-- Logs begin at Tue 2021-11-09 19:27:54 UTC, end at Tue 2021-11-09 20:54:59 UTC. -- Nov 09 19:58:56.371953 dv-cinder-801354-4-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Nov 09 19:58:56.380040 dv-cinder-801354-4-iscsi devstack@n-api.service[101135]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Nov 09 19:58:56.382052 dv-cinder-801354-4-iscsi devstack@n-api.service[101135]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Nov 9 19:58:56 2021] *** Nov 09 19:58:56.382052 dv-cinder-801354-4-iscsi devstack@n-api.service[101135]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Nov 09 19:58:56.382052 dv-cinder-801354-4-iscsi devstack@n-api.service[101135]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Nov 09 19:58:56.382052 dv-cinder-801354-4-iscsi devstack@n-api.service[101135]: nodename: dv-cinder-801354-4-iscsi Nov 09 19:58:56.382052 dv-cinder-801354-4-iscsi devstack@n-api.service[101135]: machine: x86_64 Nov 09 19:58:56.382052 dv-cinder-801354-4-iscsi devstack@n-api.service[101135]: clock source: unix Nov 09 19:58:56.382052 dv-cinder-801354-4-iscsi devstack@n-api.service[101135]: pcre jit disabled Nov 09 19:58:56.382486 dv-cinder-801354-4-iscsi devstack@n-api.service[101135]: detected number of CPU cores: 4 Nov 09 19:58:56.382486 dv-cinder-801354-4-iscsi devstack@n-api.service[101135]: current working directory: / Nov 09 19:58:56.382486 dv-cinder-801354-4-iscsi devstack@n-api.service[101135]: detected binary path: /usr/bin/uwsgi-core Nov 09 19:58:56.382486 dv-cinder-801354-4-iscsi devstack@n-api.service[101135]: your processes number limit is 47680 Nov 09 19:58:56.382486 dv-cinder-801354-4-iscsi devstack@n-api.service[101135]: your memory page size is 4096 bytes Nov 09 19:58:56.382486 dv-cinder-801354-4-iscsi devstack@n-api.service[101135]: detected max file descriptor number: 2048 Nov 09 19:58:56.382486 dv-cinder-801354-4-iscsi devstack@n-api.service[101135]: lock engine: pthread robust mutexes Nov 09 19:58:56.382486 dv-cinder-801354-4-iscsi devstack@n-api.service[101135]: thunder lock: enabled Nov 09 19:58:56.382486 dv-cinder-801354-4-iscsi devstack@n-api.service[101135]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Nov 09 19:58:56.382486 dv-cinder-801354-4-iscsi devstack@n-api.service[101135]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Nov 09 19:58:56.427803 dv-cinder-801354-4-iscsi devstack@n-api.service[101135]: Python main interpreter initialized at 0x5645ccee49c0 Nov 09 19:58:56.427803 dv-cinder-801354-4-iscsi devstack@n-api.service[101135]: python threads support enabled Nov 09 19:58:56.427803 dv-cinder-801354-4-iscsi devstack@n-api.service[101135]: your server socket listen backlog is limited to 100 connections Nov 09 19:58:56.427803 dv-cinder-801354-4-iscsi devstack@n-api.service[101135]: your mercy for graceful operations on workers is 90 seconds Nov 09 19:58:56.428171 dv-cinder-801354-4-iscsi devstack@n-api.service[101135]: mapped 403077 bytes (393 KB) for 2 cores Nov 09 19:58:56.428245 dv-cinder-801354-4-iscsi devstack@n-api.service[101135]: *** Operational MODE: preforking *** Nov 09 19:58:56.428541 dv-cinder-801354-4-iscsi devstack@n-api.service[101135]: *** uWSGI is running in multiple interpreter mode *** Nov 09 19:58:56.428541 dv-cinder-801354-4-iscsi devstack@n-api.service[101135]: spawned uWSGI master process (pid: 101135) Nov 09 19:58:56.428734 dv-cinder-801354-4-iscsi systemd[1]: Started Devstack devstack@n-api.service. Nov 09 19:58:56.432425 dv-cinder-801354-4-iscsi devstack@n-api.service[101135]: spawned uWSGI worker 1 (pid: 101136, cores: 1) Nov 09 19:58:56.432425 dv-cinder-801354-4-iscsi devstack@n-api.service[101135]: spawned uWSGI worker 2 (pid: 101137, cores: 1) Nov 09 19:58:56.432425 dv-cinder-801354-4-iscsi devstack@n-api.service[101135]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Nov 09 19:58:58.062008 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 09 19:58:58.062008 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: from cryptography.utils import int_from_bytes Nov 09 19:58:58.062749 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 09 19:58:58.062749 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: from cryptography.utils import int_from_bytes Nov 09 19:58:58.063561 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 09 19:58:58.063561 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: from cryptography.utils import int_from_bytes Nov 09 19:58:58.064041 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 09 19:58:58.064041 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: from cryptography.utils import int_from_bytes Nov 09 19:59:00.670507 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 09 19:59:00.671129 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 09 19:59:00.671239 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 09 19:59:00.671239 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 09 19:59:00.671707 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 09 19:59:00.671789 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 09 19:59:00.671879 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 09 19:59:00.671879 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 09 19:59:00.672030 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 09 19:59:00.672114 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 09 19:59:00.672191 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.672486 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.672586 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.672807 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.672896 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.673121 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.673208 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.673433 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.673528 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.673736 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.673822 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.674048 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.674147 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.674358 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.674450 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.674670 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.674755 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.674929 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.675065 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.675237 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.675336 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.675545 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.675632 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-801354-4-iscsi {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.675858 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.675944 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-801354-4-iscsi {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.676160 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.676245 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.676480 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.676568 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.676788 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.676882 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.677085 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.677171 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.677386 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.677479 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.677697 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.677790 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.677997 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.678189 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.678503 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.678658 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.678809 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.678925 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.679110 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.679234 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.679416 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.679565 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.679745 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.679878 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.680058 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.680147 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.680362 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.680479 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.680755 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.680863 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.681001 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.681086 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.681314 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.681408 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.681620 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.681706 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-801354-4-iscsi {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.681999 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.682088 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-801354-4-iscsi {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.682305 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.682403 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.682612 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.682701 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.682917 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.683001 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.683308 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.683407 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.683611 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.683702 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.683912 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.684007 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.684223 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.684315 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.684547 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.684653 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.684864 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.685476 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.685731 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.685829 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.686043 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.686182 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.686358 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.686500 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.686654 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.686816 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.686956 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.687118 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.687257 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.687424 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.687568 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.687729 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.687866 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.688044 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.688165 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.688345 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.688519 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.688672 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.688759 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.688919 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.689016 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.689223 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.689317 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.689542 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.689628 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.689855 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.689941 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.690101 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.690192 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.690403 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.690491 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.690649 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.690744 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.690963 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.691065 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.691274 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.691371 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.691578 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.691665 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.691874 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.691962 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.692173 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.692269 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.692496 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.692599 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.692799 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.692886 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.693099 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.693193 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.693411 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.693498 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.693721 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.693808 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.694031 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.694123 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.694328 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.694412 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.694640 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.694725 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.694939 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.695025 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.25 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.695250 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.695336 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.25 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.695550 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.695636 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.25 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.695877 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.25 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.695974 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.696180 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.696267 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.696507 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.696600 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.696822 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.696917 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.697130 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.697216 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.697429 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.697522 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.697729 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.697815 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.698029 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.698121 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.698330 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.698426 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.698632 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.698719 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.698940 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.699024 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.699186 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.699286 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.699480 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.699568 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.699779 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.699864 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.700076 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.700219 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.700376 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.700483 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.701323 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.701417 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.701631 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.701758 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.701940 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.702061 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.702241 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.702369 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.702535 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.702674 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.702836 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.702980 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.703136 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.703284 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.703436 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.703589 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.703734 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.703891 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.704031 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.704194 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.704327 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.704527 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.704655 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.704830 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.704954 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.705143 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.705243 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.705458 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.705551 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.705761 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.705862 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.706065 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.706172 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.706363 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.706450 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.706662 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.706765 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.706976 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.707075 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.707275 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.707374 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.707574 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.707669 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.707872 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.708038 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.708175 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.708260 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.708494 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.708596 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.708796 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.708891 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.709096 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.709181 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.709393 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.709479 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.709693 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.709781 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.709988 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.710080 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.710286 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.710371 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.710585 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.710672 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.710887 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.710971 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.711203 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.711289 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.711479 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.711576 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.711776 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.711871 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.712071 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.712156 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.712368 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.712520 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.712688 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.712773 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.712982 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.713077 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.713275 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.713360 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.713566 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.713652 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.713876 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.713970 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.714177 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.714262 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.714476 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.714568 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.714774 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.714867 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.715070 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.715156 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.715384 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 19:59:00.715477 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.715712 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.715806 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.716339 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.716520 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.716743 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.716815 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.717065 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.717165 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.717390 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.717477 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.717703 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.717788 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.718013 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.718107 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.718317 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.718409 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.718625 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.718718 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.718930 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.719017 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.719237 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.719322 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.719540 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.719638 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.719844 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.719936 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.720154 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.720242 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.720485 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.720589 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.720806 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.720905 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.721113 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.721200 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.721422 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.721567 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.721726 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.721813 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.722029 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.722122 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.722337 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.722436 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.722649 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.722741 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.722954 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.723041 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.723255 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.723348 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.723586 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.723673 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.723900 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.723985 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.724212 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.724305 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.724538 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.724628 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.724849 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.724934 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.725155 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.725241 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.725458 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.725543 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.725761 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.725846 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.726065 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.726153 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.726389 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.726494 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.726693 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.726793 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.726999 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.727098 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.727316 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.727406 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.727623 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.727712 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.727919 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.728016 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.728218 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.728308 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.728535 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.728644 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.728834 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.728931 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.729131 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.729219 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.729431 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.729529 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.729747 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.729838 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.730047 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.730137 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.730357 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.730558 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.730673 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.730754 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.730974 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.731079 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.731276 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.731372 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.731578 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.731674 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.731901 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.731994 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.732209 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.732456 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.732551 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.732779 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.732867 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.733099 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.733198 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.733406 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.733493 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.733708 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.733802 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.734024 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.734117 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.734322 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.734408 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.734620 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.734706 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.734929 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.735029 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.735235 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.735321 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.735537 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.735624 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.735840 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.735927 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.736154 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.736294 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.736484 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.736582 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.736789 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.736879 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.737115 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.737204 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.737441 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.737530 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.737739 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.737837 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.738054 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.738151 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.738369 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.738465 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.738677 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.738766 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.738973 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.739061 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.739275 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.739373 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.739571 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.739667 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.739869 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.739959 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.740163 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.740261 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.740487 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.740578 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.740788 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.740879 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.741084 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.741190 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.741383 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.741480 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.741677 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.741821 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.741975 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.742259 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.742399 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.742579 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.742676 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.742875 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.742962 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.743173 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.743261 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.743471 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.743558 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.743773 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.743873 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.744097 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.744183 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.744426 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.744515 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.744767 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.744871 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.745076 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.745169 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.745392 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.745479 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.745699 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.745798 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.746005 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.746091 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.746307 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.746394 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.746616 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.746721 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.746921 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.747017 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.747226 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.747316 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.748095 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.748189 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.748466 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.748573 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.748816 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.748907 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.749127 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.749217 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.749436 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.749525 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.749742 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.749838 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.750051 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.750141 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.750350 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.750448 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.750659 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.750748 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.750969 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.751060 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.751303 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.751399 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.751614 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.751713 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.751929 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.752017 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.752232 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.752320 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.752567 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.752670 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.752871 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.752968 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.753174 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.753262 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.753476 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.753586 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.753779 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.753870 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.754081 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.754169 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.754384 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.754482 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.754688 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.754777 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.754990 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.755079 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.755293 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.755390 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.755596 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.755685 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.755901 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.755989 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.756198 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.756287 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.756528 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.756619 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.756839 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.756937 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.757162 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.757253 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.757467 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.757557 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.757776 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.757871 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.758082 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.758172 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.758389 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.758479 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.758694 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.758783 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.759000 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.759090 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.759302 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.759392 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.759601 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.759805 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.759981 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.760069 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.760234 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.760319 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.760536 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.760644 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.760843 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.760940 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.761146 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.761237 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.761447 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.761546 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.761755 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.761846 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.762053 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.762142 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.762353 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.762451 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.762653 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.762743 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.762959 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.763102 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.763402 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.763492 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.763713 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.763802 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.764031 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.764128 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.764342 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.764455 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.764670 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.764760 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.764970 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.765060 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.765280 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.765370 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.765582 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.765672 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.765881 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.765970 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.766178 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.766268 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.766475 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.766571 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.766807 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.766909 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.767107 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.767261 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.767404 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.767551 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.767694 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.767852 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.768004 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.768146 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.768299 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.768479 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.768634 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.768788 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.768940 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.769089 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.769231 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.769379 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.769520 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.769670 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.769813 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.769954 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.770094 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.770253 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.770403 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.770558 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.770701 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.770842 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.770991 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.771140 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.771290 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.771433 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.771575 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.771716 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.771857 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.771998 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.772162 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.772305 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.772470 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.772632 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.772776 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.772923 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.773078 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.773222 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.773425 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.773573 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.773877 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.774039 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.774185 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.774385 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.774529 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.774671 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.774847 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.775026 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.775173 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.775323 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.775466 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.775608 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.775771 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.775934 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.776079 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.776233 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.776375 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.776552 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.776695 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.776849 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.776993 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.777134 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.777277 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.777418 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.777567 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.777710 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.777860 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.778003 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.778155 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.778302 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.778458 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.778609 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.779263 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.779408 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.779549 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.779690 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.779840 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.779989 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.780131 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.780279 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.780477 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.780652 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.780805 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.780957 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.781108 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.781263 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.781405 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.781548 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.781689 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.781830 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.781979 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.782122 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.782263 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.782404 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.782563 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.782714 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.782864 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.783014 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.783156 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.783305 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.783446 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.783589 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.783807 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.783959 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.784109 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.784260 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.784442 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.784606 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.784751 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.784901 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.785043 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.785184 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.785326 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.785476 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.785619 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.785761 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.785902 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.786050 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.786198 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.786359 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.786502 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.786644 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.786786 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.786927 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.787068 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.787218 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.787361 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.787502 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.787643 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.787785 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.787938 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.788088 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.788240 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.788383 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.788553 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.788695 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.788849 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.788992 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.789143 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.789292 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.789435 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.789583 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.789738 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.789890 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.790043 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.790185 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.790333 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.790481 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.790632 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.790775 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.790917 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.791058 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.791199 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.791349 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.791492 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.791634 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.791774 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.791926 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.792069 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.792219 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.792362 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.792550 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.792693 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.792835 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.792978 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.793135 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.793280 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.793421 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.793562 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.793710 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.793866 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.794016 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.794160 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.794317 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.795056 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.795277 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.795521 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.795728 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.795878 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.796021 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.796172 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.796315 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.796497 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.796664 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.796807 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.796956 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.797099 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.797252 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.797407 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.797550 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.797690 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.797840 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.797983 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.798124 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.798279 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.798422 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.798580 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.798724 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.798865 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.799022 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.799170 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.799314 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.799456 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.799597 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.799739 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.799889 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.800039 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.800190 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.800344 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.800518 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.800663 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.800816 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.800960 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.801103 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.801244 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.801387 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.801528 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.801678 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.801828 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.801971 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.802113 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.802272 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.802424 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.802569 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.802711 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.802853 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.803002 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.803145 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.803295 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.803438 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.803581 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.803722 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.803862 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.804004 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.804164 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.804314 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.804518 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.804677 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.804819 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.804961 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.805111 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.805254 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.805395 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.805543 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.805693 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.805835 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.805986 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.806141 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.806282 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.806424 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.806564 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.806716 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.806858 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.806999 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.807140 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.807281 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.807422 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.807572 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.807716 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.807858 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.808010 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.808153 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.808294 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.808489 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.808641 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.808785 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.808937 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.809080 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.809222 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.809377 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.809520 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.809662 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.809823 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.809996 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.810177 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.810323 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.810464 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.810606 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.810746 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.810889 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.811039 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.811039 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.811340 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.811488 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.811637 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.811798 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.812015 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.812162 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.812311 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.812477 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.812627 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.812769 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.812928 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.813072 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.813213 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.813361 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.813503 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.813657 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.813819 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.813965 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.814106 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.814248 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.814389 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.814539 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.814683 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.814833 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.814976 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.815117 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.815258 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.815408 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.815551 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.815715 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.815866 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.816008 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.816150 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.816300 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.816503 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.816653 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.816806 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.816955 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.817106 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.817250 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.817391 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.817549 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.817700 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.817849 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.818004 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.818148 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.818290 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.818438 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.818588 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.818730 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.818923 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.819070 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.819221 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.819364 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.819517 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.819688 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.819842 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.819986 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.820150 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.820295 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.820459 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.820620 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.820765 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.820906 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.821047 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.821187 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.821329 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.821489 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.821673 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.821819 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.821968 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.822117 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.822266 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.822423 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.822567 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.822567 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.822843 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.822985 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.823126 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.823126 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.823419 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.823568 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.823712 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.823712 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.823996 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.823996 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.824267 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.824456 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.824607 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.824749 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.824902 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.825045 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.825203 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.825352 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.825495 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.826123 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.826278 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.826421 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.826563 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.826704 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.826845 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.826986 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.827135 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.827278 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.827418 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.827576 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.827726 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.827880 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.828023 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.828164 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.828305 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.828466 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.828624 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.828787 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.828931 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.829073 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.829213 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.829354 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.829506 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.829657 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.829809 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.829953 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.830117 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.830273 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.830416 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.830558 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.830701 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.830856 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.831005 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.831148 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.831300 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.831443 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.831590 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.831740 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.831892 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.832034 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.832176 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.832317 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.832537 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.832685 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.832826 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.832969 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.833117 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.833270 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.833420 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.833563 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.833704 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.833845 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.833987 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.834134 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.834284 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.834427 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.834568 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.834709 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.834850 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.834992 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.835152 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.835303 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.835445 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.835586 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.835727 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.835876 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.836032 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.836174 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.836316 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.836477 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.836623 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.836776 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.836925 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.837085 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.837229 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.837376 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.837525 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.837677 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.837819 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.837961 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.838113 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.838263 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.838406 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.838563 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.838711 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.838863 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.839006 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.839149 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.839303 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.839453 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.839595 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.839737 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.839879 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.840020 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.840175 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.840319 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.840511 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.840658 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.840811 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.840952 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.841488 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.841645 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.841788 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.841931 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.842080 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.842223 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.842380 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.842525 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.842674 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.842817 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.842959 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.843124 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.843268 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.843418 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.843560 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.843701 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.843848 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.843999 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.844142 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.844283 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.844450 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.844611 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.844755 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.844921 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.845066 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.845208 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.845351 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.845494 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.845643 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.845797 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.845941 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.846082 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.846223 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.846364 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.846515 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.846687 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.846845 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.846988 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.847130 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.847271 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.847421 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.847574 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.847718 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.847860 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.848001 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.848149 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.848300 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.848485 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.848637 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.848800 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.848945 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.849094 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.849249 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.849393 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.849535 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.849678 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.849820 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.850006 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.850152 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.850295 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.850437 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.850578 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.850731 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.850886 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.851029 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.851178 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.851321 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.851463 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.851605 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.851756 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.851900 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.852042 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.852184 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.852184 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.852492 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.852663 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.852816 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.852816 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.853095 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.853238 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.853389 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.853539 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.853681 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.853825 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.853966 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.854108 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.854258 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.854412 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.854554 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.854695 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.854844 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.854988 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.855142 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.855285 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.855435 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.855578 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.855719 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.855869 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.856014 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.856167 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.856310 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.856496 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.856658 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.857400 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.857553 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.857697 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.857839 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.857981 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.858133 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.858285 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.858430 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.858587 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.858730 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.858873 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.859038 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.859185 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.859327 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.859469 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.859614 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.859804 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.859954 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.860098 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.860248 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.860422 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.860584 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.860739 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.860882 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.861024 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.861167 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.861316 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.861459 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.861610 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.861761 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.861905 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.862046 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.862199 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.862342 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.862497 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.862641 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.862784 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.862933 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.863083 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.863238 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.863382 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.863524 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.863667 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.863809 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.863968 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.864185 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.864332 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.864503 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.864645 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.864787 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.864929 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.865083 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.865227 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.865510 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.865660 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.865830 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.865990 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.866152 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.866296 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.866438 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.866581 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.866746 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.866908 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.867052 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.867194 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.867335 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.867485 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.867634 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.867785 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.867936 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.868088 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.868231 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.868372 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.868741 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.868902 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.869047 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.869199 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.869350 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.869493 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.869646 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.869798 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.869940 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.870093 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.870093 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.870363 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.870514 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.870666 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.870816 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.870966 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.871139 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.871290 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.871442 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.871586 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.871759 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.871916 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.872070 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.872221 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.872372 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.872598 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.872773 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.872919 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.873061 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.873212 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.873363 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.873507 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.873655 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.873799 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.873949 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.874119 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.874264 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.874407 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.874555 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.874698 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.874847 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.875002 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.875146 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.875295 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.875445 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.875588 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.875738 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.875901 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.876052 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.876194 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.876336 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.876512 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.876629 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.876720 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.876874 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.877030 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.877180 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.877324 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.877474 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.877618 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.877770 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.877913 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.878056 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.878198 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.878348 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.878504 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.878648 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.878790 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.878932 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.879075 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.879225 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.879368 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.879520 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.879673 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.879816 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.879966 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.880110 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.880259 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.880438 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.880590 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.880733 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.880891 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.881035 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.881185 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.881334 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.881477 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.881632 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.881783 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.881926 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.882069 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.882211 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.882360 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.882509 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.882661 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.882804 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.882947 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.883088 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.883237 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.883389 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.883542 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.883685 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.883834 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.883976 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.884124 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.884277 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.884511 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.884675 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.884826 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.885110 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.885262 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.885471 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.885632 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.885776 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.885918 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.886059 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.886201 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.886354 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.886497 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.886639 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.886781 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.886930 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.887083 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.887226 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.887376 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.887529 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.887672 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.887813 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.887964 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.888671 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.888790 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.888908 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.889044 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.889351 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.889455 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.889657 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.889747 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.889962 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.890051 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.890266 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.890358 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.890570 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.890659 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.890875 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.890990 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.891187 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.891275 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.891499 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.891587 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.891805 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.891893 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.892112 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.892200 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.892437 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.892603 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.892758 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.892901 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.893140 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.893287 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.893430 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.893572 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.893717 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.893880 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.894031 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.894184 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.894329 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.894473 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.894616 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.894769 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.894912 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.895081 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.895226 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.895370 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.895521 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.895664 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.895819 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.895963 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.896113 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.896256 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.896426 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.896577 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.896730 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.896882 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.897052 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.897199 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.897350 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.897494 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.897654 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.897797 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.897941 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.898088 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.898241 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.898390 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.898534 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.898684 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.898836 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.898993 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.899144 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.899294 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.899447 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.899597 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.899747 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.899898 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.900043 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.900185 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.900327 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.900535 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.900682 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.900837 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.900990 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.901134 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.901276 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.901429 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.901580 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.901733 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.901877 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.902018 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.902168 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.902318 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.902469 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.902613 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.902774 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.902924 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.903067 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.903210 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.903371 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.903515 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.903705 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.903864 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.904037 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.904198 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.904435 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.904590 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.904734 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.904877 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.905019 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.905178 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.905337 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.905480 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.905624 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.905766 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.905909 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.906059 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.906210 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.906355 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.906498 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.906640 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.906782 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.906956 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.907126 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.907291 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.907435 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.907577 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.907729 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.907872 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.908015 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.908165 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.908309 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.908473 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.908637 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.908782 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.908950 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.909107 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.909250 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.909394 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.909549 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.909693 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.909835 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.909977 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.910119 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.910269 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.910413 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.910555 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.910697 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.910839 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.911019 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.911184 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.911335 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.911480 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.911665 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.911816 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.911959 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.912110 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.912296 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.912469 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.912629 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.912784 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.912938 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 09 19:59:00.913090 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.913233 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.913515 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 19:59:00.913753 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 09 19:59:00.935990 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG oslo_db.sqlalchemy.engines [None req-57aae84e-4ef2-4989-a1fc-74fac9aedcb2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101136) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 09 19:59:00.937278 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG oslo_db.sqlalchemy.engines [None req-81092207-a5d8-427b-a21e-aef9575668d0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101137) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 09 19:59:01.097626 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.context [None req-57aae84e-4ef2-4989-a1fc-74fac9aedcb2 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3fe77ec2-f067-4504-9205-b014cb4accd4(cell1) {{(pid=101136) load_cells /opt/stack/nova/nova/context.py:464}} Nov 09 19:59:01.099311 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.context [None req-81092207-a5d8-427b-a21e-aef9575668d0 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3fe77ec2-f067-4504-9205-b014cb4accd4(cell1) {{(pid=101137) load_cells /opt/stack/nova/nova/context.py:464}} Nov 09 19:59:01.102202 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG oslo_concurrency.lockutils [None req-57aae84e-4ef2-4989-a1fc-74fac9aedcb2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 19:59:01.103640 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG oslo_concurrency.lockutils [None req-81092207-a5d8-427b-a21e-aef9575668d0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 19:59:01.103924 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG oslo_concurrency.lockutils [None req-57aae84e-4ef2-4989-a1fc-74fac9aedcb2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 19:59:01.104832 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG oslo_concurrency.lockutils [None req-57aae84e-4ef2-4989-a1fc-74fac9aedcb2 None None] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 19:59:01.105240 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG oslo_concurrency.lockutils [None req-81092207-a5d8-427b-a21e-aef9575668d0 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 19:59:01.106048 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG oslo_concurrency.lockutils [None req-81092207-a5d8-427b-a21e-aef9575668d0 None None] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 19:59:01.107593 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG oslo_concurrency.lockutils [None req-57aae84e-4ef2-4989-a1fc-74fac9aedcb2 None None] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 19:59:01.108503 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG oslo_concurrency.lockutils [None req-81092207-a5d8-427b-a21e-aef9575668d0 None None] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 19:59:01.117920 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG oslo_db.sqlalchemy.engines [None req-57aae84e-4ef2-4989-a1fc-74fac9aedcb2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101136) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 09 19:59:01.120382 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG oslo_db.sqlalchemy.engines [None req-57aae84e-4ef2-4989-a1fc-74fac9aedcb2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101136) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 09 19:59:01.124178 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG oslo_db.sqlalchemy.engines [None req-81092207-a5d8-427b-a21e-aef9575668d0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101137) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 09 19:59:01.128261 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG oslo_db.sqlalchemy.engines [None req-81092207-a5d8-427b-a21e-aef9575668d0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101137) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 09 19:59:01.382773 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG oslo_db.sqlalchemy.engines [None req-57aae84e-4ef2-4989-a1fc-74fac9aedcb2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101136) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 09 19:59:01.390401 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG oslo_db.sqlalchemy.engines [None req-81092207-a5d8-427b-a21e-aef9575668d0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101137) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 09 19:59:01.728677 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: WARNING keystonemiddleware.auth_token [None req-81092207-a5d8-427b-a21e-aef9575668d0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 09 19:59:01.735828 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: WARNING keystonemiddleware.auth_token [None req-81092207-a5d8-427b-a21e-aef9575668d0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 09 19:59:01.736005 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: WARNING keystonemiddleware.auth_token [None req-57aae84e-4ef2-4989-a1fc-74fac9aedcb2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 09 19:59:01.742576 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: WARNING keystonemiddleware.auth_token [None req-57aae84e-4ef2-4989-a1fc-74fac9aedcb2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 09 19:59:02.082753 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: WARNING keystonemiddleware.auth_token [None req-81092207-a5d8-427b-a21e-aef9575668d0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 09 19:59:02.087850 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: WARNING keystonemiddleware.auth_token [None req-81092207-a5d8-427b-a21e-aef9575668d0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 09 19:59:02.093982 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5645ccee49c0 pid: 101137 (default app) Nov 09 19:59:02.096003 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi [None req-81092207-a5d8-427b-a21e-aef9575668d0 None None] Calling method '>' {{(pid=101137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 19:59:02.097187 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: INFO nova.api.openstack.requestlog [None req-81092207-a5d8-427b-a21e-aef9575668d0 None None] 10.222.0.25 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001724 Nov 09 19:59:02.097602 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: [pid: 101137|app: 0|req: 1/1] 10.222.0.25 () {50 vars in 788 bytes} [Tue Nov 9 19:59:02 2021] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 19:59:02.098309 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: WARNING keystonemiddleware.auth_token [None req-57aae84e-4ef2-4989-a1fc-74fac9aedcb2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 09 19:59:02.103616 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: WARNING keystonemiddleware.auth_token [None req-57aae84e-4ef2-4989-a1fc-74fac9aedcb2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 09 19:59:02.109579 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5645ccee49c0 pid: 101136 (default app) Nov 09 20:00:23.349967 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi [None req-81092207-a5d8-427b-a21e-aef9575668d0 None None] Calling method '>' {{(pid=101137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:00:23.350987 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: INFO nova.api.openstack.requestlog [None req-81092207-a5d8-427b-a21e-aef9575668d0 None None] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Nov 09 20:00:23.351372 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: [pid: 101137|app: 0|req: 2/2] 10.222.0.25 () {54 vars in 930 bytes} [Tue Nov 9 20:00:23 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:00:23.788353 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi [None req-96738b2f-973e-42a1-bd64-18ce752a52f5 admin admin] Calling method '>' {{(pid=101136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:00:23.817004 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: INFO nova.api.openstack.requestlog [None req-96738b2f-973e-42a1-bd64-18ce752a52f5 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.456372 Nov 09 20:00:23.817737 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: [pid: 101136|app: 0|req: 1/3] 10.222.0.25 () {60 vars in 1291 bytes} [Tue Nov 9 20:00:23 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:00:26.194201 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi [None req-81092207-a5d8-427b-a21e-aef9575668d0 None None] Calling method '>' {{(pid=101137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:00:26.195180 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: INFO nova.api.openstack.requestlog [None req-81092207-a5d8-427b-a21e-aef9575668d0 None None] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001384 Nov 09 20:00:26.196536 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: [pid: 101137|app: 0|req: 3/4] 10.222.0.25 () {54 vars in 930 bytes} [Tue Nov 9 20:00:26 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:00:26.266448 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi [None req-10f67f48-014b-4c5a-88af-314922a2254f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "id": "c1", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 256, "os-flavor-access:is_public": true, "vcpus": 1, "swap": 0, "disk": 1}} {{(pid=101136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:00:26.286792 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 20:00:26.286792 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: warnings.warn(msg) Nov 09 20:00:26.317979 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: INFO nova.api.openstack.requestlog [None req-10f67f48-014b-4c5a-88af-314922a2254f admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.115273 Nov 09 20:00:26.318696 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: [pid: 101136|app: 0|req: 2/5] 10.222.0.25 () {64 vars in 1282 bytes} [Tue Nov 9 20:00:26 2021] POST /compute/v2.1/flavors => generated 407 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 20:00:26.569317 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi [None req-04353372-4f2c-4d5a-8c05-01e8ab8a0032 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:00:26.572304 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 20:00:26.572304 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: warnings.warn(msg) Nov 09 20:00:26.623900 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: INFO nova.api.openstack.requestlog [None req-04353372-4f2c-4d5a-8c05-01e8ab8a0032 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.295670 Nov 09 20:00:26.624811 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: [pid: 101137|app: 0|req: 4/6] 10.222.0.25 () {64 vars in 1335 bytes} [Tue Nov 9 20:00:26 2021] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:00:28.991715 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi [None req-10f67f48-014b-4c5a-88af-314922a2254f admin admin] Calling method '>' {{(pid=101136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:00:28.993337 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: INFO nova.api.openstack.requestlog [None req-10f67f48-014b-4c5a-88af-314922a2254f admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002059 Nov 09 20:00:28.993913 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: [pid: 101136|app: 0|req: 3/7] 10.222.0.25 () {54 vars in 930 bytes} [Tue Nov 9 20:00:28 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:00:29.115380 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi [None req-0c631f0a-4e92-47d0-b845-cabf46eda7e6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 5, "rxtx_factor": 1.0, "ram": 512, "vcpus": 1, "name": "ds512M", "swap": 0, "os-flavor-access:is_public": true, "id": "d1"}} {{(pid=101137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:00:29.133842 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 20:00:29.133842 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: warnings.warn(msg) Nov 09 20:00:29.159077 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: INFO nova.api.openstack.requestlog [None req-0c631f0a-4e92-47d0-b845-cabf46eda7e6 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.158003 Nov 09 20:00:29.160042 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: [pid: 101137|app: 0|req: 5/8] 10.222.0.25 () {64 vars in 1282 bytes} [Tue Nov 9 20:00:28 2021] POST /compute/v2.1/flavors => generated 404 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 20:00:29.172296 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi [None req-7388f8fc-e076-4b86-82fa-93ca5a5265e2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:00:29.173761 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 20:00:29.173761 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: warnings.warn(msg) Nov 09 20:00:29.207633 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: INFO nova.api.openstack.requestlog [None req-7388f8fc-e076-4b86-82fa-93ca5a5265e2 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038965 Nov 09 20:00:29.208215 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: [pid: 101136|app: 0|req: 4/9] 10.222.0.25 () {64 vars in 1335 bytes} [Tue Nov 9 20:00:29 2021] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:00:31.605992 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi [None req-0c631f0a-4e92-47d0-b845-cabf46eda7e6 admin admin] Calling method '>' {{(pid=101137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:00:31.607040 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: INFO nova.api.openstack.requestlog [None req-0c631f0a-4e92-47d0-b845-cabf46eda7e6 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001503 Nov 09 20:00:31.607693 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: [pid: 101137|app: 0|req: 6/10] 10.222.0.25 () {54 vars in 930 bytes} [Tue Nov 9 20:00:31 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:00:31.673239 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi [None req-fe5081c5-8384-4dd5-9ec5-dab8ef1ea3c6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "d2", "os-flavor-access:is_public": true, "swap": 0, "disk": 10, "ram": 1024, "name": "ds1G", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1}} {{(pid=101136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:00:31.694968 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: INFO nova.api.openstack.requestlog [None req-fe5081c5-8384-4dd5-9ec5-dab8ef1ea3c6 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.079849 Nov 09 20:00:31.695842 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: [pid: 101136|app: 0|req: 5/11] 10.222.0.25 () {64 vars in 1282 bytes} [Tue Nov 9 20:00:31 2021] POST /compute/v2.1/flavors => generated 404 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 20:00:31.708884 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi [None req-8c9b8d12-883c-4739-bab5-d5d2e211ebad admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:00:31.733327 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: INFO nova.api.openstack.requestlog [None req-8c9b8d12-883c-4739-bab5-d5d2e211ebad admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028115 Nov 09 20:00:31.734129 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: [pid: 101137|app: 0|req: 7/12] 10.222.0.25 () {64 vars in 1335 bytes} [Tue Nov 9 20:00:31 2021] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:00:34.063794 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi [None req-fe5081c5-8384-4dd5-9ec5-dab8ef1ea3c6 admin admin] Calling method '>' {{(pid=101136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:00:34.067143 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: INFO nova.api.openstack.requestlog [None req-fe5081c5-8384-4dd5-9ec5-dab8ef1ea3c6 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Nov 09 20:00:34.067143 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: [pid: 101136|app: 0|req: 6/13] 10.222.0.25 () {54 vars in 930 bytes} [Tue Nov 9 20:00:34 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:00:34.136465 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi [None req-8e74b93a-5c7c-4502-a127-e9e73ccf9663 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "name": "ds2G", "disk": 10, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 2048, "vcpus": 2, "id": "d3"}} {{(pid=101137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:00:34.154792 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: INFO nova.api.openstack.requestlog [None req-8e74b93a-5c7c-4502-a127-e9e73ccf9663 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.081007 Nov 09 20:00:34.155339 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: [pid: 101137|app: 0|req: 8/14] 10.222.0.25 () {64 vars in 1282 bytes} [Tue Nov 9 20:00:34 2021] POST /compute/v2.1/flavors => generated 404 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 09 20:00:34.168284 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi [None req-3e7b8a68-5abb-4c4a-bccb-7c555c2f69b5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:00:34.191553 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: INFO nova.api.openstack.requestlog [None req-3e7b8a68-5abb-4c4a-bccb-7c555c2f69b5 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027549 Nov 09 20:00:34.192121 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: [pid: 101136|app: 0|req: 7/15] 10.222.0.25 () {64 vars in 1335 bytes} [Tue Nov 9 20:00:34 2021] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:00:36.543529 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi [None req-8e74b93a-5c7c-4502-a127-e9e73ccf9663 admin admin] Calling method '>' {{(pid=101137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:00:36.544587 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: INFO nova.api.openstack.requestlog [None req-8e74b93a-5c7c-4502-a127-e9e73ccf9663 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002192 Nov 09 20:00:36.545299 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: [pid: 101137|app: 0|req: 9/16] 10.222.0.25 () {54 vars in 930 bytes} [Tue Nov 9 20:00:36 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:00:36.607649 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi [None req-f76d1f24-4b1c-446f-9db6-4db2f22db102 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "id": "d4", "ram": 4096, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "disk": 20}} {{(pid=101136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:00:36.630808 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: INFO nova.api.openstack.requestlog [None req-f76d1f24-4b1c-446f-9db6-4db2f22db102 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.078708 Nov 09 20:00:36.632180 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: [pid: 101136|app: 0|req: 8/17] 10.222.0.25 () {64 vars in 1282 bytes} [Tue Nov 9 20:00:36 2021] POST /compute/v2.1/flavors => generated 404 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 20:00:36.645625 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi [None req-2ad0adfe-aa5f-4083-8f69-1be4084ad6a1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:00:36.677433 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: INFO nova.api.openstack.requestlog [None req-2ad0adfe-aa5f-4083-8f69-1be4084ad6a1 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035594 Nov 09 20:00:36.678023 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: [pid: 101137|app: 0|req: 10/18] 10.222.0.25 () {64 vars in 1335 bytes} [Tue Nov 9 20:00:36 2021] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:00:39.087014 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi [None req-f76d1f24-4b1c-446f-9db6-4db2f22db102 admin admin] Calling method '>' {{(pid=101136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:00:39.088017 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: INFO nova.api.openstack.requestlog [None req-f76d1f24-4b1c-446f-9db6-4db2f22db102 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Nov 09 20:00:39.088625 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: [pid: 101136|app: 0|req: 9/19] 10.222.0.25 () {54 vars in 930 bytes} [Tue Nov 9 20:00:39 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:00:39.161985 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi [None req-80bc1eab-52eb-4fca-b9e0-04f98329a817 admin admin] Calling method '>' {{(pid=101137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:00:39.191553 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: INFO nova.api.openstack.requestlog [None req-80bc1eab-52eb-4fca-b9e0-04f98329a817 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.094160 Nov 09 20:00:39.192097 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: [pid: 101137|app: 0|req: 11/20] 10.222.0.25 () {60 vars in 1291 bytes} [Tue Nov 9 20:00:39 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:00:41.502484 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi [None req-f76d1f24-4b1c-446f-9db6-4db2f22db102 admin admin] Calling method '>' {{(pid=101136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:00:41.503861 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: INFO nova.api.openstack.requestlog [None req-f76d1f24-4b1c-446f-9db6-4db2f22db102 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001940 Nov 09 20:00:41.504433 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: [pid: 101136|app: 0|req: 10/21] 10.222.0.25 () {54 vars in 930 bytes} [Tue Nov 9 20:00:41 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 20:00:41.575891 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi [None req-aa4e16a5-d6bf-4df7-8600-dca6dc380548 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "swap": 0, "rxtx_factor": 1.0, "disk": 1, "name": "m1.tiny", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "os-flavor-access:is_public": true, "id": "1"}} {{(pid=101137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:00:41.596638 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: INFO nova.api.openstack.requestlog [None req-aa4e16a5-d6bf-4df7-8600-dca6dc380548 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.083861 Nov 09 20:00:41.597331 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: [pid: 101137|app: 0|req: 12/22] 10.222.0.25 () {64 vars in 1282 bytes} [Tue Nov 9 20:00:41 2021] POST /compute/v2.1/flavors => generated 402 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 20:00:41.613421 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi [None req-d8a3ca1a-8a24-4bde-bca4-2bdac68076b4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:00:41.639320 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: INFO nova.api.openstack.requestlog [None req-d8a3ca1a-8a24-4bde-bca4-2bdac68076b4 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030611 Nov 09 20:00:41.639903 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: [pid: 101136|app: 0|req: 11/23] 10.222.0.25 () {64 vars in 1332 bytes} [Tue Nov 9 20:00:41 2021] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 20:00:44.256046 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi [None req-aa4e16a5-d6bf-4df7-8600-dca6dc380548 admin admin] Calling method '>' {{(pid=101137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:00:44.257138 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: INFO nova.api.openstack.requestlog [None req-aa4e16a5-d6bf-4df7-8600-dca6dc380548 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001530 Nov 09 20:00:44.257539 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: [pid: 101137|app: 0|req: 13/24] 10.222.0.25 () {54 vars in 930 bytes} [Tue Nov 9 20:00:44 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:00:44.320480 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi [None req-60c7e42e-c075-4ed8-ac1d-669adc0aecad admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "2", "vcpus": 1, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "m1.small", "swap": 0, "ram": 2048}} {{(pid=101136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:00:44.341224 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: INFO nova.api.openstack.requestlog [None req-60c7e42e-c075-4ed8-ac1d-669adc0aecad admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.075776 Nov 09 20:00:44.341769 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: [pid: 101136|app: 0|req: 12/25] 10.222.0.25 () {64 vars in 1282 bytes} [Tue Nov 9 20:00:44 2021] POST /compute/v2.1/flavors => generated 405 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 20:00:44.355153 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi [None req-373ff543-d491-4202-bf34-bce9a706bf51 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:00:44.377561 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: INFO nova.api.openstack.requestlog [None req-373ff543-d491-4202-bf34-bce9a706bf51 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026572 Nov 09 20:00:44.378130 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: [pid: 101137|app: 0|req: 14/26] 10.222.0.25 () {64 vars in 1332 bytes} [Tue Nov 9 20:00:44 2021] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:00:46.684505 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi [None req-60c7e42e-c075-4ed8-ac1d-669adc0aecad admin admin] Calling method '>' {{(pid=101136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:00:46.685520 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: INFO nova.api.openstack.requestlog [None req-60c7e42e-c075-4ed8-ac1d-669adc0aecad admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Nov 09 20:00:46.685920 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: [pid: 101136|app: 0|req: 13/27] 10.222.0.25 () {54 vars in 930 bytes} [Tue Nov 9 20:00:46 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 20:00:46.744301 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi [None req-499d75fd-ec42-4810-95d6-5092db6eb61a admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "3", "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "m1.medium", "os-flavor-access:is_public": true, "disk": 40, "ram": 4096, "swap": 0}} {{(pid=101137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:00:46.762955 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: INFO nova.api.openstack.requestlog [None req-499d75fd-ec42-4810-95d6-5092db6eb61a admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.070545 Nov 09 20:00:46.763535 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: [pid: 101137|app: 0|req: 15/28] 10.222.0.25 () {64 vars in 1282 bytes} [Tue Nov 9 20:00:46 2021] POST /compute/v2.1/flavors => generated 406 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 09 20:00:46.776186 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi [None req-3096322c-ddc0-4efe-82cb-42598ece044f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:00:46.798438 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: INFO nova.api.openstack.requestlog [None req-3096322c-ddc0-4efe-82cb-42598ece044f admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025795 Nov 09 20:00:46.799020 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: [pid: 101136|app: 0|req: 14/29] 10.222.0.25 () {64 vars in 1332 bytes} [Tue Nov 9 20:00:46 2021] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:00:49.164227 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi [None req-499d75fd-ec42-4810-95d6-5092db6eb61a admin admin] Calling method '>' {{(pid=101137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:00:49.165933 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: INFO nova.api.openstack.requestlog [None req-499d75fd-ec42-4810-95d6-5092db6eb61a admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002124 Nov 09 20:00:49.166335 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: [pid: 101137|app: 0|req: 16/30] 10.222.0.25 () {54 vars in 930 bytes} [Tue Nov 9 20:00:49 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:00:49.246866 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi [None req-ff2f65bb-51af-4c83-a5d8-de0f4d756cf2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.large", "os-flavor-access:is_public": true, "id": "4", "swap": 0, "vcpus": 4, "rxtx_factor": 1.0, "disk": 80, "ram": 8192}} {{(pid=101136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:00:49.334583 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: INFO nova.api.openstack.requestlog [None req-ff2f65bb-51af-4c83-a5d8-de0f4d756cf2 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.160592 Nov 09 20:00:49.335912 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: [pid: 101136|app: 0|req: 15/31] 10.222.0.25 () {64 vars in 1282 bytes} [Tue Nov 9 20:00:49 2021] POST /compute/v2.1/flavors => generated 405 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 20:00:49.381047 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi [None req-f829c436-d740-40a6-9ecf-28bb4e6449b1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:00:49.405704 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: INFO nova.api.openstack.requestlog [None req-f829c436-d740-40a6-9ecf-28bb4e6449b1 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028429 Nov 09 20:00:49.406375 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: [pid: 101137|app: 0|req: 17/32] 10.222.0.25 () {64 vars in 1332 bytes} [Tue Nov 9 20:00:49 2021] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:00:51.728173 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi [None req-ff2f65bb-51af-4c83-a5d8-de0f4d756cf2 admin admin] Calling method '>' {{(pid=101136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:00:51.729207 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: INFO nova.api.openstack.requestlog [None req-ff2f65bb-51af-4c83-a5d8-de0f4d756cf2 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 Nov 09 20:00:51.730368 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: [pid: 101136|app: 0|req: 16/33] 10.222.0.25 () {54 vars in 930 bytes} [Tue Nov 9 20:00:51 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:00:51.794674 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi [None req-b223e921-fe24-4e96-adb3-5d21be3ae5bd admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "5", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.xlarge", "swap": 0, "ram": 16384, "vcpus": 8, "os-flavor-access:is_public": true, "disk": 160}} {{(pid=101137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:00:51.813570 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: INFO nova.api.openstack.requestlog [None req-b223e921-fe24-4e96-adb3-5d21be3ae5bd admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.076745 Nov 09 20:00:51.814258 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: [pid: 101137|app: 0|req: 18/34] 10.222.0.25 () {64 vars in 1282 bytes} [Tue Nov 9 20:00:51 2021] POST /compute/v2.1/flavors => generated 408 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 20:00:51.828506 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi [None req-a67c2348-6f38-4ed2-bfa7-afe94ff8b44d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:00:51.854035 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: INFO nova.api.openstack.requestlog [None req-a67c2348-6f38-4ed2-bfa7-afe94ff8b44d admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029515 Nov 09 20:00:51.855258 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: [pid: 101136|app: 0|req: 17/35] 10.222.0.25 () {64 vars in 1332 bytes} [Tue Nov 9 20:00:51 2021] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:01:30.990270 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi [None req-b223e921-fe24-4e96-adb3-5d21be3ae5bd admin admin] Calling method '>' {{(pid=101137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:01:30.991317 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: INFO nova.api.openstack.requestlog [None req-b223e921-fe24-4e96-adb3-5d21be3ae5bd admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001425 Nov 09 20:01:30.991701 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: [pid: 101137|app: 0|req: 19/36] 10.222.0.25 () {54 vars in 930 bytes} [Tue Nov 9 20:01:30 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:01:31.052864 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi [None req-94017f5a-02cd-456b-a4a4-b762e314b376 admin admin] Calling method '>' {{(pid=101136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:01:31.070031 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: INFO nova.api.openstack.requestlog [None req-94017f5a-02cd-456b-a4a4-b762e314b376 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.069714 Nov 09 20:01:31.070557 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: [pid: 101136|app: 0|req: 18/37] 10.222.0.25 () {60 vars in 1291 bytes} [Tue Nov 9 20:01:30 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:01:32.588264 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi [None req-b223e921-fe24-4e96-adb3-5d21be3ae5bd admin admin] Calling method '>' {{(pid=101137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:01:32.589289 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: INFO nova.api.openstack.requestlog [None req-b223e921-fe24-4e96-adb3-5d21be3ae5bd admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 Nov 09 20:01:32.589683 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: [pid: 101137|app: 0|req: 20/38] 10.222.0.25 () {56 vars in 1074 bytes} [Tue Nov 9 20:01:32 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:01:32.780804 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi [None req-4106b8ae-fd60-4615-86c3-49ede2b0c404 admin admin] Calling method '>' {{(pid=101136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:01:32.786434 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: INFO nova.api.openstack.wsgi [None req-4106b8ae-fd60-4615-86c3-49ede2b0c404 admin admin] HTTP exception thrown: Flavor 42 could not be found. Nov 09 20:01:32.787093 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi [None req-4106b8ae-fd60-4615-86c3-49ede2b0c404 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=101136) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 09 20:01:32.787887 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: INFO nova.api.openstack.requestlog [None req-4106b8ae-fd60-4615-86c3-49ede2b0c404 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.058656 Nov 09 20:01:32.788420 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: [pid: 101136|app: 0|req: 19/39] 10.222.0.25 () {60 vars in 1190 bytes} [Tue Nov 9 20:01:32 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 09 20:01:32.798872 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi [None req-5067d841-6f68-4e7d-88aa-2bb9854e1821 admin admin] Calling method '>' {{(pid=101137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:01:32.818757 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: INFO nova.api.openstack.requestlog [None req-5067d841-6f68-4e7d-88aa-2bb9854e1821 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.023469 Nov 09 20:01:32.819285 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: [pid: 101137|app: 0|req: 21/40] 10.222.0.25 () {60 vars in 1210 bytes} [Tue Nov 9 20:01:32 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:01:32.829247 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi [None req-d74f1bb1-6a0c-45e2-aa60-133d42483300 admin admin] Calling method '>' {{(pid=101136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:01:32.850130 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: INFO nova.api.openstack.requestlog [None req-d74f1bb1-6a0c-45e2-aa60-133d42483300 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024310 Nov 09 20:01:32.850652 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: [pid: 101136|app: 0|req: 20/41] 10.222.0.25 () {60 vars in 1210 bytes} [Tue Nov 9 20:01:32 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 09 20:01:32.861038 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi [None req-c6b551dd-c30f-417a-9aa9-6514347a9b0f admin admin] Calling method '>' {{(pid=101137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:01:32.866345 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: INFO nova.api.openstack.wsgi [None req-c6b551dd-c30f-417a-9aa9-6514347a9b0f admin admin] HTTP exception thrown: Flavor 42 could not be found. Nov 09 20:01:32.866896 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi [None req-c6b551dd-c30f-417a-9aa9-6514347a9b0f admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=101137) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 09 20:01:32.867666 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: INFO nova.api.openstack.requestlog [None req-c6b551dd-c30f-417a-9aa9-6514347a9b0f admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.010218 Nov 09 20:01:32.868144 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: [pid: 101137|app: 0|req: 22/42] 10.222.0.25 () {60 vars in 1190 bytes} [Tue Nov 9 20:01:32 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 09 20:01:34.278325 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi [None req-d74f1bb1-6a0c-45e2-aa60-133d42483300 admin admin] Calling method '>' {{(pid=101136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:01:34.279346 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: INFO nova.api.openstack.requestlog [None req-d74f1bb1-6a0c-45e2-aa60-133d42483300 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 Nov 09 20:01:34.279737 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: [pid: 101136|app: 0|req: 21/43] 10.222.0.25 () {56 vars in 1074 bytes} [Tue Nov 9 20:01:34 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:01:34.469135 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi [None req-30fcac23-ea9e-4725-90cb-3769931f81ad admin admin] Calling method '>' {{(pid=101137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:01:34.474686 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: INFO nova.api.openstack.wsgi [None req-30fcac23-ea9e-4725-90cb-3769931f81ad admin admin] HTTP exception thrown: Flavor 84 could not be found. Nov 09 20:01:34.475234 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi [None req-30fcac23-ea9e-4725-90cb-3769931f81ad admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=101137) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 09 20:01:34.476002 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: INFO nova.api.openstack.requestlog [None req-30fcac23-ea9e-4725-90cb-3769931f81ad admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.057254 Nov 09 20:01:34.476517 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: [pid: 101137|app: 0|req: 23/44] 10.222.0.25 () {60 vars in 1190 bytes} [Tue Nov 9 20:01:34 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Nov 09 20:01:34.487098 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi [None req-d61c3950-9cd9-47a2-a513-59e2ff723e98 admin admin] Calling method '>' {{(pid=101136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:01:34.500631 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: INFO nova.api.openstack.requestlog [None req-d61c3950-9cd9-47a2-a513-59e2ff723e98 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017222 Nov 09 20:01:34.501151 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: [pid: 101136|app: 0|req: 22/45] 10.222.0.25 () {60 vars in 1210 bytes} [Tue Nov 9 20:01:34 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:01:34.511232 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi [None req-55b363fb-af29-47be-86dc-144f8941304a admin admin] Calling method '>' {{(pid=101137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:01:34.524559 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: INFO nova.api.openstack.requestlog [None req-55b363fb-af29-47be-86dc-144f8941304a admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017125 Nov 09 20:01:34.525078 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: [pid: 101137|app: 0|req: 24/46] 10.222.0.25 () {60 vars in 1210 bytes} [Tue Nov 9 20:01:34 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:01:34.535618 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi [None req-11c069c0-2731-48d0-a741-f76e7ee22c89 admin admin] Calling method '>' {{(pid=101136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:01:34.540713 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: INFO nova.api.openstack.wsgi [None req-11c069c0-2731-48d0-a741-f76e7ee22c89 admin admin] HTTP exception thrown: Flavor 84 could not be found. Nov 09 20:01:34.541259 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi [None req-11c069c0-2731-48d0-a741-f76e7ee22c89 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=101136) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 09 20:01:34.542621 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: INFO nova.api.openstack.requestlog [None req-11c069c0-2731-48d0-a741-f76e7ee22c89 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.010522 Nov 09 20:01:34.543081 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: [pid: 101136|app: 0|req: 23/47] 10.222.0.25 () {60 vars in 1190 bytes} [Tue Nov 9 20:01:34 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Nov 09 20:01:35.956164 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi [None req-55b363fb-af29-47be-86dc-144f8941304a admin admin] Calling method '>' {{(pid=101137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:01:35.957350 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: INFO nova.api.openstack.requestlog [None req-55b363fb-af29-47be-86dc-144f8941304a admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001598 Nov 09 20:01:35.957735 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: [pid: 101137|app: 0|req: 25/48] 10.222.0.25 () {56 vars in 1074 bytes} [Tue Nov 9 20:01:35 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:01:36.146170 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi [None req-25838a52-b41b-48c5-8df4-b4ac798c92aa admin admin] Calling method '>' {{(pid=101136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:01:36.151221 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: INFO nova.api.openstack.wsgi [None req-25838a52-b41b-48c5-8df4-b4ac798c92aa admin admin] HTTP exception thrown: Flavor 451 could not be found. Nov 09 20:01:36.151820 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi [None req-25838a52-b41b-48c5-8df4-b4ac798c92aa admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=101136) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 09 20:01:36.152632 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: INFO nova.api.openstack.requestlog [None req-25838a52-b41b-48c5-8df4-b4ac798c92aa admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.056768 Nov 09 20:01:36.153129 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: [pid: 101136|app: 0|req: 24/49] 10.222.0.25 () {60 vars in 1193 bytes} [Tue Nov 9 20:01:36 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 09 20:01:36.162732 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi [None req-5b9cde0e-274a-4a54-9c32-3414da158ffe admin admin] Calling method '>' {{(pid=101137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:01:36.176472 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: INFO nova.api.openstack.requestlog [None req-5b9cde0e-274a-4a54-9c32-3414da158ffe admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017229 Nov 09 20:01:36.176993 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: [pid: 101137|app: 0|req: 26/50] 10.222.0.25 () {60 vars in 1210 bytes} [Tue Nov 9 20:01:36 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:01:36.187514 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi [None req-6fd9ab3a-4d05-46cd-a08e-00444e233e95 admin admin] Calling method '>' {{(pid=101136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:01:36.200247 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: INFO nova.api.openstack.requestlog [None req-6fd9ab3a-4d05-46cd-a08e-00444e233e95 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016452 Nov 09 20:01:36.200784 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: [pid: 101136|app: 0|req: 25/51] 10.222.0.25 () {60 vars in 1210 bytes} [Tue Nov 9 20:01:36 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:01:36.210071 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi [None req-ec00624a-24b2-486d-80fe-4267a714953a admin admin] Calling method '>' {{(pid=101137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:01:36.215347 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: INFO nova.api.openstack.wsgi [None req-ec00624a-24b2-486d-80fe-4267a714953a admin admin] HTTP exception thrown: Flavor 451 could not be found. Nov 09 20:01:36.215894 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi [None req-ec00624a-24b2-486d-80fe-4267a714953a admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=101137) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 09 20:01:36.216708 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: INFO nova.api.openstack.requestlog [None req-ec00624a-24b2-486d-80fe-4267a714953a admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.010014 Nov 09 20:01:36.217192 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: [pid: 101137|app: 0|req: 27/52] 10.222.0.25 () {60 vars in 1193 bytes} [Tue Nov 9 20:01:36 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 09 20:01:37.622159 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi [None req-6fd9ab3a-4d05-46cd-a08e-00444e233e95 admin admin] Calling method '>' {{(pid=101136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:01:37.623147 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: INFO nova.api.openstack.requestlog [None req-6fd9ab3a-4d05-46cd-a08e-00444e233e95 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001405 Nov 09 20:01:37.623533 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: [pid: 101136|app: 0|req: 26/53] 10.222.0.25 () {56 vars in 1074 bytes} [Tue Nov 9 20:01:37 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:01:37.823565 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi [None req-537af86b-b21b-427f-9f04-36edaf095089 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:01:37.841801 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: INFO nova.api.openstack.requestlog [None req-537af86b-b21b-427f-9f04-36edaf095089 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.072782 Nov 09 20:01:37.842356 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: [pid: 101137|app: 0|req: 28/54] 10.222.0.25 () {64 vars in 1235 bytes} [Tue Nov 9 20:01:37 2021] POST /compute/v2.1/flavors => generated 404 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 09 20:01:39.299243 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi [None req-6fd9ab3a-4d05-46cd-a08e-00444e233e95 admin admin] Calling method '>' {{(pid=101136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:01:39.300229 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: INFO nova.api.openstack.requestlog [None req-6fd9ab3a-4d05-46cd-a08e-00444e233e95 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001404 Nov 09 20:01:39.300655 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: [pid: 101136|app: 0|req: 27/55] 10.222.0.25 () {56 vars in 1074 bytes} [Tue Nov 9 20:01:39 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:01:39.489842 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi [None req-3535b683-3959-43f4-8ad8-44aa69fcad11 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:01:39.507296 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: INFO nova.api.openstack.requestlog [None req-3535b683-3959-43f4-8ad8-44aa69fcad11 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.068582 Nov 09 20:01:39.507832 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: [pid: 101137|app: 0|req: 29/56] 10.222.0.25 () {64 vars in 1235 bytes} [Tue Nov 9 20:01:39 2021] POST /compute/v2.1/flavors => generated 405 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 20:01:40.922064 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi [None req-6fd9ab3a-4d05-46cd-a08e-00444e233e95 admin admin] Calling method '>' {{(pid=101136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:01:40.923088 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: INFO nova.api.openstack.requestlog [None req-6fd9ab3a-4d05-46cd-a08e-00444e233e95 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001425 Nov 09 20:01:40.923477 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: [pid: 101136|app: 0|req: 28/57] 10.222.0.25 () {56 vars in 1074 bytes} [Tue Nov 9 20:01:40 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:01:41.113802 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi [None req-bca5252a-a7a9-494e-9e70-202981d6e139 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:01:41.131759 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: INFO nova.api.openstack.requestlog [None req-bca5252a-a7a9-494e-9e70-202981d6e139 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.069460 Nov 09 20:01:41.132223 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: [pid: 101137|app: 0|req: 30/58] 10.222.0.25 () {64 vars in 1235 bytes} [Tue Nov 9 20:01:41 2021] POST /compute/v2.1/flavors => generated 407 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 20:01:42.544002 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi [None req-6fd9ab3a-4d05-46cd-a08e-00444e233e95 admin admin] Calling method '>' {{(pid=101136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:01:42.545040 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: INFO nova.api.openstack.requestlog [None req-6fd9ab3a-4d05-46cd-a08e-00444e233e95 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Nov 09 20:01:42.545436 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: [pid: 101136|app: 0|req: 29/59] 10.222.0.25 () {56 vars in 1074 bytes} [Tue Nov 9 20:01:42 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:01:42.738645 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi [None req-96311e71-91df-4ead-88df-b720d33ec9dd admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:01:42.756620 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: INFO nova.api.openstack.requestlog [None req-96311e71-91df-4ead-88df-b720d33ec9dd admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.069515 Nov 09 20:01:42.757152 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: [pid: 101137|app: 0|req: 31/60] 10.222.0.25 () {64 vars in 1235 bytes} [Tue Nov 9 20:01:42 2021] POST /compute/v2.1/flavors => generated 409 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 20:01:44.209253 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi [None req-6fd9ab3a-4d05-46cd-a08e-00444e233e95 admin admin] Calling method '>' {{(pid=101136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:01:44.210372 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: INFO nova.api.openstack.requestlog [None req-6fd9ab3a-4d05-46cd-a08e-00444e233e95 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001534 Nov 09 20:01:44.210762 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: [pid: 101136|app: 0|req: 30/61] 10.222.0.25 () {56 vars in 1074 bytes} [Tue Nov 9 20:01:44 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:01:44.399296 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi [None req-010cdd01-f98d-4fe7-8e37-c9b0a303a5f0 admin admin] Calling method '>' {{(pid=101137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:01:44.418342 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: INFO nova.api.openstack.requestlog [None req-010cdd01-f98d-4fe7-8e37-c9b0a303a5f0 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.070029 Nov 09 20:01:44.418813 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: [pid: 101137|app: 0|req: 32/62] 10.222.0.25 () {60 vars in 1202 bytes} [Tue Nov 9 20:01:44 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:02:30.772114 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi [None req-6fd9ab3a-4d05-46cd-a08e-00444e233e95 admin admin] Calling method '>' {{(pid=101136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:02:30.773162 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: INFO nova.api.openstack.requestlog [None req-6fd9ab3a-4d05-46cd-a08e-00444e233e95 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Nov 09 20:02:30.773558 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: [pid: 101136|app: 0|req: 31/63] 10.222.0.25 () {54 vars in 930 bytes} [Tue Nov 9 20:02:30 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:02:30.832316 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi [None req-4ed9e227-9637-4406-a34f-354d1819f7bf admin admin] Calling method '>' {{(pid=101137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:02:30.851469 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: INFO nova.api.openstack.requestlog [None req-4ed9e227-9637-4406-a34f-354d1819f7bf admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.070025 Nov 09 20:02:30.851997 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: [pid: 101137|app: 0|req: 33/64] 10.222.0.25 () {60 vars in 1291 bytes} [Tue Nov 9 20:02:30 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:02:30.874873 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi [None req-29fbf3c3-2aba-4718-9066-624b8c8b0f90 admin admin] Calling method '>' {{(pid=101136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:02:30.882365 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: INFO nova.api.openstack.requestlog [None req-29fbf3c3-2aba-4718-9066-624b8c8b0f90 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011024 Nov 09 20:02:30.882881 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: [pid: 101136|app: 0|req: 32/65] 10.222.0.25 () {60 vars in 1282 bytes} [Tue Nov 9 20:02:30 2021] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:02:30.894373 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi [None req-9461938c-d929-4db1-be7f-4aa932208558 admin admin] Calling method '>' {{(pid=101137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:02:30.902011 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: INFO nova.api.openstack.requestlog [None req-9461938c-d929-4db1-be7f-4aa932208558 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011121 Nov 09 20:02:30.902520 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: [pid: 101137|app: 0|req: 34/66] 10.222.0.25 () {60 vars in 1285 bytes} [Tue Nov 9 20:02:30 2021] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:02:30.913707 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi [None req-fc8f614d-e334-4570-bcc2-5194978fc505 admin admin] Calling method '>' {{(pid=101136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:02:30.921920 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: INFO nova.api.openstack.requestlog [None req-fc8f614d-e334-4570-bcc2-5194978fc505 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011538 Nov 09 20:02:30.922439 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: [pid: 101136|app: 0|req: 33/67] 10.222.0.25 () {60 vars in 1285 bytes} [Tue Nov 9 20:02:30 2021] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:02:30.934168 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi [None req-33dc1ab8-1198-4989-a3fb-d871f60ba552 admin admin] Calling method '>' {{(pid=101137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:02:30.941737 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: INFO nova.api.openstack.requestlog [None req-33dc1ab8-1198-4989-a3fb-d871f60ba552 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011034 Nov 09 20:02:30.942261 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: [pid: 101137|app: 0|req: 35/68] 10.222.0.25 () {60 vars in 1282 bytes} [Tue Nov 9 20:02:30 2021] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:04:12.290018 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi [None req-b1c211e6-690d-42e8-9ce6-33fa62720d5c tempest-verify_tempest_config-108101444 tempest-verify_tempest_config-108101444-project] Calling method '>' {{(pid=101136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:04:12.292789 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: INFO nova.api.openstack.requestlog [None req-b1c211e6-690d-42e8-9ce6-33fa62720d5c tempest-verify_tempest_config-108101444 tempest-verify_tempest_config-108101444-project] 10.222.0.25 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.107079 Nov 09 20:04:12.293328 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: [pid: 101136|app: 0|req: 34/69] 10.222.0.25 () {58 vars in 1133 bytes} [Tue Nov 9 20:04:12 2021] GET /compute/v2.1/extensions => generated 22700 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 20:05:42.616845 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi [None req-33dc1ab8-1198-4989-a3fb-d871f60ba552 admin admin] Calling method '>' {{(pid=101137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:05:42.617846 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: INFO nova.api.openstack.requestlog [None req-33dc1ab8-1198-4989-a3fb-d871f60ba552 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Nov 09 20:05:42.618731 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: [pid: 101137|app: 0|req: 36/70] 10.222.0.25 () {56 vars in 1074 bytes} [Tue Nov 9 20:05:42 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:05:42.873193 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi [None req-01718911-5e91-4999-a9bd-094cec3fe184 admin admin] Calling method '>' {{(pid=101136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:05:42.874490 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 20:05:42.874490 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: warnings.warn(msg) Nov 09 20:05:42.876006 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG oslo_concurrency.lockutils [None req-01718911-5e91-4999-a9bd-094cec3fe184 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:05:42.876463 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG oslo_concurrency.lockutils [None req-01718911-5e91-4999-a9bd-094cec3fe184 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:05:42.877316 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG oslo_concurrency.lockutils [None req-01718911-5e91-4999-a9bd-094cec3fe184 admin admin] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:05:42.877821 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG oslo_concurrency.lockutils [None req-01718911-5e91-4999-a9bd-094cec3fe184 admin admin] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:05:42.910292 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: INFO nova.api.openstack.requestlog [None req-01718911-5e91-4999-a9bd-094cec3fe184 admin admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.151175 Nov 09 20:05:42.910855 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: [pid: 101136|app: 0|req: 35/71] 10.222.0.25 () {60 vars in 1193 bytes} [Tue Nov 9 20:05:42 2021] GET /compute/v2.1/os-services => generated 791 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 20:05:44.341586 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi [None req-33dc1ab8-1198-4989-a3fb-d871f60ba552 admin admin] Calling method '>' {{(pid=101137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:05:44.342626 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: INFO nova.api.openstack.requestlog [None req-33dc1ab8-1198-4989-a3fb-d871f60ba552 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001417 Nov 09 20:05:44.343013 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: [pid: 101137|app: 0|req: 37/72] 10.222.0.25 () {56 vars in 1074 bytes} [Tue Nov 9 20:05:44 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:05:44.537404 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi [None req-25b9275c-2d43-4577-92dd-1c7215eae849 admin admin] Calling method '>' {{(pid=101136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:05:44.538547 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 20:05:44.538547 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: warnings.warn(msg) Nov 09 20:05:44.540078 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG oslo_concurrency.lockutils [None req-25b9275c-2d43-4577-92dd-1c7215eae849 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:05:44.540551 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG oslo_concurrency.lockutils [None req-25b9275c-2d43-4577-92dd-1c7215eae849 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:05:44.541345 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG oslo_concurrency.lockutils [None req-25b9275c-2d43-4577-92dd-1c7215eae849 admin admin] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:05:44.541763 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG oslo_concurrency.lockutils [None req-25b9275c-2d43-4577-92dd-1c7215eae849 admin admin] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:05:44.560014 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: INFO nova.api.openstack.requestlog [None req-25b9275c-2d43-4577-92dd-1c7215eae849 admin admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.073872 Nov 09 20:05:44.560573 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: [pid: 101136|app: 0|req: 36/73] 10.222.0.25 () {60 vars in 1193 bytes} [Tue Nov 9 20:05:44 2021] GET /compute/v2.1/os-services => generated 791 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 20:05:56.411494 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi [None req-33dc1ab8-1198-4989-a3fb-d871f60ba552 admin admin] Calling method '>' {{(pid=101137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:05:56.412513 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: INFO nova.api.openstack.requestlog [None req-33dc1ab8-1198-4989-a3fb-d871f60ba552 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001405 Nov 09 20:05:56.412911 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: [pid: 101137|app: 0|req: 38/74] 10.222.0.25 () {56 vars in 1074 bytes} [Tue Nov 9 20:05:56 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:05:56.607973 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi [None req-6b4f9a04-144d-4cf3-99b5-da90eda7b19e admin admin] Calling method '>' {{(pid=101136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:05:56.609140 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 20:05:56.609140 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: warnings.warn(msg) Nov 09 20:05:56.610641 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG oslo_concurrency.lockutils [None req-6b4f9a04-144d-4cf3-99b5-da90eda7b19e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:05:56.611075 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG oslo_concurrency.lockutils [None req-6b4f9a04-144d-4cf3-99b5-da90eda7b19e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:05:56.611853 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG oslo_concurrency.lockutils [None req-6b4f9a04-144d-4cf3-99b5-da90eda7b19e admin admin] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:05:56.612271 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG oslo_concurrency.lockutils [None req-6b4f9a04-144d-4cf3-99b5-da90eda7b19e admin admin] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:05:56.636711 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: INFO nova.api.openstack.requestlog [None req-6b4f9a04-144d-4cf3-99b5-da90eda7b19e admin admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.079880 Nov 09 20:05:56.637251 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: [pid: 101136|app: 0|req: 37/75] 10.222.0.25 () {60 vars in 1193 bytes} [Tue Nov 9 20:05:56 2021] GET /compute/v2.1/os-services => generated 1035 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:05:58.069494 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: DEBUG nova.api.openstack.wsgi [None req-33dc1ab8-1198-4989-a3fb-d871f60ba552 admin admin] Calling method '>' {{(pid=101137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:05:58.070512 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: INFO nova.api.openstack.requestlog [None req-33dc1ab8-1198-4989-a3fb-d871f60ba552 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001391 Nov 09 20:05:58.070918 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: [pid: 101137|app: 0|req: 39/76] 10.222.0.25 () {56 vars in 1074 bytes} [Tue Nov 9 20:05:58 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:05:58.262149 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG nova.api.openstack.wsgi [None req-2888dae5-8ad8-46b6-9f6d-9b82eb1cf81b admin admin] Calling method '>' {{(pid=101136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:05:58.263300 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 20:05:58.263300 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: warnings.warn(msg) Nov 09 20:05:58.264853 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG oslo_concurrency.lockutils [None req-2888dae5-8ad8-46b6-9f6d-9b82eb1cf81b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:05:58.265286 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG oslo_concurrency.lockutils [None req-2888dae5-8ad8-46b6-9f6d-9b82eb1cf81b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:05:58.266064 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG oslo_concurrency.lockutils [None req-2888dae5-8ad8-46b6-9f6d-9b82eb1cf81b admin admin] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:05:58.266504 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: DEBUG oslo_concurrency.lockutils [None req-2888dae5-8ad8-46b6-9f6d-9b82eb1cf81b admin admin] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:05:58.288327 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: INFO nova.api.openstack.requestlog [None req-2888dae5-8ad8-46b6-9f6d-9b82eb1cf81b admin admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.077533 Nov 09 20:05:58.288910 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: [pid: 101136|app: 0|req: 38/77] 10.222.0.25 () {60 vars in 1193 bytes} [Tue Nov 9 20:05:58 2021] GET /compute/v2.1/os-services => generated 1035 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:06:53.963878 dv-cinder-801354-4-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Nov 09 20:06:53.964480 dv-cinder-801354-4-iscsi devstack@n-api.service[101135]: Tue Nov 9 20:06:53 2021 - graceful shutdown triggered... Nov 09 20:06:53.965062 dv-cinder-801354-4-iscsi devstack@n-api.service[101136]: Gracefully killing worker 1 (pid: 101136)... Nov 09 20:06:53.965444 dv-cinder-801354-4-iscsi devstack@n-api.service[101137]: Gracefully killing worker 2 (pid: 101137)... Nov 09 20:06:54.966147 dv-cinder-801354-4-iscsi devstack@n-api.service[101135]: worker 1 buried after 1 seconds Nov 09 20:06:54.966727 dv-cinder-801354-4-iscsi devstack@n-api.service[101135]: worker 2 buried after 1 seconds Nov 09 20:06:54.966727 dv-cinder-801354-4-iscsi devstack@n-api.service[101135]: goodbye to uWSGI. Nov 09 20:06:54.967759 dv-cinder-801354-4-iscsi systemd[1]: devstack@n-api.service: Succeeded. Nov 09 20:06:54.968311 dv-cinder-801354-4-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Nov 09 20:06:54.971160 dv-cinder-801354-4-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Nov 09 20:06:54.982312 dv-cinder-801354-4-iscsi devstack@n-api.service[116085]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Nov 09 20:06:54.984952 dv-cinder-801354-4-iscsi devstack@n-api.service[116085]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Nov 9 20:06:54 2021] *** Nov 09 20:06:54.985117 dv-cinder-801354-4-iscsi devstack@n-api.service[116085]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Nov 09 20:06:54.985255 dv-cinder-801354-4-iscsi devstack@n-api.service[116085]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Nov 09 20:06:54.985393 dv-cinder-801354-4-iscsi devstack@n-api.service[116085]: nodename: dv-cinder-801354-4-iscsi Nov 09 20:06:54.985393 dv-cinder-801354-4-iscsi devstack@n-api.service[116085]: machine: x86_64 Nov 09 20:06:54.985393 dv-cinder-801354-4-iscsi devstack@n-api.service[116085]: clock source: unix Nov 09 20:06:54.985393 dv-cinder-801354-4-iscsi devstack@n-api.service[116085]: pcre jit disabled Nov 09 20:06:54.985393 dv-cinder-801354-4-iscsi devstack@n-api.service[116085]: detected number of CPU cores: 4 Nov 09 20:06:54.985393 dv-cinder-801354-4-iscsi devstack@n-api.service[116085]: current working directory: / Nov 09 20:06:54.985393 dv-cinder-801354-4-iscsi devstack@n-api.service[116085]: detected binary path: /usr/bin/uwsgi-core Nov 09 20:06:54.985393 dv-cinder-801354-4-iscsi devstack@n-api.service[116085]: your processes number limit is 47680 Nov 09 20:06:54.985393 dv-cinder-801354-4-iscsi devstack@n-api.service[116085]: your memory page size is 4096 bytes Nov 09 20:06:54.986058 dv-cinder-801354-4-iscsi devstack@n-api.service[116085]: detected max file descriptor number: 2048 Nov 09 20:06:54.986058 dv-cinder-801354-4-iscsi devstack@n-api.service[116085]: lock engine: pthread robust mutexes Nov 09 20:06:54.986058 dv-cinder-801354-4-iscsi devstack@n-api.service[116085]: thunder lock: enabled Nov 09 20:06:54.986058 dv-cinder-801354-4-iscsi devstack@n-api.service[116085]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Nov 09 20:06:54.986058 dv-cinder-801354-4-iscsi devstack@n-api.service[116085]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Nov 09 20:06:55.034345 dv-cinder-801354-4-iscsi devstack@n-api.service[116085]: Python main interpreter initialized at 0x55afdab519c0 Nov 09 20:06:55.034345 dv-cinder-801354-4-iscsi devstack@n-api.service[116085]: python threads support enabled Nov 09 20:06:55.034345 dv-cinder-801354-4-iscsi devstack@n-api.service[116085]: your server socket listen backlog is limited to 100 connections Nov 09 20:06:55.034345 dv-cinder-801354-4-iscsi devstack@n-api.service[116085]: your mercy for graceful operations on workers is 90 seconds Nov 09 20:06:55.034804 dv-cinder-801354-4-iscsi devstack@n-api.service[116085]: mapped 403077 bytes (393 KB) for 2 cores Nov 09 20:06:55.034804 dv-cinder-801354-4-iscsi devstack@n-api.service[116085]: *** Operational MODE: preforking *** Nov 09 20:06:55.035050 dv-cinder-801354-4-iscsi devstack@n-api.service[116085]: *** uWSGI is running in multiple interpreter mode *** Nov 09 20:06:55.035050 dv-cinder-801354-4-iscsi devstack@n-api.service[116085]: spawned uWSGI master process (pid: 116085) Nov 09 20:06:55.035255 dv-cinder-801354-4-iscsi systemd[1]: Started Devstack devstack@n-api.service. Nov 09 20:06:55.035847 dv-cinder-801354-4-iscsi devstack@n-api.service[116085]: spawned uWSGI worker 1 (pid: 116102, cores: 1) Nov 09 20:06:55.036373 dv-cinder-801354-4-iscsi devstack@n-api.service[116085]: spawned uWSGI worker 2 (pid: 116103, cores: 1) Nov 09 20:06:55.036681 dv-cinder-801354-4-iscsi devstack@n-api.service[116085]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Nov 09 20:06:56.867243 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 09 20:06:56.867243 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: from cryptography.utils import int_from_bytes Nov 09 20:06:56.868947 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 09 20:06:56.868947 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: from cryptography.utils import int_from_bytes Nov 09 20:06:56.884107 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 09 20:06:56.884107 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: from cryptography.utils import int_from_bytes Nov 09 20:06:56.884803 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 09 20:06:56.884803 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: from cryptography.utils import int_from_bytes Nov 09 20:06:59.437253 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 09 20:06:59.437819 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 09 20:06:59.437917 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 09 20:06:59.438292 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 09 20:06:59.438548 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 09 20:06:59.438944 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.439275 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.439602 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.439927 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.440266 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.440614 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.440943 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.441267 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.441601 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.441866 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.442190 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.442523 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-801354-4-iscsi {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.442856 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.443168 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.443485 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.443808 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.444119 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.444543 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.444907 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.445474 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.447029 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.447029 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.447029 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.447326 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.447517 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.451056 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.451056 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.451056 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.451056 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.451056 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.451056 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-801354-4-iscsi {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.451056 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.451056 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.451667 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.451667 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.451667 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.451667 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.451667 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.452094 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.452468 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.452654 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.453077 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.453287 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.453614 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.453918 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.454228 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.454539 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.454862 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.455169 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.455475 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.455723 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.456031 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.456355 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.456706 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.457032 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.457283 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.457531 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.457852 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.458174 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.458484 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.458806 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.459115 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.459437 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.459658 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 09 20:06:59.460150 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.460296 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 09 20:06:59.460569 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.460569 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.460887 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.461037 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 09 20:06:59.461186 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.461513 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 09 20:06:59.461513 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 09 20:06:59.461834 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.461834 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.462122 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.462279 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.462422 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.462574 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.462719 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.462719 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.463005 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.25 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.463005 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.25 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.463290 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.463456 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.463620 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.463774 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.463918 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.464059 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.464209 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.464360 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.464596 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.464596 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.465323 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.465690 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.465972 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.466336 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-801354-4-iscsi {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.466698 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.467108 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.467373 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.467643 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.468076 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.468344 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.468635 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.468979 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.469324 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.470584 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.471378 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.471378 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.471745 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.471895 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.472041 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.472198 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.472366 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.473091 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.473261 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.473408 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.473575 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.473864 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.477345 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.477930 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.478128 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.478294 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.478455 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.478608 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.478895 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.479049 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.479296 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.479536 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.479793 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.479957 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.480101 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.480253 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.480487 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.480640 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.480640 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.480940 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-801354-4-iscsi {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.481221 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.481379 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.481528 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.481682 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.481833 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.481983 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.482137 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.482289 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.482447 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.482602 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.482758 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.482922 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.483563 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.483721 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.483895 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.484126 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.484292 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.484471 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.484621 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.484777 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.484920 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.485071 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.485235 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.485388 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.485541 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.485690 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.485842 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.485991 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.486141 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.486141 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.486426 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.486567 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.486567 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.486844 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.487006 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.487156 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.487310 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.487453 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.487619 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.488083 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.488244 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.488425 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.488579 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.488737 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.488906 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.489164 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.489402 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.489652 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.489827 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.490038 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.490199 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.490353 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.490497 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.490639 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.490784 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.490934 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.491093 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.491261 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.491487 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.491654 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.492484 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.492733 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.492967 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.493120 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.493264 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.493416 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.493565 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.493718 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.493874 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.494024 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.494284 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.494453 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.494597 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.494756 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.494906 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.495054 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.495195 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.495337 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.495486 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.495718 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.495718 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.496000 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.496143 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.496285 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.496285 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.496628 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.25 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.496628 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.25 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.496907 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.497065 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.497215 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.497366 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.497525 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.497525 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.497796 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.497796 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.498434 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.498586 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.498748 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.498899 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.499041 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.499306 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.499554 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.499810 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.499969 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.500121 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.500278 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.500453 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.500614 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.500772 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.500927 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.501078 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.501227 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.501370 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.501602 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.501762 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.501905 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.502057 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.502200 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.502349 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.502501 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.502645 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.503126 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.503303 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.503456 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.503609 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.503761 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.503912 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.504055 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.504197 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.504463 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.504615 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.504768 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.504911 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.505052 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.505194 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.505355 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.505505 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.505663 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.505817 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.505960 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.506101 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.506243 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.506394 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.506546 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.506697 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.506849 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.506998 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.507153 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.507346 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.507491 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.507634 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.507775 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.507918 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.508387 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.508620 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.508766 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.508919 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.509075 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.509231 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.509477 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.509723 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.509965 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.510126 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.510272 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.510414 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.510556 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.510706 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.510849 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.511001 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.511155 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.511306 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.511450 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.511690 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.511862 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.512017 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.512170 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.512320 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.512563 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.512720 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.512720 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.513002 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.513155 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.513306 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.513460 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.513609 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.513759 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.513912 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.514074 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.514219 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.514374 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.514611 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.514769 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.514926 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.515070 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.515226 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.515368 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.515517 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.515667 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.515819 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.515983 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.516134 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.516333 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.516531 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.516677 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.516834 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.516993 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.517145 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.517288 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.517430 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.518185 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.518655 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.519026 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 20:06:59.519204 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.519344 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.519490 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.519744 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.520171 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.520331 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.520501 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.520643 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.520789 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.521000 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.521142 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.521142 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.521395 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.521527 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.521655 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.521917 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.522061 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.522199 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.522330 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.522458 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.522602 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.522734 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.522886 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.523019 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.523148 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.523288 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.523458 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.523690 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.523830 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.523960 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.524090 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.524219 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.524365 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.524515 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.524742 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.524876 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.525013 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.525143 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.525288 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.525425 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.525563 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.525707 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.525837 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.525974 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.526104 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.526241 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.526371 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.526507 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.526636 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.526779 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.526909 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.527038 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.527166 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.527295 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.527438 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.527577 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.527816 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.527970 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.528101 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.528238 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.528695 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.528850 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.528981 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.529120 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.529250 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.529387 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.529526 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.529657 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.529883 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.530753 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.530894 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.531024 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.531163 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.531295 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.531439 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.531620 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.531763 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.531906 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.532111 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.532251 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.532381 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.532551 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.532551 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.532551 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.532926 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.533067 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.533658 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.533796 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.533796 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.534043 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.534187 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.534334 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.534472 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.534472 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.534741 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.534948 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.534948 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.535216 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.535463 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.535610 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.535749 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.535749 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.536005 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.536144 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.536280 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.536441 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.536441 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.536716 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.536846 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.536846 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.537097 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.537227 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.537362 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.537500 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.537500 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.537752 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.537889 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.538019 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.538160 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.538160 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.539511 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.539709 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.539709 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.540109 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.540326 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.540493 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.540627 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.540627 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.540962 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.541104 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.541244 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.541386 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.541524 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.541654 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.541654 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.541897 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.542040 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.542040 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.542376 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.542506 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.542668 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.542816 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.542948 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.543083 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.543220 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.543357 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.543357 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.543625 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.543757 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.543894 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.544024 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.544024 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.544284 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.544484 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.544484 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.544753 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.544916 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.545114 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.545246 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.545389 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.545527 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.545527 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.545772 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.545908 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.545908 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.546200 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.546340 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.546470 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.546600 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.546600 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.546865 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.547003 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.547131 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.547260 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.547260 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.547511 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.547671 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.549091 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.549475 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.549475 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.549834 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.549967 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.549967 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.550351 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.550563 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.550705 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.550845 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.551004 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.551204 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.551337 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.551467 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.551467 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.551719 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.551936 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.552076 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.552207 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.552207 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.552576 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.552716 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.552716 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.552979 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.552979 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.553231 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.553231 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.553474 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.553612 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.553742 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.554222 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.554222 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.554541 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.554713 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.554850 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.554975 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.554975 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.555307 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.555439 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.555439 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.555705 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.555842 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.555842 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.556095 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.556226 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.556364 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.556563 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.556563 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.556820 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.556957 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.556957 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.557213 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.557344 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.557344 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.557594 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.557732 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.557870 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.558000 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.558137 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.558274 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.558403 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.558541 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.558671 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.558801 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.558936 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.559066 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.559066 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.559335 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.559679 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.559914 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.560058 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.560058 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.560336 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.560577 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.560790 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.560926 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.560926 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.561196 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.561402 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.561536 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.561666 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.561666 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.561917 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.562058 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.562196 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.562328 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.562328 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.562659 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.562791 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.562933 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.563063 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.563063 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.563315 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.563446 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.563446 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.563706 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.563836 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.563836 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.564088 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.564217 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.564358 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.564529 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.564529 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.564788 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.564919 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.564919 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.565170 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.565324 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.565519 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.565652 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.565652 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.565913 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.566056 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.566056 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.566301 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.566437 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.566568 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.566697 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.566697 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.566951 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.567081 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.567218 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.567348 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.567348 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.567611 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.567740 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.567868 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.568003 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.568003 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.568264 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.568394 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.568394 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.568755 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.568889 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.569031 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.569170 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.569170 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.569424 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.570281 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.570281 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.570618 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.570928 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.571075 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.571214 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.571214 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.571554 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.571703 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.571703 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.571951 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.572088 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.572941 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.573081 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.573081 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.573342 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.573478 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.573478 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.573742 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.573872 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.574000 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.574147 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.574147 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.574399 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.574527 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.574527 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.574776 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.574905 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.575047 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.575189 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.575189 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.575448 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.575666 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.575798 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.575947 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.575947 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.576209 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.576339 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.576339 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.576612 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.576758 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.576889 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.577027 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.577027 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.577282 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.577421 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.577559 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.577696 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.577833 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.577970 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.577970 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.578301 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.578440 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.578577 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.578707 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.578842 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.578972 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.578972 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.579229 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.579359 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.579359 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.579625 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.579972 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.580127 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.580260 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.580260 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.580743 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.580894 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.580894 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.581346 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.581478 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.581735 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.581885 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.581885 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.582145 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.582278 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.582407 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.582545 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.582545 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.582790 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.583023 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.583023 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.583321 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.583463 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.583601 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.583730 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.583730 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.583991 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.584121 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.584259 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.584410 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.584556 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.584688 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.584688 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.584939 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.585079 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.585490 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.585656 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.585656 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.586012 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.587000 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.587000 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.587329 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.587470 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.587606 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.587735 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.587735 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.587983 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.588112 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.588257 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.588388 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.588388 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.588666 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.588796 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.588944 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.589083 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.589083 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.589339 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.589469 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.589600 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.589743 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.590134 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.590277 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.590408 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.590538 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.590538 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.590907 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.591049 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.591370 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.591506 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.591636 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.591850 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.591850 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.592116 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.592254 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.592392 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.592540 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.592684 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.592832 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.592986 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.593183 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.593316 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.593446 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.593585 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.593717 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.593848 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.593978 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.594115 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.594245 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.594384 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.594524 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.594662 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.594793 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.594923 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.594923 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.595198 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.595330 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.595459 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.595589 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.595719 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.595872 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.596070 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.596205 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.596336 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.596494 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.596624 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.596767 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.596906 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.597045 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.597183 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.597324 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.597534 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.597677 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.597816 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.597947 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.598086 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.598226 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.598357 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.598487 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.598617 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.598753 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.598894 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.599027 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.599164 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.599295 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.599424 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.599812 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.599974 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.600303 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.600456 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.600604 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.600604 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.600853 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.600853 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.602188 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.602188 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.602453 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.602585 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.602732 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.602872 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.603004 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.603142 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.603364 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.603513 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.603729 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.603863 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.603994 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.604123 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.604253 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.604382 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.604584 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.604717 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.604847 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.604976 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.605113 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.605244 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.605385 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.605527 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.605527 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.605772 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.605901 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.606054 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.606250 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.606384 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.606505 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.606615 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.606724 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.606922 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.607038 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.607149 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.607269 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.607380 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.607491 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.607620 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.607741 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.607852 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.607975 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.608164 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.608279 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.608417 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.608549 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.608662 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.608779 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.608891 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.609010 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.609129 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.609240 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.609359 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.609480 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.609592 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.609711 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.609836 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.609956 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.610075 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.610416 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.610549 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.610682 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.610802 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.610915 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.611024 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.611133 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.611242 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.611364 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.611476 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.611586 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.611813 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.612127 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.612354 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.612515 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.612515 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.612852 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.612987 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.613117 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.613257 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.613473 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.613605 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.613735 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.613863 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.614000 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.614141 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.614270 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.614398 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.614527 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.614655 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.614793 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.614937 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.615074 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.615204 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.615335 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.615464 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.615608 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.615748 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.615887 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.616017 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.616146 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.616294 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.616698 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.616829 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.616951 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.617071 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.617183 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.617294 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.617419 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.617533 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.617659 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.617770 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.617880 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.617998 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.617998 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.618257 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.618387 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.618517 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.618646 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.618646 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.618908 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.619048 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.619187 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.619325 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.619462 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.619462 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.619719 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.619856 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.620003 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.620266 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.620598 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.620598 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.621068 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.621205 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.621343 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.621482 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.621621 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.621783 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.622001 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.622301 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.622514 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.622656 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.622802 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.622933 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.623063 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.623194 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.623324 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.623476 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.623684 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.623818 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.623949 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.624086 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.624217 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.624355 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.624533 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.624675 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.624805 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.624935 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.625078 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.625210 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.625210 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.625460 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.625597 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.625736 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.625876 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.626008 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.626138 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.626268 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.626399 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.626529 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.626749 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.626947 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.627082 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.627212 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.627343 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.627481 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.627622 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.627762 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.628002 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.628155 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.628295 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.628462 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.628604 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.628736 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.628866 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.628996 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.629125 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.629125 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.629387 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.629519 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.629654 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.629792 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.629923 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.630068 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.630208 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.630346 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.630637 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.630785 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.630931 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.631071 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.631216 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.631351 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.631489 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.631669 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.631819 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.631974 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.632199 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.633093 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.633307 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.633455 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.633608 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.633830 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.633971 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.634103 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.634240 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.634385 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.634517 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.634648 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.634779 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.634908 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.635046 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.635192 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.635324 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.635475 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.635693 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.635849 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.635989 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.636131 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.636263 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.636393 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.636540 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.636680 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.636826 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.636980 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.637177 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.637319 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.637451 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.637589 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.637730 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.637863 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.637863 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.638117 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.638255 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.638386 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.638530 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.638652 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.638791 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.638923 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.639052 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.639181 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.639321 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.639453 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.639582 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.639718 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.639855 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.639997 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.640129 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.640268 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.640456 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.640588 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.640878 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.641024 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.641157 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.641287 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.641417 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.641554 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.641824 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.641967 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.642099 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.642315 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.642450 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.642580 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.642709 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.642854 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.643000 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.643199 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.643334 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.643466 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.643606 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.643606 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.643942 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.644076 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.644207 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.644344 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.644530 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.644671 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.644803 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.644933 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.645069 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.645201 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.645340 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.645478 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.645609 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.645609 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.645904 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.646042 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.646182 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.646182 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.646430 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.646430 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.646673 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.646816 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.646947 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.646947 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.647205 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.647428 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.647562 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.647702 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.647841 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.648563 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.648724 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.648855 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.648985 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.648985 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.649244 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.649244 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.649488 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.649623 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.649761 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.649899 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.650068 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.650201 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.650339 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.650471 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.650610 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.650750 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.651001 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.651135 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.651273 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.651403 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.651544 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.651682 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.651835 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.652029 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.652179 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.652179 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.652563 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.652563 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.652832 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.652963 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.653093 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.653234 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.653434 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.653569 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.653707 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.653838 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.654048 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.654196 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.654328 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.654466 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.654612 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.654745 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.655153 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.655369 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.655503 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.655638 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.655791 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.655937 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.656069 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.656213 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.656353 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.656495 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.656627 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.656758 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.656902 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.657035 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.657165 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.657295 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.657447 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.657653 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.657653 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.657924 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.658056 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.658056 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.658309 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.658440 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.658580 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.658719 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.658858 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.658997 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.659135 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.659266 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.659445 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.659581 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.659763 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.659909 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.660079 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.660223 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.660450 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.660589 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.660801 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.660942 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.661164 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.661312 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.661454 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.661591 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.661722 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.661852 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.661983 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.662204 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.662340 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.662478 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.662689 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.662831 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.662978 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.663118 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.663250 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.663379 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.663626 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.663801 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.663949 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.664159 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.664307 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.664563 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.664712 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.664845 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.664989 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.665131 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.665271 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.665409 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.665548 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.665684 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.665829 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.666045 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.666188 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.666327 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.666467 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.666598 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.666738 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.666870 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.667002 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.667141 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.667273 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.667417 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.667556 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.667765 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.667900 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.668030 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.668160 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.668301 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.668603 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.668741 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.668919 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.669054 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.669230 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.669378 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.669541 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.669684 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.669852 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.669995 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.670165 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.670308 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.670476 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.670618 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.670792 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.670934 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.671150 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.671352 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.671488 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.671619 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.671757 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.671889 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.672034 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.672189 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.672392 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.672569 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.672722 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.672932 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.673068 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.673207 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.673339 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.673479 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.673633 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.673845 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.673980 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.674111 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.674327 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.674461 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.674600 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.674747 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.674879 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.675017 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.675149 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.675286 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.675426 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.675559 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.675696 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.675827 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.675961 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.676106 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.676273 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.676455 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.676619 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.676768 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.676934 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.677078 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.677247 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.677390 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.677559 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.677703 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.677913 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.678061 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.678202 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.678334 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.678472 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.678605 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.678778 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.679042 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.679732 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.679962 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.680172 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.680319 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.680486 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.680644 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.680779 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.680912 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.681042 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.681171 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.681331 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.681543 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.681679 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.681825 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.681969 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.682101 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.682243 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.682398 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.682605 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.682740 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.682879 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.683103 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.683249 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.683382 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.683512 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.683642 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.683768 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.683988 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.684134 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.684266 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.684491 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.684628 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.684772 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.684914 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.685047 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.685176 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.685313 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.685452 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.685624 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.685776 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.685931 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.686069 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.686251 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.686387 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.686561 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.686789 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.686925 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.687091 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.687229 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 09 20:06:59.687480 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.687751 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.688078 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.688439 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.688739 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.689045 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.689366 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.689672 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.689976 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.690292 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.690601 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.690903 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.691214 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.691528 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.691838 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.692142 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.692478 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.692785 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.693111 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.693418 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.693721 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.694026 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.694335 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.694638 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.695533 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.695913 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.696224 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.696568 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.696878 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.697189 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.697495 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.697807 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.698112 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.698422 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.698727 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.699053 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.699357 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.699663 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.699978 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.700290 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.700636 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.700950 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.701268 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.701616 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.701932 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.702715 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.703102 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.703429 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.703770 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.704110 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.704436 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.704750 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.705056 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.705380 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.705689 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.706003 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.706313 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.706623 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.706943 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.707239 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.707551 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.707859 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.708172 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.708541 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.708876 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.709181 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.711171 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.711171 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.711171 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.711171 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.711532 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_db.sqlalchemy.engines [None req-35b3fd3a-b7a6-4fc5-87ca-396688eaf230 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116103) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 09 20:06:59.711631 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.711792 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.712117 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.712476 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.712802 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.713115 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.713543 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.713860 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.714175 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.714503 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.714815 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.715142 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.715464 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.715776 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.716098 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.716424 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.716763 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.717105 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.717439 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.717768 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.718077 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.718388 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.718692 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.719004 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.719339 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.719657 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.719987 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.720298 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.720659 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.720977 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.721299 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.721629 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.721947 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.722259 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.722591 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.722904 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.723216 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.723528 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.723841 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.724153 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.724488 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.725070 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.725396 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.725703 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.726092 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.726643 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.726902 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.727227 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.727542 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.727877 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.728188 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.728525 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.728841 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.729154 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.729471 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.729787 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.730115 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.730443 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.730770 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.731099 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.731443 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.731764 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.732107 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.732452 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.732769 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.733080 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.733385 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 20:06:59.733626 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 09 20:06:59.756331 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_db.sqlalchemy.engines [None req-908c910f-75a5-4aaa-abca-3dbbf2ef86e5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116102) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 09 20:06:59.780413 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.context [None req-35b3fd3a-b7a6-4fc5-87ca-396688eaf230 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3fe77ec2-f067-4504-9205-b014cb4accd4(cell1) {{(pid=116103) load_cells /opt/stack/nova/nova/context.py:464}} Nov 09 20:06:59.784665 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-35b3fd3a-b7a6-4fc5-87ca-396688eaf230 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:06:59.786269 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-35b3fd3a-b7a6-4fc5-87ca-396688eaf230 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:06:59.787094 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-35b3fd3a-b7a6-4fc5-87ca-396688eaf230 None None] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:06:59.789478 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-35b3fd3a-b7a6-4fc5-87ca-396688eaf230 None None] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:06:59.800159 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_db.sqlalchemy.engines [None req-35b3fd3a-b7a6-4fc5-87ca-396688eaf230 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116103) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 09 20:06:59.801913 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_db.sqlalchemy.engines [None req-35b3fd3a-b7a6-4fc5-87ca-396688eaf230 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116103) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 09 20:06:59.824328 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.context [None req-908c910f-75a5-4aaa-abca-3dbbf2ef86e5 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3fe77ec2-f067-4504-9205-b014cb4accd4(cell1) {{(pid=116102) load_cells /opt/stack/nova/nova/context.py:464}} Nov 09 20:06:59.828590 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-908c910f-75a5-4aaa-abca-3dbbf2ef86e5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:06:59.830170 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-908c910f-75a5-4aaa-abca-3dbbf2ef86e5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:06:59.830976 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-908c910f-75a5-4aaa-abca-3dbbf2ef86e5 None None] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:06:59.833114 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-908c910f-75a5-4aaa-abca-3dbbf2ef86e5 None None] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:06:59.843633 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_db.sqlalchemy.engines [None req-908c910f-75a5-4aaa-abca-3dbbf2ef86e5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116102) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 09 20:06:59.844671 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_db.sqlalchemy.engines [None req-908c910f-75a5-4aaa-abca-3dbbf2ef86e5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116102) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 09 20:07:00.072150 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_db.sqlalchemy.engines [None req-35b3fd3a-b7a6-4fc5-87ca-396688eaf230 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116103) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 09 20:07:00.105025 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_db.sqlalchemy.engines [None req-908c910f-75a5-4aaa-abca-3dbbf2ef86e5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116102) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 09 20:07:00.399984 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: WARNING keystonemiddleware.auth_token [None req-35b3fd3a-b7a6-4fc5-87ca-396688eaf230 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 09 20:07:00.408891 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: WARNING keystonemiddleware.auth_token [None req-35b3fd3a-b7a6-4fc5-87ca-396688eaf230 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 09 20:07:00.436122 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: WARNING keystonemiddleware.auth_token [None req-908c910f-75a5-4aaa-abca-3dbbf2ef86e5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 09 20:07:00.445867 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: WARNING keystonemiddleware.auth_token [None req-908c910f-75a5-4aaa-abca-3dbbf2ef86e5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 09 20:07:00.786300 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: WARNING keystonemiddleware.auth_token [None req-35b3fd3a-b7a6-4fc5-87ca-396688eaf230 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 09 20:07:00.794608 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: WARNING keystonemiddleware.auth_token [None req-35b3fd3a-b7a6-4fc5-87ca-396688eaf230 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 09 20:07:00.800131 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55afdab519c0 pid: 116103 (default app) Nov 09 20:07:00.837875 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: WARNING keystonemiddleware.auth_token [None req-908c910f-75a5-4aaa-abca-3dbbf2ef86e5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 09 20:07:00.844202 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: WARNING keystonemiddleware.auth_token [None req-908c910f-75a5-4aaa-abca-3dbbf2ef86e5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 09 20:07:00.849414 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55afdab519c0 pid: 116102 (default app) Nov 09 20:07:34.492598 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-eaa8a889-e00d-4fb4-8482-bf7c2941f6a5 tempest-VolumesSnapshotsTestJSON-866801274 tempest-VolumesSnapshotsTestJSON-866801274-project] Action: 'create', calling method: .version_select at 0x7fab3cbac1f0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1437096074"}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:07:36.317876 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-eaa8a889-e00d-4fb4-8482-bf7c2941f6a5 tempest-VolumesSnapshotsTestJSON-866801274 tempest-VolumesSnapshotsTestJSON-866801274-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 3.353864 Nov 09 20:07:36.319800 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1/1] 10.222.0.25 () {60 vars in 1154 bytes} [Tue Nov 9 20:07:32 2021] POST /compute/v2.1/os-volumes => generated 345 bytes in 3358 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Nov 09 20:07:36.327711 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-f70f6649-ed2f-4396-8524-7801434dc973 tempest-VolumesTestJSON-1715234088 tempest-VolumesTestJSON-1715234088-project] Calling method '.version_select at 0x7fab3ca78dc0>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:07:36.380290 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-f3603a94-b2db-4547-8366-2911b76d8499 tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1334090389", "imageRef": "109ded43-8c19-4f17-afac-7625dcfef942", "flavorRef": "452", "networks": [{"uuid": "ea1e7709-708c-4559-9e7d-5f23a918b0ae"}]}} {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:07:36.463171 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-f70f6649-ed2f-4396-8524-7801434dc973 tempest-VolumesTestJSON-1715234088 tempest-VolumesTestJSON-1715234088-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/ee24bed7-4569-4246-a39d-b2649496c731" status: 200 len: 351 microversion: 2.1 time: 0.141252 Nov 09 20:07:36.464220 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 2/2] 10.222.0.25 () {58 vars in 1244 bytes} [Tue Nov 9 20:07:36 2021] GET /compute/v2.1/os-volumes/ee24bed7-4569-4246-a39d-b2649496c731 => generated 351 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:07:36.468771 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-3f035118-de35-473a-8731-e886aa662a5c tempest-VolumesSnapshotsTestJSON-866801274 tempest-VolumesSnapshotsTestJSON-866801274-project] Calling method '.version_select at 0x7fab3cbacaf0>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:07:36.988983 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-3f035118-de35-473a-8731-e886aa662a5c tempest-VolumesSnapshotsTestJSON-866801274 tempest-VolumesSnapshotsTestJSON-866801274-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/a912e679-60fb-4b9c-bf0d-b4bf5a7e49d0" status: 200 len: 346 microversion: 2.1 time: 0.523309 Nov 09 20:07:36.989885 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 3/3] 10.222.0.25 () {58 vars in 1244 bytes} [Tue Nov 9 20:07:36 2021] GET /compute/v2.1/os-volumes/a912e679-60fb-4b9c-bf0d-b4bf5a7e49d0 => generated 346 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:07:37.002891 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-8dcfbb75-65ef-49ab-8333-b9ec0a91be31 tempest-VolumesSnapshotsTestJSON-866801274 tempest-VolumesSnapshotsTestJSON-866801274-project] Action: 'create', calling method: .version_select at 0x7fab3ca0a820>, body: {"snapshot": {"volume_id": "a912e679-60fb-4b9c-bf0d-b4bf5a7e49d0", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-58037273"}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:07:37.300084 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.network.neutron [None req-f3603a94-b2db-4547-8366-2911b76d8499 tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] validate_networks() for [('ea1e7709-708c-4559-9e7d-5f23a918b0ae', None, None, None, None, None)] {{(pid=116102) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 09 20:07:37.321253 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-8dcfbb75-65ef-49ab-8333-b9ec0a91be31 tempest-VolumesSnapshotsTestJSON-866801274 tempest-VolumesSnapshotsTestJSON-866801274-project] 10.222.0.25 "POST /compute/v2.1/os-snapshots" status: 200 len: 285 microversion: 2.1 time: 0.322901 Nov 09 20:07:37.322244 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 4/4] 10.222.0.25 () {60 vars in 1161 bytes} [Tue Nov 9 20:07:36 2021] POST /compute/v2.1/os-snapshots => generated 285 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:07:37.333896 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-0b173029-f982-436d-8a82-524aaa6a2ae4 tempest-VolumesSnapshotsTestJSON-866801274 tempest-VolumesSnapshotsTestJSON-866801274-project] Calling method '.version_select at 0x7fab3ca10430>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:07:37.527656 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-0b173029-f982-436d-8a82-524aaa6a2ae4 tempest-VolumesSnapshotsTestJSON-866801274 tempest-VolumesSnapshotsTestJSON-866801274-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/de7a62b1-8557-4e8a-805f-877952319efc" status: 200 len: 285 microversion: 2.1 time: 0.197541 Nov 09 20:07:37.532988 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 5/5] 10.222.0.25 () {58 vars in 1250 bytes} [Tue Nov 9 20:07:37 2021] GET /compute/v2.1/os-snapshots/de7a62b1-8557-4e8a-805f-877952319efc => generated 285 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:07:37.539252 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-a2339d08-c27a-4ddd-a482-48468bdebc94 tempest-VolumesSnapshotsTestJSON-866801274 tempest-VolumesSnapshotsTestJSON-866801274-project] Calling method '.version_select at 0x7fab3ca78e50>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:07:37.592474 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-a2339d08-c27a-4ddd-a482-48468bdebc94 tempest-VolumesSnapshotsTestJSON-866801274 tempest-VolumesSnapshotsTestJSON-866801274-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots" status: 200 len: 288 microversion: 2.1 time: 0.058073 Nov 09 20:07:37.593548 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 6/6] 10.222.0.25 () {58 vars in 1139 bytes} [Tue Nov 9 20:07:37 2021] GET /compute/v2.1/os-snapshots => generated 288 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:07:37.603596 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-923d6c49-6e29-4553-a9d4-bbe4a2872118 tempest-VolumesSnapshotsTestJSON-866801274 tempest-VolumesSnapshotsTestJSON-866801274-project] Calling method '.version_select at 0x7fab3ca10ee0>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:07:37.639055 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-923d6c49-6e29-4553-a9d4-bbe4a2872118 tempest-VolumesSnapshotsTestJSON-866801274 tempest-VolumesSnapshotsTestJSON-866801274-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/de7a62b1-8557-4e8a-805f-877952319efc" status: 200 len: 285 microversion: 2.1 time: 0.039277 Nov 09 20:07:37.641153 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 7/7] 10.222.0.25 () {58 vars in 1250 bytes} [Tue Nov 9 20:07:37 2021] GET /compute/v2.1/os-snapshots/de7a62b1-8557-4e8a-805f-877952319efc => generated 285 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:07:38.652135 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-623eb522-5d8a-4c72-9d79-2ddde35e9a82 tempest-VolumesSnapshotsTestJSON-866801274 tempest-VolumesSnapshotsTestJSON-866801274-project] Calling method '.version_select at 0x7fab3ca0a790>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:07:38.686667 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.virt.hardware [None req-f3603a94-b2db-4547-8366-2911b76d8499 tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] Flavor limits 0:0:0 {{(pid=116102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 09 20:07:38.687282 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.virt.hardware [None req-f3603a94-b2db-4547-8366-2911b76d8499 tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] Image limits 0:0:0 {{(pid=116102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 09 20:07:38.687556 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.virt.hardware [None req-f3603a94-b2db-4547-8366-2911b76d8499 tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] Flavor pref 0:0:0 {{(pid=116102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 09 20:07:38.687965 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.virt.hardware [None req-f3603a94-b2db-4547-8366-2911b76d8499 tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] Image pref 0:0:0 {{(pid=116102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 09 20:07:38.688383 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.virt.hardware [None req-f3603a94-b2db-4547-8366-2911b76d8499 tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 09 20:07:38.706140 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-623eb522-5d8a-4c72-9d79-2ddde35e9a82 tempest-VolumesSnapshotsTestJSON-866801274 tempest-VolumesSnapshotsTestJSON-866801274-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/de7a62b1-8557-4e8a-805f-877952319efc" status: 200 len: 285 microversion: 2.1 time: 0.058498 Nov 09 20:07:38.706708 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 8/8] 10.222.0.25 () {58 vars in 1250 bytes} [Tue Nov 9 20:07:38 2021] GET /compute/v2.1/os-snapshots/de7a62b1-8557-4e8a-805f-877952319efc => generated 285 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:07:38.726497 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f3603a94-b2db-4547-8366-2911b76d8499 tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:07:38.727340 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f3603a94-b2db-4547-8366-2911b76d8499 tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:07:38.728439 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f3603a94-b2db-4547-8366-2911b76d8499 tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:07:38.729110 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f3603a94-b2db-4547-8366-2911b76d8499 tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:07:38.783428 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.quota [None req-f3603a94-b2db-4547-8366-2911b76d8499 tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] Getting quotas for project c4112bf1e0544da3a76ae67c69234248. Resources: {'cores', 'instances', 'ram'} {{(pid=116102) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 09 20:07:38.903178 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.quota [None req-f3603a94-b2db-4547-8366-2911b76d8499 tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] Getting quotas for user be7c1dc758e548a8a9e638f45e9f2e54 and project c4112bf1e0544da3a76ae67c69234248. Resources: {'cores', 'instances', 'ram'} {{(pid=116102) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 09 20:07:38.903178 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-f3603a94-b2db-4547-8366-2911b76d8499 tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] Going to run 1 instances... {{(pid=116102) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 09 20:07:38.903178 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-f3603a94-b2db-4547-8366-2911b76d8499 tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] [instance: bf7875f5-a01d-4ea9-8d7b-cbe90b7a6418] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='109ded43-8c19-4f17-afac-7625dcfef942',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 09 20:07:39.020820 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-f3603a94-b2db-4547-8366-2911b76d8499 tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.477568 Nov 09 20:07:39.021451 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1/9] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Nov 9 20:07:35 2021] POST /compute/v2.1/servers => generated 380 bytes in 3480 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 09 20:07:39.031897 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-46fdf393-d00b-4071-830a-10015e598b5a tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:07:39.032673 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-46fdf393-d00b-4071-830a-10015e598b5a tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] [instance: bf7875f5-a01d-4ea9-8d7b-cbe90b7a6418] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:07:39.256220 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-46fdf393-d00b-4071-830a-10015e598b5a tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7c1dc758e548a8a9e638f45e9f2e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4112bf1e0544da3a76ae67c69234248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:07:39.278114 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-46fdf393-d00b-4071-830a-10015e598b5a tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] 10.222.0.25 "GET /compute/v2.1/servers/bf7875f5-a01d-4ea9-8d7b-cbe90b7a6418" status: 200 len: 1215 microversion: 2.1 time: 0.249719 Nov 09 20:07:39.278705 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 9/10] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:07:39 2021] GET /compute/v2.1/servers/bf7875f5-a01d-4ea9-8d7b-cbe90b7a6418 => generated 1215 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:07:39.718851 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-b95d7fc4-eae2-44e1-b7b9-db09105bec6d tempest-VolumesSnapshotsTestJSON-866801274 tempest-VolumesSnapshotsTestJSON-866801274-project] Calling method '.version_select at 0x7fab3c9a2b80>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:07:39.834438 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-b95d7fc4-eae2-44e1-b7b9-db09105bec6d tempest-VolumesSnapshotsTestJSON-866801274 tempest-VolumesSnapshotsTestJSON-866801274-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/de7a62b1-8557-4e8a-805f-877952319efc" status: 200 len: 285 microversion: 2.1 time: 0.119498 Nov 09 20:07:39.835639 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 2/11] 10.222.0.25 () {58 vars in 1250 bytes} [Tue Nov 9 20:07:39 2021] GET /compute/v2.1/os-snapshots/de7a62b1-8557-4e8a-805f-877952319efc => generated 285 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:07:40.297371 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-56e84420-86f4-4fd7-babe-41114679d298 tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:07:40.298618 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-56e84420-86f4-4fd7-babe-41114679d298 tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] [instance: bf7875f5-a01d-4ea9-8d7b-cbe90b7a6418] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:07:40.386597 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-56e84420-86f4-4fd7-babe-41114679d298 tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7c1dc758e548a8a9e638f45e9f2e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4112bf1e0544da3a76ae67c69234248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:07:40.394878 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-56e84420-86f4-4fd7-babe-41114679d298 tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] 10.222.0.25 "GET /compute/v2.1/servers/bf7875f5-a01d-4ea9-8d7b-cbe90b7a6418" status: 200 len: 1215 microversion: 2.1 time: 0.100801 Nov 09 20:07:40.408384 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 10/12] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:07:40 2021] GET /compute/v2.1/servers/bf7875f5-a01d-4ea9-8d7b-cbe90b7a6418 => generated 1215 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:07:40.857536 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-da901b65-3634-4920-a2a3-7f7c58dfc0c1 tempest-VolumesSnapshotsTestJSON-866801274 tempest-VolumesSnapshotsTestJSON-866801274-project] Calling method '.version_select at 0x7fab3c1418b0>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:07:40.937239 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-da901b65-3634-4920-a2a3-7f7c58dfc0c1 tempest-VolumesSnapshotsTestJSON-866801274 tempest-VolumesSnapshotsTestJSON-866801274-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/de7a62b1-8557-4e8a-805f-877952319efc" status: 200 len: 286 microversion: 2.1 time: 0.092401 Nov 09 20:07:40.938541 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 3/13] 10.222.0.25 () {58 vars in 1250 bytes} [Tue Nov 9 20:07:40 2021] GET /compute/v2.1/os-snapshots/de7a62b1-8557-4e8a-805f-877952319efc => generated 286 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:07:40.949697 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-fa2033f1-d3e8-452d-8365-558c6846a7b4 tempest-VolumesSnapshotsTestJSON-866801274 tempest-VolumesSnapshotsTestJSON-866801274-project] Calling method '.version_select at 0x7fab3c9d2af0>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:07:41.061370 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-fa2033f1-d3e8-452d-8365-558c6846a7b4 tempest-VolumesSnapshotsTestJSON-866801274 tempest-VolumesSnapshotsTestJSON-866801274-project] 10.222.0.25 "DELETE /compute/v2.1/os-snapshots/de7a62b1-8557-4e8a-805f-877952319efc" status: 202 len: 0 microversion: 2.1 time: 0.115877 Nov 09 20:07:41.062523 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 11/14] 10.222.0.25 () {58 vars in 1253 bytes} [Tue Nov 9 20:07:40 2021] DELETE /compute/v2.1/os-snapshots/de7a62b1-8557-4e8a-805f-877952319efc => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 09 20:07:41.071670 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-af175180-496b-4cc9-93e1-771a0d9df62a tempest-VolumesSnapshotsTestJSON-866801274 tempest-VolumesSnapshotsTestJSON-866801274-project] Calling method '.version_select at 0x7fab3c126160>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:07:41.142493 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-af175180-496b-4cc9-93e1-771a0d9df62a tempest-VolumesSnapshotsTestJSON-866801274 tempest-VolumesSnapshotsTestJSON-866801274-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/de7a62b1-8557-4e8a-805f-877952319efc" status: 200 len: 285 microversion: 2.1 time: 0.075368 Nov 09 20:07:41.143963 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 4/15] 10.222.0.25 () {58 vars in 1250 bytes} [Tue Nov 9 20:07:41 2021] GET /compute/v2.1/os-snapshots/de7a62b1-8557-4e8a-805f-877952319efc => generated 285 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:07:41.420597 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-ab996614-acdb-4537-a2c0-33e5ce67fb12 tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:07:41.422391 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-ab996614-acdb-4537-a2c0-33e5ce67fb12 tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] [instance: bf7875f5-a01d-4ea9-8d7b-cbe90b7a6418] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:07:41.432751 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ab996614-acdb-4537-a2c0-33e5ce67fb12 tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:07:41.454891 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ab996614-acdb-4537-a2c0-33e5ce67fb12 tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:07:41.458040 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ab996614-acdb-4537-a2c0-33e5ce67fb12 tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:07:41.458836 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ab996614-acdb-4537-a2c0-33e5ce67fb12 tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:07:41.811959 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-ab996614-acdb-4537-a2c0-33e5ce67fb12 tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7c1dc758e548a8a9e638f45e9f2e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4112bf1e0544da3a76ae67c69234248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:07:41.831243 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-ab996614-acdb-4537-a2c0-33e5ce67fb12 tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] 10.222.0.25 "GET /compute/v2.1/servers/bf7875f5-a01d-4ea9-8d7b-cbe90b7a6418" status: 200 len: 1219 microversion: 2.1 time: 0.418768 Nov 09 20:07:41.833467 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 12/16] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:07:41 2021] GET /compute/v2.1/servers/bf7875f5-a01d-4ea9-8d7b-cbe90b7a6418 => generated 1219 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:07:42.155949 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-0451a9d1-f755-4044-95de-49aa713e3ebe tempest-VolumesSnapshotsTestJSON-866801274 tempest-VolumesSnapshotsTestJSON-866801274-project] Calling method '.version_select at 0x7fab3c118ee0>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:07:42.252066 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-0451a9d1-f755-4044-95de-49aa713e3ebe tempest-VolumesSnapshotsTestJSON-866801274 tempest-VolumesSnapshotsTestJSON-866801274-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/de7a62b1-8557-4e8a-805f-877952319efc" status: 200 len: 285 microversion: 2.1 time: 0.099874 Nov 09 20:07:42.253404 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 5/17] 10.222.0.25 () {58 vars in 1250 bytes} [Tue Nov 9 20:07:42 2021] GET /compute/v2.1/os-snapshots/de7a62b1-8557-4e8a-805f-877952319efc => generated 285 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:07:42.854975 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-8412044c-c6e0-4c31-8b37-b33544646da7 tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:07:42.855577 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-8412044c-c6e0-4c31-8b37-b33544646da7 tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] [instance: bf7875f5-a01d-4ea9-8d7b-cbe90b7a6418] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:07:42.875543 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8412044c-c6e0-4c31-8b37-b33544646da7 tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:07:42.876168 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8412044c-c6e0-4c31-8b37-b33544646da7 tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:07:42.879626 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8412044c-c6e0-4c31-8b37-b33544646da7 tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:07:42.880267 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8412044c-c6e0-4c31-8b37-b33544646da7 tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:07:43.264506 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-2f4e934f-0666-4598-829f-025a029b1b06 tempest-VolumesSnapshotsTestJSON-866801274 tempest-VolumesSnapshotsTestJSON-866801274-project] Calling method '.version_select at 0x7fab3c126820>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:07:43.318331 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-2f4e934f-0666-4598-829f-025a029b1b06 tempest-VolumesSnapshotsTestJSON-866801274 tempest-VolumesSnapshotsTestJSON-866801274-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/de7a62b1-8557-4e8a-805f-877952319efc" status: 200 len: 285 microversion: 2.1 time: 0.057956 Nov 09 20:07:43.319740 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 6/18] 10.222.0.25 () {58 vars in 1250 bytes} [Tue Nov 9 20:07:43 2021] GET /compute/v2.1/os-snapshots/de7a62b1-8557-4e8a-805f-877952319efc => generated 285 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 20:07:43.467281 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-8412044c-c6e0-4c31-8b37-b33544646da7 tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7c1dc758e548a8a9e638f45e9f2e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4112bf1e0544da3a76ae67c69234248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:07:43.488019 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-8412044c-c6e0-4c31-8b37-b33544646da7 tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] 10.222.0.25 "GET /compute/v2.1/servers/bf7875f5-a01d-4ea9-8d7b-cbe90b7a6418" status: 200 len: 1219 microversion: 2.1 time: 0.640089 Nov 09 20:07:43.488808 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 13/19] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:07:42 2021] GET /compute/v2.1/servers/bf7875f5-a01d-4ea9-8d7b-cbe90b7a6418 => generated 1219 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:07:44.332821 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-8b569a1f-2fdd-4e8e-a0a2-5d14727ac99b tempest-VolumesSnapshotsTestJSON-866801274 tempest-VolumesSnapshotsTestJSON-866801274-project] Calling method '.version_select at 0x7fab3c126af0>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:07:44.411508 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-8b569a1f-2fdd-4e8e-a0a2-5d14727ac99b tempest-VolumesSnapshotsTestJSON-866801274 tempest-VolumesSnapshotsTestJSON-866801274-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/de7a62b1-8557-4e8a-805f-877952319efc" status: 200 len: 285 microversion: 2.1 time: 0.082263 Nov 09 20:07:44.412205 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 7/20] 10.222.0.25 () {58 vars in 1250 bytes} [Tue Nov 9 20:07:44 2021] GET /compute/v2.1/os-snapshots/de7a62b1-8557-4e8a-805f-877952319efc => generated 285 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:07:44.507707 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-7b02e089-4d37-489f-bcdf-dbf12d5073aa tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:07:44.508541 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-7b02e089-4d37-489f-bcdf-dbf12d5073aa tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] [instance: bf7875f5-a01d-4ea9-8d7b-cbe90b7a6418] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:07:44.524960 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7b02e089-4d37-489f-bcdf-dbf12d5073aa tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:07:44.527979 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7b02e089-4d37-489f-bcdf-dbf12d5073aa tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:07:44.530753 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7b02e089-4d37-489f-bcdf-dbf12d5073aa tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:07:44.531418 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7b02e089-4d37-489f-bcdf-dbf12d5073aa tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:07:44.948900 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-f1d7369e-d037-4d94-ba24-74c22883358b tempest-VolumesTestJSON-1715234088 tempest-VolumesTestJSON-1715234088-project] Calling method '.version_select at 0x7fab3c126f70>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:07:45.088931 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-f1d7369e-d037-4d94-ba24-74c22883358b tempest-VolumesTestJSON-1715234088 tempest-VolumesTestJSON-1715234088-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/f5bdad6c-03b8-47e6-a3ee-448f291d8fdc" status: 200 len: 350 microversion: 2.1 time: 0.151249 Nov 09 20:07:45.096069 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 8/21] 10.222.0.25 () {58 vars in 1244 bytes} [Tue Nov 9 20:07:44 2021] GET /compute/v2.1/os-volumes/f5bdad6c-03b8-47e6-a3ee-448f291d8fdc => generated 350 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:07:45.259960 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-7b02e089-4d37-489f-bcdf-dbf12d5073aa tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7c1dc758e548a8a9e638f45e9f2e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4112bf1e0544da3a76ae67c69234248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:07:45.274538 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-7b02e089-4d37-489f-bcdf-dbf12d5073aa tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] 10.222.0.25 "GET /compute/v2.1/servers/bf7875f5-a01d-4ea9-8d7b-cbe90b7a6418" status: 200 len: 1267 microversion: 2.1 time: 0.767200 Nov 09 20:07:45.276384 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 14/22] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:07:44 2021] GET /compute/v2.1/servers/bf7875f5-a01d-4ea9-8d7b-cbe90b7a6418 => generated 1267 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:07:45.337413 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-406bcd6c-48d0-4899-b48f-cc38a66efd4b tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Action: 'create', calling method: .version_select at 0x7fab3d3ec940>, body: {"keypair": {"name": "tempest-keypair-1604207818"}} {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:07:45.405689 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.quota [None req-406bcd6c-48d0-4899-b48f-cc38a66efd4b tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Getting quotas for project ee9e1da6a3c14c4a931ece53d568b716. Resources: {'key_pairs'} {{(pid=116102) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 09 20:07:45.421849 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.quota [None req-406bcd6c-48d0-4899-b48f-cc38a66efd4b tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Getting quotas for user 9f813425597246e495fca79f1d6a1448 and project ee9e1da6a3c14c4a931ece53d568b716. Resources: {'key_pairs'} {{(pid=116102) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 09 20:07:45.425571 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-e1e1e74a-5e91-475b-8dcb-64efcc2f8903 tempest-VolumesSnapshotsTestJSON-866801274 tempest-VolumesSnapshotsTestJSON-866801274-project] Calling method '.version_select at 0x7fab3c961160>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:07:45.624465 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.wsgi [None req-e1e1e74a-5e91-475b-8dcb-64efcc2f8903 tempest-VolumesSnapshotsTestJSON-866801274 tempest-VolumesSnapshotsTestJSON-866801274-project] HTTP exception thrown: Snapshot de7a62b1-8557-4e8a-805f-877952319efc could not be found. Nov 09 20:07:45.625684 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-e1e1e74a-5e91-475b-8dcb-64efcc2f8903 tempest-VolumesSnapshotsTestJSON-866801274 tempest-VolumesSnapshotsTestJSON-866801274-project] Returning 404 to user: Snapshot de7a62b1-8557-4e8a-805f-877952319efc could not be found. {{(pid=116103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 09 20:07:45.626825 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-e1e1e74a-5e91-475b-8dcb-64efcc2f8903 tempest-VolumesSnapshotsTestJSON-866801274 tempest-VolumesSnapshotsTestJSON-866801274-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/de7a62b1-8557-4e8a-805f-877952319efc" status: 404 len: 111 microversion: 2.1 time: 0.206203 Nov 09 20:07:45.627807 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 15/23] 10.222.0.25 () {58 vars in 1250 bytes} [Tue Nov 9 20:07:45 2021] GET /compute/v2.1/os-snapshots/de7a62b1-8557-4e8a-805f-877952319efc => generated 111 bytes in 208 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 09 20:07:45.637439 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-789b6a24-7ba8-413e-b596-ea2aa0bc1d56 tempest-VolumesSnapshotsTestJSON-866801274 tempest-VolumesSnapshotsTestJSON-866801274-project] Calling method '.version_select at 0x7fab3d3ed820>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:07:45.904855 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-789b6a24-7ba8-413e-b596-ea2aa0bc1d56 tempest-VolumesSnapshotsTestJSON-866801274 tempest-VolumesSnapshotsTestJSON-866801274-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/a912e679-60fb-4b9c-bf0d-b4bf5a7e49d0" status: 202 len: 0 microversion: 2.1 time: 0.271365 Nov 09 20:07:45.905700 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 16/24] 10.222.0.25 () {58 vars in 1247 bytes} [Tue Nov 9 20:07:45 2021] DELETE /compute/v2.1/os-volumes/a912e679-60fb-4b9c-bf0d-b4bf5a7e49d0 => generated 0 bytes in 274 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 09 20:07:45.915056 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-be28fd80-618e-465c-a7b1-06a94053a2a2 tempest-VolumesSnapshotsTestJSON-866801274 tempest-VolumesSnapshotsTestJSON-866801274-project] Calling method '.version_select at 0x7fab3c961430>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:07:46.003619 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.quota [None req-406bcd6c-48d0-4899-b48f-cc38a66efd4b tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Getting quotas for project ee9e1da6a3c14c4a931ece53d568b716. Resources: {'key_pairs'} {{(pid=116102) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 09 20:07:46.021797 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.quota [None req-406bcd6c-48d0-4899-b48f-cc38a66efd4b tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Getting quotas for user 9f813425597246e495fca79f1d6a1448 and project ee9e1da6a3c14c4a931ece53d568b716. Resources: {'key_pairs'} {{(pid=116102) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 09 20:07:46.113468 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-406bcd6c-48d0-4899-b48f-cc38a66efd4b tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.20 time: 1.009180 Nov 09 20:07:46.114188 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 9/25] 10.222.0.25 () {62 vars in 1198 bytes} [Tue Nov 9 20:07:45 2021] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 1019 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Nov 09 20:07:46.223230 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.wsgi [None req-be28fd80-618e-465c-a7b1-06a94053a2a2 tempest-VolumesSnapshotsTestJSON-866801274 tempest-VolumesSnapshotsTestJSON-866801274-project] HTTP exception thrown: Volume a912e679-60fb-4b9c-bf0d-b4bf5a7e49d0 could not be found. Nov 09 20:07:46.225111 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-be28fd80-618e-465c-a7b1-06a94053a2a2 tempest-VolumesSnapshotsTestJSON-866801274 tempest-VolumesSnapshotsTestJSON-866801274-project] Returning 404 to user: Volume a912e679-60fb-4b9c-bf0d-b4bf5a7e49d0 could not be found. {{(pid=116103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 09 20:07:46.226601 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-be28fd80-618e-465c-a7b1-06a94053a2a2 tempest-VolumesSnapshotsTestJSON-866801274 tempest-VolumesSnapshotsTestJSON-866801274-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/a912e679-60fb-4b9c-bf0d-b4bf5a7e49d0" status: 404 len: 109 microversion: 2.1 time: 0.316894 Nov 09 20:07:46.227568 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 17/26] 10.222.0.25 () {58 vars in 1244 bytes} [Tue Nov 9 20:07:45 2021] GET /compute/v2.1/os-volumes/a912e679-60fb-4b9c-bf0d-b4bf5a7e49d0 => generated 109 bytes in 318 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 09 20:07:46.263687 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-74349293-d117-4eba-9215-071271efbdd2 tempest-VolumesSnapshotsTestJSON-866801274 tempest-VolumesSnapshotsTestJSON-866801274-project] Calling method '.version_select at 0x7fab3c126550>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:07:46.293664 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-9623ef0b-18b3-4b43-9799-3ec1a0044e7e tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:07:46.295065 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-9623ef0b-18b3-4b43-9799-3ec1a0044e7e tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] [instance: bf7875f5-a01d-4ea9-8d7b-cbe90b7a6418] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:07:46.312321 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9623ef0b-18b3-4b43-9799-3ec1a0044e7e tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:07:46.312807 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9623ef0b-18b3-4b43-9799-3ec1a0044e7e tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:07:46.318453 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9623ef0b-18b3-4b43-9799-3ec1a0044e7e tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:07:46.323724 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9623ef0b-18b3-4b43-9799-3ec1a0044e7e tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:07:46.353657 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.wsgi [None req-74349293-d117-4eba-9215-071271efbdd2 tempest-VolumesSnapshotsTestJSON-866801274 tempest-VolumesSnapshotsTestJSON-866801274-project] HTTP exception thrown: Volume a912e679-60fb-4b9c-bf0d-b4bf5a7e49d0 could not be found. Nov 09 20:07:46.354926 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-74349293-d117-4eba-9215-071271efbdd2 tempest-VolumesSnapshotsTestJSON-866801274 tempest-VolumesSnapshotsTestJSON-866801274-project] Returning 404 to user: Volume a912e679-60fb-4b9c-bf0d-b4bf5a7e49d0 could not be found. {{(pid=116102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 09 20:07:46.356106 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-74349293-d117-4eba-9215-071271efbdd2 tempest-VolumesSnapshotsTestJSON-866801274 tempest-VolumesSnapshotsTestJSON-866801274-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/a912e679-60fb-4b9c-bf0d-b4bf5a7e49d0" status: 404 len: 109 microversion: 2.1 time: 0.116869 Nov 09 20:07:46.357368 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 10/27] 10.222.0.25 () {58 vars in 1247 bytes} [Tue Nov 9 20:07:46 2021] DELETE /compute/v2.1/os-volumes/a912e679-60fb-4b9c-bf0d-b4bf5a7e49d0 => generated 109 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 09 20:07:46.373114 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-13c43c6b-d64a-4b8d-920b-833518b0800a tempest-VolumesSnapshotsTestJSON-866801274 tempest-VolumesSnapshotsTestJSON-866801274-project] Calling method '.version_select at 0x7fab3ca89310>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:07:46.470832 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.wsgi [None req-13c43c6b-d64a-4b8d-920b-833518b0800a tempest-VolumesSnapshotsTestJSON-866801274 tempest-VolumesSnapshotsTestJSON-866801274-project] HTTP exception thrown: Volume a912e679-60fb-4b9c-bf0d-b4bf5a7e49d0 could not be found. Nov 09 20:07:46.471801 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-13c43c6b-d64a-4b8d-920b-833518b0800a tempest-VolumesSnapshotsTestJSON-866801274 tempest-VolumesSnapshotsTestJSON-866801274-project] Returning 404 to user: Volume a912e679-60fb-4b9c-bf0d-b4bf5a7e49d0 could not be found. {{(pid=116102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 09 20:07:46.472909 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-13c43c6b-d64a-4b8d-920b-833518b0800a tempest-VolumesSnapshotsTestJSON-866801274 tempest-VolumesSnapshotsTestJSON-866801274-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/a912e679-60fb-4b9c-bf0d-b4bf5a7e49d0" status: 404 len: 109 microversion: 2.1 time: 0.107075 Nov 09 20:07:46.473875 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 11/28] 10.222.0.25 () {58 vars in 1244 bytes} [Tue Nov 9 20:07:46 2021] GET /compute/v2.1/os-volumes/a912e679-60fb-4b9c-bf0d-b4bf5a7e49d0 => generated 109 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 09 20:07:46.719272 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-9623ef0b-18b3-4b43-9799-3ec1a0044e7e tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7c1dc758e548a8a9e638f45e9f2e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4112bf1e0544da3a76ae67c69234248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:07:46.741763 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-9623ef0b-18b3-4b43-9799-3ec1a0044e7e tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] 10.222.0.25 "GET /compute/v2.1/servers/bf7875f5-a01d-4ea9-8d7b-cbe90b7a6418" status: 200 len: 1273 microversion: 2.1 time: 0.452353 Nov 09 20:07:46.744063 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 18/29] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:07:46 2021] GET /compute/v2.1/servers/bf7875f5-a01d-4ea9-8d7b-cbe90b7a6418 => generated 1273 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:07:47.322483 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-afc322bf-9535-4223-b1b0-de34cfd1a32f tempest-VolumesTestJSON-1715234088 tempest-VolumesTestJSON-1715234088-project] Calling method '.version_select at 0x7fab3d3ed670>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:07:47.506918 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-afc322bf-9535-4223-b1b0-de34cfd1a32f tempest-VolumesTestJSON-1715234088 tempest-VolumesTestJSON-1715234088-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/06f5db20-b2da-4e29-baa2-eff46bb436b1" status: 200 len: 351 microversion: 2.1 time: 0.188496 Nov 09 20:07:47.507762 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 19/30] 10.222.0.25 () {58 vars in 1244 bytes} [Tue Nov 9 20:07:47 2021] GET /compute/v2.1/os-volumes/06f5db20-b2da-4e29-baa2-eff46bb436b1 => generated 351 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:07:47.518928 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-6a89f3d9-9260-4498-bcf3-522e115c3ba4 tempest-VolumesTestJSON-1715234088 tempest-VolumesTestJSON-1715234088-project] Calling method '.version_select at 0x7fab3c939280>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:07:47.562580 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-be12d31d-3db0-4a24-ac7a-8b16c300051a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-284860373", "imageRef": "109ded43-8c19-4f17-afac-7625dcfef942", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "609b381f-6a00-4f5b-bc42-7d010569a218"}]}} {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:07:47.704965 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.network.neutron [None req-be12d31d-3db0-4a24-ac7a-8b16c300051a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] validate_networks() for [('609b381f-6a00-4f5b-bc42-7d010569a218', None, None, None, None, None)] {{(pid=116102) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 09 20:07:47.817174 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-6a89f3d9-9260-4498-bcf3-522e115c3ba4 tempest-VolumesTestJSON-1715234088 tempest-VolumesTestJSON-1715234088-project] 10.222.0.25 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.301590 Nov 09 20:07:47.818035 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 20/31] 10.222.0.25 () {58 vars in 1133 bytes} [Tue Nov 9 20:07:47 2021] GET /compute/v2.1/os-volumes => generated 1035 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 20:07:47.830999 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-0a0e5ee9-218c-42d0-ae83-8054ba7e02ff tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:07:47.831612 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-0a0e5ee9-218c-42d0-ae83-8054ba7e02ff tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] [instance: bf7875f5-a01d-4ea9-8d7b-cbe90b7a6418] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:07:47.850568 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0a0e5ee9-218c-42d0-ae83-8054ba7e02ff tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:07:47.851029 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0a0e5ee9-218c-42d0-ae83-8054ba7e02ff tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:07:47.851808 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0a0e5ee9-218c-42d0-ae83-8054ba7e02ff tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:07:47.862244 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0a0e5ee9-218c-42d0-ae83-8054ba7e02ff tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:07:48.740674 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-0a0e5ee9-218c-42d0-ae83-8054ba7e02ff tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7c1dc758e548a8a9e638f45e9f2e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4112bf1e0544da3a76ae67c69234248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:07:48.762981 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-0a0e5ee9-218c-42d0-ae83-8054ba7e02ff tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] 10.222.0.25 "GET /compute/v2.1/servers/bf7875f5-a01d-4ea9-8d7b-cbe90b7a6418" status: 200 len: 1273 microversion: 2.1 time: 0.943893 Nov 09 20:07:48.763615 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 21/32] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:07:47 2021] GET /compute/v2.1/servers/bf7875f5-a01d-4ea9-8d7b-cbe90b7a6418 => generated 1273 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:07:48.777538 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-3bb745bc-3731-4477-adb4-aab104d5b002 tempest-VolumesTestJSON-1715234088 tempest-VolumesTestJSON-1715234088-project] Calling method '.version_select at 0x7fab3c961700>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:07:49.093142 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-3bb745bc-3731-4477-adb4-aab104d5b002 tempest-VolumesTestJSON-1715234088 tempest-VolumesTestJSON-1715234088-project] 10.222.0.25 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.319150 Nov 09 20:07:49.093761 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 22/33] 10.222.0.25 () {58 vars in 1148 bytes} [Tue Nov 9 20:07:48 2021] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:07:49.107465 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-a386ff0d-4d89-4975-9851-39fe0020ab8e tempest-VolumesTestJSON-1715234088 tempest-VolumesTestJSON-1715234088-project] Calling method '.version_select at 0x7fab3c9395e0>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:07:49.360218 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-a386ff0d-4d89-4975-9851-39fe0020ab8e tempest-VolumesTestJSON-1715234088 tempest-VolumesTestJSON-1715234088-project] 10.222.0.25 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.256513 Nov 09 20:07:49.361407 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 23/34] 10.222.0.25 () {58 vars in 1133 bytes} [Tue Nov 9 20:07:49 2021] GET /compute/v2.1/os-volumes => generated 1035 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 20:07:49.374271 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-3a21de25-656e-4cc6-99f6-dbb32e6f0890 tempest-VolumesTestJSON-1715234088 tempest-VolumesTestJSON-1715234088-project] Calling method '.version_select at 0x7fab3c8d1310>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:07:49.739968 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-3a21de25-656e-4cc6-99f6-dbb32e6f0890 tempest-VolumesTestJSON-1715234088 tempest-VolumesTestJSON-1715234088-project] 10.222.0.25 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.370378 Nov 09 20:07:49.741473 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 24/35] 10.222.0.25 () {58 vars in 1166 bytes} [Tue Nov 9 20:07:49 2021] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:07:49.753304 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-1badc805-4565-41b4-95e5-84eab3394b9e tempest-VolumesTestJSON-1715234088 tempest-VolumesTestJSON-1715234088-project] Calling method '.version_select at 0x7fab3c939820>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:07:50.037880 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-1badc805-4565-41b4-95e5-84eab3394b9e tempest-VolumesTestJSON-1715234088 tempest-VolumesTestJSON-1715234088-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.288009 Nov 09 20:07:50.045626 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 25/36] 10.222.0.25 () {58 vars in 1169 bytes} [Tue Nov 9 20:07:49 2021] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:07:50.045626 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-e778146e-854c-4b6c-9fc9-9ade3ba80655 tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:07:50.047121 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-e778146e-854c-4b6c-9fc9-9ade3ba80655 tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] [instance: bf7875f5-a01d-4ea9-8d7b-cbe90b7a6418] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:07:50.070996 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e778146e-854c-4b6c-9fc9-9ade3ba80655 tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:07:50.071514 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e778146e-854c-4b6c-9fc9-9ade3ba80655 tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:07:50.075633 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e778146e-854c-4b6c-9fc9-9ade3ba80655 tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:07:50.076084 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e778146e-854c-4b6c-9fc9-9ade3ba80655 tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:07:50.187040 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.virt.hardware [None req-be12d31d-3db0-4a24-ac7a-8b16c300051a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Flavor limits 0:0:0 {{(pid=116102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 09 20:07:50.188782 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.virt.hardware [None req-be12d31d-3db0-4a24-ac7a-8b16c300051a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Image limits 0:0:0 {{(pid=116102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 09 20:07:50.189289 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.virt.hardware [None req-be12d31d-3db0-4a24-ac7a-8b16c300051a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Flavor pref 0:0:0 {{(pid=116102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 09 20:07:50.189704 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.virt.hardware [None req-be12d31d-3db0-4a24-ac7a-8b16c300051a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Image pref 0:0:0 {{(pid=116102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 09 20:07:50.190181 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.virt.hardware [None req-be12d31d-3db0-4a24-ac7a-8b16c300051a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 09 20:07:50.220877 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-be12d31d-3db0-4a24-ac7a-8b16c300051a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:07:50.221334 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-be12d31d-3db0-4a24-ac7a-8b16c300051a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:07:50.224818 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-be12d31d-3db0-4a24-ac7a-8b16c300051a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:07:50.225635 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-be12d31d-3db0-4a24-ac7a-8b16c300051a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:07:50.291091 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.quota [None req-be12d31d-3db0-4a24-ac7a-8b16c300051a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Getting quotas for project be3e835ea4424a88bb80e940a61aff08. Resources: {'cores', 'instances', 'ram'} {{(pid=116102) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 09 20:07:50.302974 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.quota [None req-be12d31d-3db0-4a24-ac7a-8b16c300051a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Getting quotas for user b9eba07a4d664c80a55e05a82a791bb6 and project be3e835ea4424a88bb80e940a61aff08. Resources: {'cores', 'instances', 'ram'} {{(pid=116102) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 09 20:07:50.338309 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-be12d31d-3db0-4a24-ac7a-8b16c300051a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Going to run 1 instances... {{(pid=116102) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 09 20:07:50.340848 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-be12d31d-3db0-4a24-ac7a-8b16c300051a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='109ded43-8c19-4f17-afac-7625dcfef942',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 09 20:07:50.439579 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-be12d31d-3db0-4a24-ac7a-8b16c300051a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.237125 Nov 09 20:07:50.444933 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 12/37] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Nov 9 20:07:47 2021] POST /compute/v2.1/servers => generated 383 bytes in 3243 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 09 20:07:50.455051 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-e009fe79-079e-4c1a-94d6-585cfb12457d tempest-VolumesTestJSON-1715234088 tempest-VolumesTestJSON-1715234088-project] Calling method '.version_select at 0x7fab3c131700>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:07:50.681894 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-e009fe79-079e-4c1a-94d6-585cfb12457d tempest-VolumesTestJSON-1715234088 tempest-VolumesTestJSON-1715234088-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.235806 Nov 09 20:07:50.682785 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 13/38] 10.222.0.25 () {58 vars in 1154 bytes} [Tue Nov 9 20:07:50 2021] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:07:50.694133 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-4f5ecb27-b8fd-4b42-ae60-4dd88f4321b5 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:07:50.698705 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-4f5ecb27-b8fd-4b42-ae60-4dd88f4321b5 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:07:51.145460 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-4f5ecb27-b8fd-4b42-ae60-4dd88f4321b5 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:07:51.181310 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-4f5ecb27-b8fd-4b42-ae60-4dd88f4321b5 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1221 microversion: 2.1 time: 0.492440 Nov 09 20:07:51.184463 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 14/39] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:07:50 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1221 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:07:51.207887 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-a349e1b3-da37-4098-9c85-6c8fbdab734c tempest-VolumesTestJSON-1715234088 tempest-VolumesTestJSON-1715234088-project] Calling method '.version_select at 0x7fab3c0f2af0>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:07:51.456509 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-a349e1b3-da37-4098-9c85-6c8fbdab734c tempest-VolumesTestJSON-1715234088 tempest-VolumesTestJSON-1715234088-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.270332 Nov 09 20:07:51.457097 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 15/40] 10.222.0.25 () {58 vars in 1187 bytes} [Tue Nov 9 20:07:51 2021] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:07:51.466264 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-e778146e-854c-4b6c-9fc9-9ade3ba80655 tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7c1dc758e548a8a9e638f45e9f2e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4112bf1e0544da3a76ae67c69234248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:07:51.470777 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-dc0966fb-27d1-416a-9250-6ef0c1dd0c6f tempest-VolumesTestJSON-1715234088 tempest-VolumesTestJSON-1715234088-project] Calling method '.version_select at 0x7fab3c0fcaf0>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:07:51.478983 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-e778146e-854c-4b6c-9fc9-9ade3ba80655 tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] 10.222.0.25 "GET /compute/v2.1/servers/bf7875f5-a01d-4ea9-8d7b-cbe90b7a6418" status: 200 len: 1315 microversion: 2.1 time: 1.438006 Nov 09 20:07:51.490201 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 26/41] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:07:50 2021] GET /compute/v2.1/servers/bf7875f5-a01d-4ea9-8d7b-cbe90b7a6418 => generated 1315 bytes in 1444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:07:51.731750 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-dc0966fb-27d1-416a-9250-6ef0c1dd0c6f tempest-VolumesTestJSON-1715234088 tempest-VolumesTestJSON-1715234088-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.265037 Nov 09 20:07:51.744002 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 16/42] 10.222.0.25 () {58 vars in 1154 bytes} [Tue Nov 9 20:07:51 2021] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:07:51.744002 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-24973662-7457-4d76-805f-5628dc990a6b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-622957831", "imageRef": "109ded43-8c19-4f17-afac-7625dcfef942", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "609b381f-6a00-4f5b-bc42-7d010569a218"}]}} {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:07:51.834608 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-1a7c8bfd-6a72-4270-baa4-d276aafb7772 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Action: 'create', calling method: .version_select at 0x7fab3c9393a0>, body: {"keypair": {"name": "tempest-keypair-919557392"}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:07:51.870388 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.network.neutron [None req-24973662-7457-4d76-805f-5628dc990a6b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] validate_networks() for [('609b381f-6a00-4f5b-bc42-7d010569a218', None, None, None, None, None)] {{(pid=116102) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 09 20:07:51.990502 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.quota [None req-1a7c8bfd-6a72-4270-baa4-d276aafb7772 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Getting quotas for project 04aa1d479bda429cb8cc96145ab3e4ab. Resources: {'key_pairs'} {{(pid=116103) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 09 20:07:52.011140 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.quota [None req-1a7c8bfd-6a72-4270-baa4-d276aafb7772 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Getting quotas for user 5d2764f4c77b47629d7c33ea15a5b566 and project 04aa1d479bda429cb8cc96145ab3e4ab. Resources: {'key_pairs'} {{(pid=116103) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 09 20:07:52.782608 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.quota [None req-1a7c8bfd-6a72-4270-baa4-d276aafb7772 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Getting quotas for project 04aa1d479bda429cb8cc96145ab3e4ab. Resources: {'key_pairs'} {{(pid=116103) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 09 20:07:52.800844 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.quota [None req-1a7c8bfd-6a72-4270-baa4-d276aafb7772 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Getting quotas for user 5d2764f4c77b47629d7c33ea15a5b566 and project 04aa1d479bda429cb8cc96145ab3e4ab. Resources: {'key_pairs'} {{(pid=116103) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 09 20:07:52.858825 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-1a7c8bfd-6a72-4270-baa4-d276aafb7772 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 1.349286 Nov 09 20:07:52.868480 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 27/43] 10.222.0.25 () {60 vars in 1157 bytes} [Tue Nov 9 20:07:51 2021] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 1369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:07:52.896986 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-d2b21e45-d19d-4fc9-9901-0a0a1e60a472 tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:07:52.897927 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-d2b21e45-d19d-4fc9-9901-0a0a1e60a472 tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] [instance: bf7875f5-a01d-4ea9-8d7b-cbe90b7a6418] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:07:52.914415 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d2b21e45-d19d-4fc9-9901-0a0a1e60a472 tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:07:52.915190 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d2b21e45-d19d-4fc9-9901-0a0a1e60a472 tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:07:52.916672 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d2b21e45-d19d-4fc9-9901-0a0a1e60a472 tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:07:52.919204 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d2b21e45-d19d-4fc9-9901-0a0a1e60a472 tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:07:53.229800 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.virt.hardware [None req-24973662-7457-4d76-805f-5628dc990a6b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Flavor limits 0:0:0 {{(pid=116102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 09 20:07:53.231090 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.virt.hardware [None req-24973662-7457-4d76-805f-5628dc990a6b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Image limits 0:0:0 {{(pid=116102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 09 20:07:53.231843 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.virt.hardware [None req-24973662-7457-4d76-805f-5628dc990a6b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Flavor pref 0:0:0 {{(pid=116102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 09 20:07:53.232538 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.virt.hardware [None req-24973662-7457-4d76-805f-5628dc990a6b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Image pref 0:0:0 {{(pid=116102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 09 20:07:53.233172 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.virt.hardware [None req-24973662-7457-4d76-805f-5628dc990a6b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 09 20:07:53.260536 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-24973662-7457-4d76-805f-5628dc990a6b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:07:53.264263 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-24973662-7457-4d76-805f-5628dc990a6b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:07:53.267312 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-24973662-7457-4d76-805f-5628dc990a6b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:07:53.278827 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-24973662-7457-4d76-805f-5628dc990a6b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:07:53.364740 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.quota [None req-24973662-7457-4d76-805f-5628dc990a6b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Getting quotas for project be3e835ea4424a88bb80e940a61aff08. Resources: {'cores', 'instances', 'ram'} {{(pid=116102) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 09 20:07:53.377995 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.quota [None req-24973662-7457-4d76-805f-5628dc990a6b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Getting quotas for user b9eba07a4d664c80a55e05a82a791bb6 and project be3e835ea4424a88bb80e940a61aff08. Resources: {'cores', 'instances', 'ram'} {{(pid=116102) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 09 20:07:53.409965 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-24973662-7457-4d76-805f-5628dc990a6b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Going to run 1 instances... {{(pid=116102) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 09 20:07:53.413347 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-24973662-7457-4d76-805f-5628dc990a6b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 10bef0be-b648-4906-b91c-5582ec00cb5c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='109ded43-8c19-4f17-afac-7625dcfef942',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 09 20:07:53.527588 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-24973662-7457-4d76-805f-5628dc990a6b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.790703 Nov 09 20:07:53.529380 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 17/44] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Nov 9 20:07:51 2021] POST /compute/v2.1/servers => generated 383 bytes in 1796 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 09 20:07:53.539745 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-b613b176-6d78-4e3f-9191-89fed28f3ff6 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:07:53.540749 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-b613b176-6d78-4e3f-9191-89fed28f3ff6 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 10bef0be-b648-4906-b91c-5582ec00cb5c] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:07:53.741482 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-b613b176-6d78-4e3f-9191-89fed28f3ff6 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:07:53.749381 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-b613b176-6d78-4e3f-9191-89fed28f3ff6 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/10bef0be-b648-4906-b91c-5582ec00cb5c" status: 200 len: 1221 microversion: 2.1 time: 0.214175 Nov 09 20:07:53.751052 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 18/45] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:07:53 2021] GET /compute/v2.1/servers/10bef0be-b648-4906-b91c-5582ec00cb5c => generated 1221 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 20:07:53.863416 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-d2b21e45-d19d-4fc9-9901-0a0a1e60a472 tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7c1dc758e548a8a9e638f45e9f2e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4112bf1e0544da3a76ae67c69234248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:07:53.875092 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-d2b21e45-d19d-4fc9-9901-0a0a1e60a472 tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] 10.222.0.25 "GET /compute/v2.1/servers/bf7875f5-a01d-4ea9-8d7b-cbe90b7a6418" status: 200 len: 1315 microversion: 2.1 time: 1.014184 Nov 09 20:07:53.879766 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 28/46] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:07:52 2021] GET /compute/v2.1/servers/bf7875f5-a01d-4ea9-8d7b-cbe90b7a6418 => generated 1315 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:07:54.770140 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-5a99792b-2c43-47c3-9bce-a61d2681cf06 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:07:54.771417 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-5a99792b-2c43-47c3-9bce-a61d2681cf06 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 10bef0be-b648-4906-b91c-5582ec00cb5c] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:07:54.790724 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-5a99792b-2c43-47c3-9bce-a61d2681cf06 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:07:54.791472 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-5a99792b-2c43-47c3-9bce-a61d2681cf06 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:07:54.797044 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-5a99792b-2c43-47c3-9bce-a61d2681cf06 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:07:54.797787 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-5a99792b-2c43-47c3-9bce-a61d2681cf06 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:07:54.896694 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-83dfdbaf-4080-49fb-86bb-97a91cbb7863 tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:07:54.898379 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-83dfdbaf-4080-49fb-86bb-97a91cbb7863 tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] [instance: bf7875f5-a01d-4ea9-8d7b-cbe90b7a6418] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:07:54.917103 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-83dfdbaf-4080-49fb-86bb-97a91cbb7863 tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:07:54.919348 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-83dfdbaf-4080-49fb-86bb-97a91cbb7863 tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:07:54.921882 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-83dfdbaf-4080-49fb-86bb-97a91cbb7863 tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:07:54.925560 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-83dfdbaf-4080-49fb-86bb-97a91cbb7863 tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:07:55.460514 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-5a99792b-2c43-47c3-9bce-a61d2681cf06 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:07:55.497001 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-5a99792b-2c43-47c3-9bce-a61d2681cf06 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/10bef0be-b648-4906-b91c-5582ec00cb5c" status: 200 len: 1225 microversion: 2.1 time: 0.729205 Nov 09 20:07:55.500076 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 19/47] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:07:54 2021] GET /compute/v2.1/servers/10bef0be-b648-4906-b91c-5582ec00cb5c => generated 1225 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:07:55.803319 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-83dfdbaf-4080-49fb-86bb-97a91cbb7863 tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7c1dc758e548a8a9e638f45e9f2e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4112bf1e0544da3a76ae67c69234248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:07:55.815291 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-83dfdbaf-4080-49fb-86bb-97a91cbb7863 tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] 10.222.0.25 "GET /compute/v2.1/servers/bf7875f5-a01d-4ea9-8d7b-cbe90b7a6418" status: 200 len: 1315 microversion: 2.1 time: 0.922310 Nov 09 20:07:55.830966 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 29/48] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:07:54 2021] GET /compute/v2.1/servers/bf7875f5-a01d-4ea9-8d7b-cbe90b7a6418 => generated 1315 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 20:07:56.515872 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-68004ac4-e6a9-44aa-a0b6-06fb28ecf09a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:07:56.517233 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-68004ac4-e6a9-44aa-a0b6-06fb28ecf09a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 10bef0be-b648-4906-b91c-5582ec00cb5c] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:07:56.533641 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-68004ac4-e6a9-44aa-a0b6-06fb28ecf09a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:07:56.538586 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-68004ac4-e6a9-44aa-a0b6-06fb28ecf09a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:07:56.548623 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-68004ac4-e6a9-44aa-a0b6-06fb28ecf09a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:07:56.549183 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-68004ac4-e6a9-44aa-a0b6-06fb28ecf09a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:07:56.925763 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [req-46740a21-e91c-4c7a-a881-3f6ec17d004c req-dccd687e-d21b-4418-9178-5ddbe4ced1ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf7875f5-a01d-4ea9-8d7b-cbe90b7a6418", "tag": "ef1d2d21-e309-4954-881c-631a9d9de67c"}]} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:07:56.927900 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 20:07:56.927900 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: warnings.warn(msg) Nov 09 20:07:56.970806 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-46740a21-e91c-4c7a-a881-3f6ec17d004c req-dccd687e-d21b-4418-9178-5ddbe4ced1ee service nova] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:07:56.985776 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-46740a21-e91c-4c7a-a881-3f6ec17d004c req-dccd687e-d21b-4418-9178-5ddbe4ced1ee service nova] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:07:57.043384 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.compute.server_external_events [req-46740a21-e91c-4c7a-a881-3f6ec17d004c req-dccd687e-d21b-4418-9178-5ddbe4ced1ee service nova] Creating event network-changed:ef1d2d21-e309-4954-881c-631a9d9de67c for instance bf7875f5-a01d-4ea9-8d7b-cbe90b7a6418 on hv-cinder-80135 Nov 09 20:07:57.043921 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-46740a21-e91c-4c7a-a881-3f6ec17d004c req-dccd687e-d21b-4418-9178-5ddbe4ced1ee service nova] Acquired lock "compute-rpcapi-router" {{(pid=116103) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Nov 09 20:07:57.045349 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8d4312d3-6527-42b3-a46f-2f7ea8e6d184 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:07:57.045815 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8d4312d3-6527-42b3-a46f-2f7ea8e6d184 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:07:57.046660 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8d4312d3-6527-42b3-a46f-2f7ea8e6d184 None None] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:07:57.046976 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8d4312d3-6527-42b3-a46f-2f7ea8e6d184 None None] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:07:57.087279 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.compute.rpcapi [None req-8d4312d3-6527-42b3-a46f-2f7ea8e6d184 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Nov 09 20:07:57.088180 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8d4312d3-6527-42b3-a46f-2f7ea8e6d184 None None] Releasing lock "compute-rpcapi-router" {{(pid=116103) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 09 20:07:57.177840 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-8d4312d3-6527-42b3-a46f-2f7ea8e6d184 None None] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.355358 Nov 09 20:07:57.179012 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 30/49] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Nov 9 20:07:56 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 20:07:57.183999 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-5e2f6811-efe8-4bd3-9159-22a90f098694 tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:07:57.190493 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-5e2f6811-efe8-4bd3-9159-22a90f098694 tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] [instance: bf7875f5-a01d-4ea9-8d7b-cbe90b7a6418] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:07:57.207551 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5e2f6811-efe8-4bd3-9159-22a90f098694 tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:07:57.208000 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5e2f6811-efe8-4bd3-9159-22a90f098694 tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:07:57.208860 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5e2f6811-efe8-4bd3-9159-22a90f098694 tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:07:57.209289 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5e2f6811-efe8-4bd3-9159-22a90f098694 tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:07:57.299116 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-68004ac4-e6a9-44aa-a0b6-06fb28ecf09a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:07:57.313413 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-68004ac4-e6a9-44aa-a0b6-06fb28ecf09a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/10bef0be-b648-4906-b91c-5582ec00cb5c" status: 200 len: 1279 microversion: 2.1 time: 0.802083 Nov 09 20:07:57.319181 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 20/50] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:07:56 2021] GET /compute/v2.1/servers/10bef0be-b648-4906-b91c-5582ec00cb5c => generated 1279 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:07:58.335240 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-21820269-a22b-417c-a7f0-7395449fba20 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:07:58.335939 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-21820269-a22b-417c-a7f0-7395449fba20 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 10bef0be-b648-4906-b91c-5582ec00cb5c] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:07:58.348713 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-21820269-a22b-417c-a7f0-7395449fba20 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:07:58.352656 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-21820269-a22b-417c-a7f0-7395449fba20 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:07:58.353733 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-21820269-a22b-417c-a7f0-7395449fba20 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:07:58.354472 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-21820269-a22b-417c-a7f0-7395449fba20 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:07:58.871752 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-21820269-a22b-417c-a7f0-7395449fba20 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:07:58.898630 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-21820269-a22b-417c-a7f0-7395449fba20 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/10bef0be-b648-4906-b91c-5582ec00cb5c" status: 200 len: 1279 microversion: 2.1 time: 0.557142 Nov 09 20:07:58.902806 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 21/51] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:07:58 2021] GET /compute/v2.1/servers/10bef0be-b648-4906-b91c-5582ec00cb5c => generated 1279 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:07:58.955764 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-bdc3743b-8c82-4a36-8674-23ddbff6f7a4 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-353172887", "imageRef": "109ded43-8c19-4f17-afac-7625dcfef942", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5e5cb9f1-b28c-498d-9454-93e9dbc54380"}], "security_groups": [{"name": "tempest-securitygroup--1609377048"}], "key_name": "tempest-keypair-1604207818", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:08:00.221831 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-5e2f6811-efe8-4bd3-9159-22a90f098694 tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7c1dc758e548a8a9e638f45e9f2e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4112bf1e0544da3a76ae67c69234248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:08:00.242505 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-5e2f6811-efe8-4bd3-9159-22a90f098694 tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] 10.222.0.25 "GET /compute/v2.1/servers/bf7875f5-a01d-4ea9-8d7b-cbe90b7a6418" status: 200 len: 1315 microversion: 2.1 time: 3.058172 Nov 09 20:08:00.247056 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 31/52] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:07:57 2021] GET /compute/v2.1/servers/bf7875f5-a01d-4ea9-8d7b-cbe90b7a6418 => generated 1315 bytes in 3067 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:08:00.273495 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-fb28a6d8-bd83-428a-a268-14efea0de5fc tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:08:00.278102 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-fb28a6d8-bd83-428a-a268-14efea0de5fc tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 10bef0be-b648-4906-b91c-5582ec00cb5c] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:08:00.305298 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fb28a6d8-bd83-428a-a268-14efea0de5fc tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:00.306001 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fb28a6d8-bd83-428a-a268-14efea0de5fc tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:00.307921 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fb28a6d8-bd83-428a-a268-14efea0de5fc tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:00.309809 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fb28a6d8-bd83-428a-a268-14efea0de5fc tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:00.320595 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.network.neutron [None req-bdc3743b-8c82-4a36-8674-23ddbff6f7a4 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] validate_networks() for [('5e5cb9f1-b28c-498d-9454-93e9dbc54380', None, None, None, None, None)] {{(pid=116102) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 09 20:08:01.036465 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-fb28a6d8-bd83-428a-a268-14efea0de5fc tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:08:01.051191 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-fb28a6d8-bd83-428a-a268-14efea0de5fc tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/10bef0be-b648-4906-b91c-5582ec00cb5c" status: 200 len: 1279 microversion: 2.1 time: 0.802620 Nov 09 20:08:01.051779 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 32/53] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:08:00 2021] GET /compute/v2.1/servers/10bef0be-b648-4906-b91c-5582ec00cb5c => generated 1279 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:08:01.270104 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-d1bd2755-c298-4fcb-a85f-e74090efa7e1 tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:08:01.271679 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-d1bd2755-c298-4fcb-a85f-e74090efa7e1 tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] [instance: bf7875f5-a01d-4ea9-8d7b-cbe90b7a6418] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:08:01.320103 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d1bd2755-c298-4fcb-a85f-e74090efa7e1 tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:01.322230 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d1bd2755-c298-4fcb-a85f-e74090efa7e1 tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:01.358500 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d1bd2755-c298-4fcb-a85f-e74090efa7e1 tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:01.364851 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d1bd2755-c298-4fcb-a85f-e74090efa7e1 tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.029s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:02.601536 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-d1bd2755-c298-4fcb-a85f-e74090efa7e1 tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7c1dc758e548a8a9e638f45e9f2e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4112bf1e0544da3a76ae67c69234248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:08:02.613971 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-d1bd2755-c298-4fcb-a85f-e74090efa7e1 tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] 10.222.0.25 "GET /compute/v2.1/servers/bf7875f5-a01d-4ea9-8d7b-cbe90b7a6418" status: 200 len: 1315 microversion: 2.1 time: 1.351561 Nov 09 20:08:02.614555 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 33/54] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:08:01 2021] GET /compute/v2.1/servers/bf7875f5-a01d-4ea9-8d7b-cbe90b7a6418 => generated 1315 bytes in 1353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:08:02.623973 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-2ce53453-0fe5-487e-941a-c7a19309234a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:08:02.624834 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-2ce53453-0fe5-487e-941a-c7a19309234a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 10bef0be-b648-4906-b91c-5582ec00cb5c] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:08:02.633880 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2ce53453-0fe5-487e-941a-c7a19309234a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:02.645102 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2ce53453-0fe5-487e-941a-c7a19309234a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:02.646188 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2ce53453-0fe5-487e-941a-c7a19309234a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:02.646843 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2ce53453-0fe5-487e-941a-c7a19309234a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:03.565876 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-2ce53453-0fe5-487e-941a-c7a19309234a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:08:03.587013 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-2ce53453-0fe5-487e-941a-c7a19309234a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/10bef0be-b648-4906-b91c-5582ec00cb5c" status: 200 len: 1321 microversion: 2.1 time: 0.971256 Nov 09 20:08:03.591325 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 34/55] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:08:02 2021] GET /compute/v2.1/servers/10bef0be-b648-4906-b91c-5582ec00cb5c => generated 1321 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:08:03.598226 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-5b462918-d511-4ba1-8ef2-5a7c371a985c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1089948523", "imageRef": "109ded43-8c19-4f17-afac-7625dcfef942", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "38a3e273-4c80-49c2-bd2f-f5745f189daa"}], "security_groups": [{"name": "tempest-securitygroup--331853444"}], "key_name": "tempest-keypair-919557392", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:08:03.605589 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.virt.hardware [None req-bdc3743b-8c82-4a36-8674-23ddbff6f7a4 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Flavor limits 0:0:0 {{(pid=116102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 09 20:08:03.606650 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.virt.hardware [None req-bdc3743b-8c82-4a36-8674-23ddbff6f7a4 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Image limits 0:0:0 {{(pid=116102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 09 20:08:03.611244 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.virt.hardware [None req-bdc3743b-8c82-4a36-8674-23ddbff6f7a4 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Flavor pref 0:0:0 {{(pid=116102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 09 20:08:03.611724 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.virt.hardware [None req-bdc3743b-8c82-4a36-8674-23ddbff6f7a4 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Image pref 0:0:0 {{(pid=116102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 09 20:08:03.612154 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.virt.hardware [None req-bdc3743b-8c82-4a36-8674-23ddbff6f7a4 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 09 20:08:03.638526 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-bdc3743b-8c82-4a36-8674-23ddbff6f7a4 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:03.638972 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-bdc3743b-8c82-4a36-8674-23ddbff6f7a4 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:03.639793 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-bdc3743b-8c82-4a36-8674-23ddbff6f7a4 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:03.640227 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-bdc3743b-8c82-4a36-8674-23ddbff6f7a4 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:03.682559 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.quota [None req-bdc3743b-8c82-4a36-8674-23ddbff6f7a4 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Getting quotas for project ee9e1da6a3c14c4a931ece53d568b716. Resources: {'cores', 'instances', 'ram'} {{(pid=116102) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 09 20:08:03.689139 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.quota [None req-bdc3743b-8c82-4a36-8674-23ddbff6f7a4 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Getting quotas for user 9f813425597246e495fca79f1d6a1448 and project ee9e1da6a3c14c4a931ece53d568b716. Resources: {'cores', 'instances', 'ram'} {{(pid=116102) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 09 20:08:03.725292 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-bdc3743b-8c82-4a36-8674-23ddbff6f7a4 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Going to run 1 instances... {{(pid=116102) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 09 20:08:03.727759 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-bdc3743b-8c82-4a36-8674-23ddbff6f7a4 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='109ded43-8c19-4f17-afac-7625dcfef942',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 09 20:08:03.815641 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-bdc3743b-8c82-4a36-8674-23ddbff6f7a4 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 4.863151 Nov 09 20:08:03.817312 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 22/56] 10.222.0.25 () {62 vars in 1187 bytes} [Tue Nov 9 20:07:58 2021] POST /compute/v2.1/servers => generated 402 bytes in 4866 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 09 20:08:03.822948 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-bdf43938-1ed5-4edf-8ae1-4f5d346e3f98 tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:08:03.823642 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-bdf43938-1ed5-4edf-8ae1-4f5d346e3f98 tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] [instance: bf7875f5-a01d-4ea9-8d7b-cbe90b7a6418] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:08:03.831154 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-bdf43938-1ed5-4edf-8ae1-4f5d346e3f98 tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:03.831865 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-bdf43938-1ed5-4edf-8ae1-4f5d346e3f98 tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:03.832871 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-bdf43938-1ed5-4edf-8ae1-4f5d346e3f98 tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:03.833491 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-bdf43938-1ed5-4edf-8ae1-4f5d346e3f98 tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:04.008841 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.network.neutron [None req-5b462918-d511-4ba1-8ef2-5a7c371a985c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] validate_networks() for [('38a3e273-4c80-49c2-bd2f-f5745f189daa', None, None, None, None, None)] {{(pid=116103) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 09 20:08:04.507094 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-bdf43938-1ed5-4edf-8ae1-4f5d346e3f98 tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7c1dc758e548a8a9e638f45e9f2e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4112bf1e0544da3a76ae67c69234248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:08:04.517599 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-bdf43938-1ed5-4edf-8ae1-4f5d346e3f98 tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] 10.222.0.25 "GET /compute/v2.1/servers/bf7875f5-a01d-4ea9-8d7b-cbe90b7a6418" status: 200 len: 1315 microversion: 2.1 time: 0.698140 Nov 09 20:08:04.518259 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 23/57] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:08:03 2021] GET /compute/v2.1/servers/bf7875f5-a01d-4ea9-8d7b-cbe90b7a6418 => generated 1315 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:08:04.532875 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-ac5a5a97-f5eb-4498-8d3d-38286ae8e676 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:08:04.545621 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-ac5a5a97-f5eb-4498-8d3d-38286ae8e676 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:08:04.553366 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ac5a5a97-f5eb-4498-8d3d-38286ae8e676 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:04.554027 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ac5a5a97-f5eb-4498-8d3d-38286ae8e676 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:04.554983 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ac5a5a97-f5eb-4498-8d3d-38286ae8e676 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:04.556853 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ac5a5a97-f5eb-4498-8d3d-38286ae8e676 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:04.712843 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-ac5a5a97-f5eb-4498-8d3d-38286ae8e676 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:08:04.720655 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-ac5a5a97-f5eb-4498-8d3d-38286ae8e676 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:08:04.724636 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-ac5a5a97-f5eb-4498-8d3d-38286ae8e676 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:08:04.732471 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-ac5a5a97-f5eb-4498-8d3d-38286ae8e676 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1285 microversion: 2.20 time: 0.203079 Nov 09 20:08:04.733308 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 24/58] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:08:04 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1285 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:08:04.737615 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-1ab03719-5647-4aa0-9ac6-16dafb561d1b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:08:04.738215 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-1ab03719-5647-4aa0-9ac6-16dafb561d1b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 10bef0be-b648-4906-b91c-5582ec00cb5c] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:08:04.745600 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-1ab03719-5647-4aa0-9ac6-16dafb561d1b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:04.746286 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-1ab03719-5647-4aa0-9ac6-16dafb561d1b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:04.747283 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-1ab03719-5647-4aa0-9ac6-16dafb561d1b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:04.747854 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-1ab03719-5647-4aa0-9ac6-16dafb561d1b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:05.668181 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-1ab03719-5647-4aa0-9ac6-16dafb561d1b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:08:05.684335 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-1ab03719-5647-4aa0-9ac6-16dafb561d1b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/10bef0be-b648-4906-b91c-5582ec00cb5c" status: 200 len: 1321 microversion: 2.1 time: 0.948823 Nov 09 20:08:05.686477 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 25/59] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:08:04 2021] GET /compute/v2.1/servers/10bef0be-b648-4906-b91c-5582ec00cb5c => generated 1321 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:08:06.042701 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [req-b1c583c4-0fc7-4590-9da1-5de3f8e4d873 req-9868e91a-9d5f-4746-9994-b3a356aa7846 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80ce5722-8f51-457b-9f9b-ff4b63b103df", "tag": "bbfda69a-3f26-4b91-a131-9256661c754a"}]} {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:08:06.045778 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 20:08:06.045778 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: warnings.warn(msg) Nov 09 20:08:06.075028 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [req-b1c583c4-0fc7-4590-9da1-5de3f8e4d873 req-9868e91a-9d5f-4746-9994-b3a356aa7846 service nova] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:06.076863 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [req-b1c583c4-0fc7-4590-9da1-5de3f8e4d873 req-9868e91a-9d5f-4746-9994-b3a356aa7846 service nova] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:06.132064 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.compute.server_external_events [req-b1c583c4-0fc7-4590-9da1-5de3f8e4d873 req-9868e91a-9d5f-4746-9994-b3a356aa7846 service nova] Creating event network-changed:bbfda69a-3f26-4b91-a131-9256661c754a for instance 80ce5722-8f51-457b-9f9b-ff4b63b103df on hv-cinder-80135 Nov 09 20:08:06.132902 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [req-b1c583c4-0fc7-4590-9da1-5de3f8e4d873 req-9868e91a-9d5f-4746-9994-b3a356aa7846 service nova] Acquired lock "compute-rpcapi-router" {{(pid=116102) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Nov 09 20:08:06.134452 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-2bd22272-1271-4bf0-9c81-adab4bb294f3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:06.135368 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-2bd22272-1271-4bf0-9c81-adab4bb294f3 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:06.136710 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-2bd22272-1271-4bf0-9c81-adab4bb294f3 None None] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:06.137826 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-2bd22272-1271-4bf0-9c81-adab4bb294f3 None None] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:06.151990 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.compute.rpcapi [None req-2bd22272-1271-4bf0-9c81-adab4bb294f3 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Nov 09 20:08:06.154093 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-2bd22272-1271-4bf0-9c81-adab4bb294f3 None None] Releasing lock "compute-rpcapi-router" {{(pid=116102) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 09 20:08:06.191551 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-2bd22272-1271-4bf0-9c81-adab4bb294f3 None None] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.503201 Nov 09 20:08:06.192589 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 26/60] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Nov 9 20:08:05 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:08:06.199795 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-7d7cc7b1-b10e-413b-82eb-0e3bf276d0eb tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:08:06.201775 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-7d7cc7b1-b10e-413b-82eb-0e3bf276d0eb tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] [instance: bf7875f5-a01d-4ea9-8d7b-cbe90b7a6418] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:08:06.214081 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-7d7cc7b1-b10e-413b-82eb-0e3bf276d0eb tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:06.214636 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-7d7cc7b1-b10e-413b-82eb-0e3bf276d0eb tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:06.215721 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-7d7cc7b1-b10e-413b-82eb-0e3bf276d0eb tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:06.216164 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-7d7cc7b1-b10e-413b-82eb-0e3bf276d0eb tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:06.906148 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-7d7cc7b1-b10e-413b-82eb-0e3bf276d0eb tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7c1dc758e548a8a9e638f45e9f2e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4112bf1e0544da3a76ae67c69234248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:08:06.913880 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-7d7cc7b1-b10e-413b-82eb-0e3bf276d0eb tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] 10.222.0.25 "GET /compute/v2.1/servers/bf7875f5-a01d-4ea9-8d7b-cbe90b7a6418" status: 200 len: 1315 microversion: 2.1 time: 0.719355 Nov 09 20:08:06.925522 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 27/61] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:08:06 2021] GET /compute/v2.1/servers/bf7875f5-a01d-4ea9-8d7b-cbe90b7a6418 => generated 1315 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:08:06.930382 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-cda7e9ef-95b0-4a17-a0bd-99488f69b3fd tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:08:06.931124 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-cda7e9ef-95b0-4a17-a0bd-99488f69b3fd tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:08:06.948631 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-cda7e9ef-95b0-4a17-a0bd-99488f69b3fd tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:06.949255 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-cda7e9ef-95b0-4a17-a0bd-99488f69b3fd tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:06.950194 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-cda7e9ef-95b0-4a17-a0bd-99488f69b3fd tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:06.950769 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-cda7e9ef-95b0-4a17-a0bd-99488f69b3fd tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:07.162074 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.virt.hardware [None req-5b462918-d511-4ba1-8ef2-5a7c371a985c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Flavor limits 0:0:0 {{(pid=116103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 09 20:08:07.164281 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.virt.hardware [None req-5b462918-d511-4ba1-8ef2-5a7c371a985c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Image limits 0:0:0 {{(pid=116103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 09 20:08:07.164955 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.virt.hardware [None req-5b462918-d511-4ba1-8ef2-5a7c371a985c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Flavor pref 0:0:0 {{(pid=116103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 09 20:08:07.166886 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.virt.hardware [None req-5b462918-d511-4ba1-8ef2-5a7c371a985c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Image pref 0:0:0 {{(pid=116103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 09 20:08:07.167321 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.virt.hardware [None req-5b462918-d511-4ba1-8ef2-5a7c371a985c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 09 20:08:07.195222 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5b462918-d511-4ba1-8ef2-5a7c371a985c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:07.195674 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5b462918-d511-4ba1-8ef2-5a7c371a985c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:07.196508 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5b462918-d511-4ba1-8ef2-5a7c371a985c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:07.199509 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5b462918-d511-4ba1-8ef2-5a7c371a985c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:07.296318 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.quota [None req-5b462918-d511-4ba1-8ef2-5a7c371a985c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Getting quotas for project 04aa1d479bda429cb8cc96145ab3e4ab. Resources: {'cores', 'instances', 'ram'} {{(pid=116103) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 09 20:08:07.306817 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.quota [None req-5b462918-d511-4ba1-8ef2-5a7c371a985c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Getting quotas for user 5d2764f4c77b47629d7c33ea15a5b566 and project 04aa1d479bda429cb8cc96145ab3e4ab. Resources: {'cores', 'instances', 'ram'} {{(pid=116103) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 09 20:08:07.336006 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-5b462918-d511-4ba1-8ef2-5a7c371a985c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Going to run 1 instances... {{(pid=116103) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 09 20:08:07.346567 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-5b462918-d511-4ba1-8ef2-5a7c371a985c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='109ded43-8c19-4f17-afac-7625dcfef942',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116103) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 09 20:08:07.503482 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-5b462918-d511-4ba1-8ef2-5a7c371a985c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.905472 Nov 09 20:08:07.507813 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 35/62] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Nov 9 20:08:03 2021] POST /compute/v2.1/servers => generated 401 bytes in 3914 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 09 20:08:07.529178 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-3293c269-4725-4e3f-be7d-99506d0abc2c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:08:07.529816 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-3293c269-4725-4e3f-be7d-99506d0abc2c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 10bef0be-b648-4906-b91c-5582ec00cb5c] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:08:07.555735 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3293c269-4725-4e3f-be7d-99506d0abc2c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:07.557822 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3293c269-4725-4e3f-be7d-99506d0abc2c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:07.558462 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3293c269-4725-4e3f-be7d-99506d0abc2c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:07.560787 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3293c269-4725-4e3f-be7d-99506d0abc2c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:07.862346 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-cda7e9ef-95b0-4a17-a0bd-99488f69b3fd tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:08:07.900927 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-cda7e9ef-95b0-4a17-a0bd-99488f69b3fd tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:08:07.913725 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-cda7e9ef-95b0-4a17-a0bd-99488f69b3fd tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:08:07.918074 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-cda7e9ef-95b0-4a17-a0bd-99488f69b3fd tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1407 microversion: 2.20 time: 0.991224 Nov 09 20:08:07.920730 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 28/63] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:08:06 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1407 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:08:07.930597 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-2435a348-bb33-482d-811b-39745f5cc53a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:08:07.931199 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-2435a348-bb33-482d-811b-39745f5cc53a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:08:08.175878 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-2435a348-bb33-482d-811b-39745f5cc53a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:08:08.192010 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-2435a348-bb33-482d-811b-39745f5cc53a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1237 microversion: 2.1 time: 0.263989 Nov 09 20:08:08.193837 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 29/64] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:08:07 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1237 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:08:08.426268 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-3293c269-4725-4e3f-be7d-99506d0abc2c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:08:08.436709 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-3293c269-4725-4e3f-be7d-99506d0abc2c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/10bef0be-b648-4906-b91c-5582ec00cb5c" status: 200 len: 1321 microversion: 2.1 time: 0.925538 Nov 09 20:08:08.448949 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 36/65] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:08:07 2021] GET /compute/v2.1/servers/10bef0be-b648-4906-b91c-5582ec00cb5c => generated 1321 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:08:08.463258 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [req-ed3f41a3-cabc-4c4a-9131-b258c0288d4a req-eb96f9b2-e6dc-4aaf-87ca-2c3f5c92b07f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae338c69-d22d-41c2-89b0-b0cec236521e", "tag": "8caa7fa5-9183-46fa-9387-e9fbebafe302"}]} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:08:08.467467 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 20:08:08.467467 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: warnings.warn(msg) Nov 09 20:08:08.482679 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-ed3f41a3-cabc-4c4a-9131-b258c0288d4a req-eb96f9b2-e6dc-4aaf-87ca-2c3f5c92b07f service nova] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:08.483385 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-ed3f41a3-cabc-4c4a-9131-b258c0288d4a req-eb96f9b2-e6dc-4aaf-87ca-2c3f5c92b07f service nova] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:08.497781 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.compute.server_external_events [req-ed3f41a3-cabc-4c4a-9131-b258c0288d4a req-eb96f9b2-e6dc-4aaf-87ca-2c3f5c92b07f service nova] Creating event network-changed:8caa7fa5-9183-46fa-9387-e9fbebafe302 for instance ae338c69-d22d-41c2-89b0-b0cec236521e on hv-cinder-80135 Nov 09 20:08:08.504724 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [req-ed3f41a3-cabc-4c4a-9131-b258c0288d4a req-eb96f9b2-e6dc-4aaf-87ca-2c3f5c92b07f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054379 Nov 09 20:08:08.505656 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 37/66] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Nov 9 20:08:08 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:08:08.512953 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-71616779-39b2-40d3-9be7-8e8faca3645d tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:08:08.513960 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-71616779-39b2-40d3-9be7-8e8faca3645d tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] [instance: bf7875f5-a01d-4ea9-8d7b-cbe90b7a6418] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:08:08.522963 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-71616779-39b2-40d3-9be7-8e8faca3645d tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:08.524132 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-71616779-39b2-40d3-9be7-8e8faca3645d tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:08.525503 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-71616779-39b2-40d3-9be7-8e8faca3645d tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:08.526179 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-71616779-39b2-40d3-9be7-8e8faca3645d tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:08.685728 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [req-93fdec3c-905d-494f-8d82-e4bab200924e req-b17a13b2-8246-4879-ab72-9e5f993c4f4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf7875f5-a01d-4ea9-8d7b-cbe90b7a6418", "name": "network-vif-plugged", "status": "completed", "tag": "ef1d2d21-e309-4954-881c-631a9d9de67c"}]} {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:08:08.688647 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 20:08:08.688647 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: warnings.warn(msg) Nov 09 20:08:08.705233 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [req-93fdec3c-905d-494f-8d82-e4bab200924e req-b17a13b2-8246-4879-ab72-9e5f993c4f4e service nova] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:08.705598 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [req-93fdec3c-905d-494f-8d82-e4bab200924e req-b17a13b2-8246-4879-ab72-9e5f993c4f4e service nova] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:08.727505 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.compute.server_external_events [req-93fdec3c-905d-494f-8d82-e4bab200924e req-b17a13b2-8246-4879-ab72-9e5f993c4f4e service nova] Creating event network-vif-plugged:ef1d2d21-e309-4954-881c-631a9d9de67c for instance bf7875f5-a01d-4ea9-8d7b-cbe90b7a6418 on hv-cinder-80135 Nov 09 20:08:08.739178 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [req-93fdec3c-905d-494f-8d82-e4bab200924e req-b17a13b2-8246-4879-ab72-9e5f993c4f4e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.540586 Nov 09 20:08:08.746620 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 30/67] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Nov 9 20:08:08 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:08:08.754194 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [req-9b690ce7-17d6-4655-9598-0615de45df6c req-b6b79bc2-2939-458d-ac96-c3b4202557e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10bef0be-b648-4906-b91c-5582ec00cb5c", "tag": "341cb797-77c6-4bd0-a210-da8c6d2f6c39"}]} {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:08:08.768115 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 20:08:08.768115 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: warnings.warn(msg) Nov 09 20:08:08.779991 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [req-9b690ce7-17d6-4655-9598-0615de45df6c req-b6b79bc2-2939-458d-ac96-c3b4202557e6 service nova] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:08.780699 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [req-9b690ce7-17d6-4655-9598-0615de45df6c req-b6b79bc2-2939-458d-ac96-c3b4202557e6 service nova] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:08.817039 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.compute.server_external_events [req-9b690ce7-17d6-4655-9598-0615de45df6c req-b6b79bc2-2939-458d-ac96-c3b4202557e6 service nova] Creating event network-changed:341cb797-77c6-4bd0-a210-da8c6d2f6c39 for instance 10bef0be-b648-4906-b91c-5582ec00cb5c on hv-cinder-80135 Nov 09 20:08:08.851411 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [req-9b690ce7-17d6-4655-9598-0615de45df6c req-b6b79bc2-2939-458d-ac96-c3b4202557e6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102010 Nov 09 20:08:08.852479 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 31/68] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Nov 9 20:08:08 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:08:08.941119 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-f8c69508-6b78-41af-8da4-d3d643ceac1d tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:08:08.941973 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-f8c69508-6b78-41af-8da4-d3d643ceac1d tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:08:08.955695 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f8c69508-6b78-41af-8da4-d3d643ceac1d tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:08.956290 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f8c69508-6b78-41af-8da4-d3d643ceac1d tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:08.960900 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f8c69508-6b78-41af-8da4-d3d643ceac1d tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:08.961882 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f8c69508-6b78-41af-8da4-d3d643ceac1d tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:08.974156 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-71616779-39b2-40d3-9be7-8e8faca3645d tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7c1dc758e548a8a9e638f45e9f2e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4112bf1e0544da3a76ae67c69234248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:08:08.989555 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-71616779-39b2-40d3-9be7-8e8faca3645d tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] 10.222.0.25 "GET /compute/v2.1/servers/bf7875f5-a01d-4ea9-8d7b-cbe90b7a6418" status: 200 len: 1315 microversion: 2.1 time: 0.481805 Nov 09 20:08:08.990154 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 38/69] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:08:08 2021] GET /compute/v2.1/servers/bf7875f5-a01d-4ea9-8d7b-cbe90b7a6418 => generated 1315 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:08:09.212669 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-db0af52b-0584-4218-9820-ecc74d3a0e92 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:08:09.213652 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-db0af52b-0584-4218-9820-ecc74d3a0e92 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:08:09.236722 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-db0af52b-0584-4218-9820-ecc74d3a0e92 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:09.237710 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-db0af52b-0584-4218-9820-ecc74d3a0e92 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:09.241323 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-db0af52b-0584-4218-9820-ecc74d3a0e92 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:09.243728 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-db0af52b-0584-4218-9820-ecc74d3a0e92 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:09.564732 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-db0af52b-0584-4218-9820-ecc74d3a0e92 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:08:09.575756 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-db0af52b-0584-4218-9820-ecc74d3a0e92 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1297 microversion: 2.1 time: 0.368582 Nov 09 20:08:09.591226 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 39/70] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:08:09 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1297 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 20:08:09.603846 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-c6c44e0e-dbd1-4a58-aa15-dc053dca0d7b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:08:09.608335 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-c6c44e0e-dbd1-4a58-aa15-dc053dca0d7b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 10bef0be-b648-4906-b91c-5582ec00cb5c] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:08:09.622867 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c6c44e0e-dbd1-4a58-aa15-dc053dca0d7b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:09.626567 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c6c44e0e-dbd1-4a58-aa15-dc053dca0d7b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:09.629549 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c6c44e0e-dbd1-4a58-aa15-dc053dca0d7b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:09.630273 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c6c44e0e-dbd1-4a58-aa15-dc053dca0d7b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:09.908414 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-f8c69508-6b78-41af-8da4-d3d643ceac1d tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:08:09.921349 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-f8c69508-6b78-41af-8da4-d3d643ceac1d tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:08:09.923177 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-f8c69508-6b78-41af-8da4-d3d643ceac1d tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:08:09.924528 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-f8c69508-6b78-41af-8da4-d3d643ceac1d tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1407 microversion: 2.20 time: 0.987392 Nov 09 20:08:09.940788 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 32/71] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:08:08 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1407 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 09 20:08:10.008218 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-375df808-539b-489e-9f78-ad56887b17ab tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:08:10.009058 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-375df808-539b-489e-9f78-ad56887b17ab tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] [instance: bf7875f5-a01d-4ea9-8d7b-cbe90b7a6418] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:08:10.016683 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-375df808-539b-489e-9f78-ad56887b17ab tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:10.018614 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-375df808-539b-489e-9f78-ad56887b17ab tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:10.020538 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-375df808-539b-489e-9f78-ad56887b17ab tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:10.023624 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-375df808-539b-489e-9f78-ad56887b17ab tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:10.039777 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-c6c44e0e-dbd1-4a58-aa15-dc053dca0d7b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:08:10.050056 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-c6c44e0e-dbd1-4a58-aa15-dc053dca0d7b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/10bef0be-b648-4906-b91c-5582ec00cb5c" status: 200 len: 1321 microversion: 2.1 time: 0.456931 Nov 09 20:08:10.052440 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 40/72] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:08:09 2021] GET /compute/v2.1/servers/10bef0be-b648-4906-b91c-5582ec00cb5c => generated 1321 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:08:10.406684 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-375df808-539b-489e-9f78-ad56887b17ab tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7c1dc758e548a8a9e638f45e9f2e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4112bf1e0544da3a76ae67c69234248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:08:10.419788 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-375df808-539b-489e-9f78-ad56887b17ab tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] 10.222.0.25 "GET /compute/v2.1/servers/bf7875f5-a01d-4ea9-8d7b-cbe90b7a6418" status: 200 len: 1315 microversion: 2.1 time: 0.416522 Nov 09 20:08:10.421069 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 33/73] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:08:10 2021] GET /compute/v2.1/servers/bf7875f5-a01d-4ea9-8d7b-cbe90b7a6418 => generated 1315 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 20:08:10.596095 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-aaa336b5-1fbe-4686-a0ec-3b88d23b770f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:08:10.597417 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-aaa336b5-1fbe-4686-a0ec-3b88d23b770f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:08:10.605304 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-aaa336b5-1fbe-4686-a0ec-3b88d23b770f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:10.606044 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-aaa336b5-1fbe-4686-a0ec-3b88d23b770f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:10.606986 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-aaa336b5-1fbe-4686-a0ec-3b88d23b770f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:10.607558 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-aaa336b5-1fbe-4686-a0ec-3b88d23b770f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:10.721306 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-aaa336b5-1fbe-4686-a0ec-3b88d23b770f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:08:10.731730 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-aaa336b5-1fbe-4686-a0ec-3b88d23b770f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1295 microversion: 2.1 time: 0.140337 Nov 09 20:08:10.744168 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 41/74] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:08:10 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1295 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:08:10.949375 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-1dcf3ede-c8af-45e9-956e-c5fe60ba6a34 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:08:10.950622 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-1dcf3ede-c8af-45e9-956e-c5fe60ba6a34 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:08:10.986607 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-1dcf3ede-c8af-45e9-956e-c5fe60ba6a34 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:10.991163 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-1dcf3ede-c8af-45e9-956e-c5fe60ba6a34 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:10.995007 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-1dcf3ede-c8af-45e9-956e-c5fe60ba6a34 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:11.000170 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-1dcf3ede-c8af-45e9-956e-c5fe60ba6a34 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:11.071995 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-e0540245-79ec-484e-8d87-8b040c35d0a0 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:08:11.072883 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-e0540245-79ec-484e-8d87-8b040c35d0a0 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 10bef0be-b648-4906-b91c-5582ec00cb5c] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:08:11.087435 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e0540245-79ec-484e-8d87-8b040c35d0a0 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:11.088888 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e0540245-79ec-484e-8d87-8b040c35d0a0 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:11.090406 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e0540245-79ec-484e-8d87-8b040c35d0a0 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:11.091278 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e0540245-79ec-484e-8d87-8b040c35d0a0 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:11.596244 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-1dcf3ede-c8af-45e9-956e-c5fe60ba6a34 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:08:11.610003 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-1dcf3ede-c8af-45e9-956e-c5fe60ba6a34 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:08:11.618900 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-1dcf3ede-c8af-45e9-956e-c5fe60ba6a34 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:08:11.620354 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-1dcf3ede-c8af-45e9-956e-c5fe60ba6a34 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1407 microversion: 2.20 time: 0.676881 Nov 09 20:08:11.622689 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 34/75] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:08:10 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1407 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:08:11.627768 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-e0540245-79ec-484e-8d87-8b040c35d0a0 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:08:11.635510 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-e0540245-79ec-484e-8d87-8b040c35d0a0 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/10bef0be-b648-4906-b91c-5582ec00cb5c" status: 200 len: 1321 microversion: 2.1 time: 0.570193 Nov 09 20:08:11.636088 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 42/76] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:08:11 2021] GET /compute/v2.1/servers/10bef0be-b648-4906-b91c-5582ec00cb5c => generated 1321 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:08:11.636235 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-43cb026d-3def-4bca-bf06-b98e98cf37df tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:08:11.638148 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-43cb026d-3def-4bca-bf06-b98e98cf37df tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] [instance: bf7875f5-a01d-4ea9-8d7b-cbe90b7a6418] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:08:11.656814 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-43cb026d-3def-4bca-bf06-b98e98cf37df tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:11.657579 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-43cb026d-3def-4bca-bf06-b98e98cf37df tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:11.658862 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-43cb026d-3def-4bca-bf06-b98e98cf37df tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:11.663242 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-43cb026d-3def-4bca-bf06-b98e98cf37df tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:11.751873 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-307dba55-bcaf-4dbc-95ca-0c6642072ca3 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:08:11.754163 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-307dba55-bcaf-4dbc-95ca-0c6642072ca3 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:08:11.776178 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-307dba55-bcaf-4dbc-95ca-0c6642072ca3 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:11.776716 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-307dba55-bcaf-4dbc-95ca-0c6642072ca3 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:11.777512 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-307dba55-bcaf-4dbc-95ca-0c6642072ca3 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:11.779990 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-307dba55-bcaf-4dbc-95ca-0c6642072ca3 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:11.975023 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-43cb026d-3def-4bca-bf06-b98e98cf37df tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7c1dc758e548a8a9e638f45e9f2e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4112bf1e0544da3a76ae67c69234248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:08:11.983249 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-43cb026d-3def-4bca-bf06-b98e98cf37df tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] 10.222.0.25 "GET /compute/v2.1/servers/bf7875f5-a01d-4ea9-8d7b-cbe90b7a6418" status: 200 len: 1315 microversion: 2.1 time: 0.359504 Nov 09 20:08:11.991370 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 35/77] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:08:11 2021] GET /compute/v2.1/servers/bf7875f5-a01d-4ea9-8d7b-cbe90b7a6418 => generated 1315 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:08:12.064042 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-307dba55-bcaf-4dbc-95ca-0c6642072ca3 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:08:12.073439 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-307dba55-bcaf-4dbc-95ca-0c6642072ca3 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1362 microversion: 2.1 time: 0.326103 Nov 09 20:08:12.076442 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 43/78] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:08:11 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1362 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:08:12.144692 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [req-5305b5b3-8174-46d4-9d7f-347d7c8278a1 req-41755149-39b9-48a6-a310-df7101cf26ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80ce5722-8f51-457b-9f9b-ff4b63b103df", "name": "network-vif-plugged", "status": "completed", "tag": "bbfda69a-3f26-4b91-a131-9256661c754a"}]} {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:08:12.146826 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 20:08:12.146826 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: warnings.warn(msg) Nov 09 20:08:12.163134 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [req-5305b5b3-8174-46d4-9d7f-347d7c8278a1 req-41755149-39b9-48a6-a310-df7101cf26ee service nova] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:12.163678 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [req-5305b5b3-8174-46d4-9d7f-347d7c8278a1 req-41755149-39b9-48a6-a310-df7101cf26ee service nova] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:12.207776 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.compute.server_external_events [req-5305b5b3-8174-46d4-9d7f-347d7c8278a1 req-41755149-39b9-48a6-a310-df7101cf26ee service nova] Creating event network-vif-plugged:bbfda69a-3f26-4b91-a131-9256661c754a for instance 80ce5722-8f51-457b-9f9b-ff4b63b103df on hv-cinder-80135 Nov 09 20:08:12.226706 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [req-5305b5b3-8174-46d4-9d7f-347d7c8278a1 req-41755149-39b9-48a6-a310-df7101cf26ee service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088715 Nov 09 20:08:12.227908 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 36/79] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Nov 9 20:08:12 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:08:12.639163 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-b93de60b-e9f6-471b-88a9-167ac4f68928 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:08:12.640043 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-b93de60b-e9f6-471b-88a9-167ac4f68928 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:08:12.654225 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-d7ab3905-7804-4eef-bc48-995f34063839 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:08:12.654997 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-d7ab3905-7804-4eef-bc48-995f34063839 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 10bef0be-b648-4906-b91c-5582ec00cb5c] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:08:12.659346 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b93de60b-e9f6-471b-88a9-167ac4f68928 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:12.663201 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b93de60b-e9f6-471b-88a9-167ac4f68928 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:12.665289 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b93de60b-e9f6-471b-88a9-167ac4f68928 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:12.666607 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d7ab3905-7804-4eef-bc48-995f34063839 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:12.670248 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b93de60b-e9f6-471b-88a9-167ac4f68928 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:12.672054 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d7ab3905-7804-4eef-bc48-995f34063839 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:12.678927 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d7ab3905-7804-4eef-bc48-995f34063839 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:12.680860 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d7ab3905-7804-4eef-bc48-995f34063839 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:13.153134 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-d7ab3905-7804-4eef-bc48-995f34063839 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:08:13.162405 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-d7ab3905-7804-4eef-bc48-995f34063839 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/10bef0be-b648-4906-b91c-5582ec00cb5c" status: 200 len: 1321 microversion: 2.1 time: 0.513309 Nov 09 20:08:13.170690 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-b93de60b-e9f6-471b-88a9-167ac4f68928 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:08:13.181208 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 37/80] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:08:12 2021] GET /compute/v2.1/servers/10bef0be-b648-4906-b91c-5582ec00cb5c => generated 1321 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:08:13.182894 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-b93de60b-e9f6-471b-88a9-167ac4f68928 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:08:13.185824 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-b93de60b-e9f6-471b-88a9-167ac4f68928 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:08:13.187155 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-b93de60b-e9f6-471b-88a9-167ac4f68928 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1407 microversion: 2.20 time: 0.551908 Nov 09 20:08:13.188287 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [req-701fa538-f91d-4cdb-8472-22de53fbdb5a req-03b32cd8-7d2b-4b69-a958-a2a8cec984d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "632b79c1-d378-423c-8404-3204223226a6", "tag": "bf82cdc8-5318-4cd6-9fbe-fda62638d826"}]} {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:08:13.200634 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 44/81] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:08:12 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1407 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:08:13.213651 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-f9e09af6-56ad-4c44-8644-29cd3ff16ec4 tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:08:13.213841 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 20:08:13.213841 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: warnings.warn(msg) Nov 09 20:08:13.215933 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-f9e09af6-56ad-4c44-8644-29cd3ff16ec4 tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] [instance: bf7875f5-a01d-4ea9-8d7b-cbe90b7a6418] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:08:13.228121 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f9e09af6-56ad-4c44-8644-29cd3ff16ec4 tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:13.229609 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f9e09af6-56ad-4c44-8644-29cd3ff16ec4 tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:13.230665 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [req-701fa538-f91d-4cdb-8472-22de53fbdb5a req-03b32cd8-7d2b-4b69-a958-a2a8cec984d0 service nova] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:13.231208 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [req-701fa538-f91d-4cdb-8472-22de53fbdb5a req-03b32cd8-7d2b-4b69-a958-a2a8cec984d0 service nova] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:13.232107 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f9e09af6-56ad-4c44-8644-29cd3ff16ec4 tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:13.236967 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f9e09af6-56ad-4c44-8644-29cd3ff16ec4 tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:13.268063 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.compute.server_external_events [req-701fa538-f91d-4cdb-8472-22de53fbdb5a req-03b32cd8-7d2b-4b69-a958-a2a8cec984d0 service nova] Creating event network-changed:bf82cdc8-5318-4cd6-9fbe-fda62638d826 for instance 632b79c1-d378-423c-8404-3204223226a6 on hv-cinder-80135 Nov 09 20:08:13.284307 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [req-701fa538-f91d-4cdb-8472-22de53fbdb5a req-03b32cd8-7d2b-4b69-a958-a2a8cec984d0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101839 Nov 09 20:08:13.288601 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 38/82] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Nov 9 20:08:13 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:08:13.302754 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-c13ac6b2-0a84-4a71-ac01-3d48ba762c63 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:08:13.305058 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-c13ac6b2-0a84-4a71-ac01-3d48ba762c63 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:08:13.321669 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c13ac6b2-0a84-4a71-ac01-3d48ba762c63 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:13.322526 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c13ac6b2-0a84-4a71-ac01-3d48ba762c63 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:13.325997 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c13ac6b2-0a84-4a71-ac01-3d48ba762c63 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:13.330467 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c13ac6b2-0a84-4a71-ac01-3d48ba762c63 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:13.418850 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-f9e09af6-56ad-4c44-8644-29cd3ff16ec4 tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7c1dc758e548a8a9e638f45e9f2e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4112bf1e0544da3a76ae67c69234248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:08:13.426613 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-f9e09af6-56ad-4c44-8644-29cd3ff16ec4 tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] 10.222.0.25 "GET /compute/v2.1/servers/bf7875f5-a01d-4ea9-8d7b-cbe90b7a6418" status: 200 len: 1502 microversion: 2.1 time: 0.224722 Nov 09 20:08:13.429140 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 45/83] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:08:13 2021] GET /compute/v2.1/servers/bf7875f5-a01d-4ea9-8d7b-cbe90b7a6418 => generated 1502 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:08:13.516791 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-c13ac6b2-0a84-4a71-ac01-3d48ba762c63 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:08:13.525523 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-c13ac6b2-0a84-4a71-ac01-3d48ba762c63 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1362 microversion: 2.1 time: 0.234882 Nov 09 20:08:13.527442 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 39/84] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:08:13 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1362 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:08:14.197613 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-3dc40f59-76cc-41a6-be18-b800de43c6bb tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:08:14.199127 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-3dc40f59-76cc-41a6-be18-b800de43c6bb tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 10bef0be-b648-4906-b91c-5582ec00cb5c] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:08:14.210016 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-6d0dfc13-a2d1-4297-bae7-e563a6fffc71 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:08:14.212635 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-6d0dfc13-a2d1-4297-bae7-e563a6fffc71 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:08:14.226476 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3dc40f59-76cc-41a6-be18-b800de43c6bb tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:14.226875 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6d0dfc13-a2d1-4297-bae7-e563a6fffc71 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:14.227406 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3dc40f59-76cc-41a6-be18-b800de43c6bb tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:14.227998 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6d0dfc13-a2d1-4297-bae7-e563a6fffc71 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:14.229152 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6d0dfc13-a2d1-4297-bae7-e563a6fffc71 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:14.229907 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3dc40f59-76cc-41a6-be18-b800de43c6bb tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:14.230437 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3dc40f59-76cc-41a6-be18-b800de43c6bb tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:14.231024 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6d0dfc13-a2d1-4297-bae7-e563a6fffc71 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:14.598403 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-3dc40f59-76cc-41a6-be18-b800de43c6bb tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:08:14.611646 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-3dc40f59-76cc-41a6-be18-b800de43c6bb tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/10bef0be-b648-4906-b91c-5582ec00cb5c" status: 200 len: 1321 microversion: 2.1 time: 0.415030 Nov 09 20:08:14.612673 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 46/85] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:08:14 2021] GET /compute/v2.1/servers/10bef0be-b648-4906-b91c-5582ec00cb5c => generated 1321 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:08:14.622624 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-87b3306e-f881-46a5-b431-32368a1d6625 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:08:14.623440 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-87b3306e-f881-46a5-b431-32368a1d6625 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:08:14.638991 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-87b3306e-f881-46a5-b431-32368a1d6625 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:14.639429 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-87b3306e-f881-46a5-b431-32368a1d6625 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:14.643606 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-87b3306e-f881-46a5-b431-32368a1d6625 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:14.644281 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-87b3306e-f881-46a5-b431-32368a1d6625 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:14.682429 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-6d0dfc13-a2d1-4297-bae7-e563a6fffc71 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:08:14.700856 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-6d0dfc13-a2d1-4297-bae7-e563a6fffc71 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:08:14.705462 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-6d0dfc13-a2d1-4297-bae7-e563a6fffc71 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:08:14.706542 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-6d0dfc13-a2d1-4297-bae7-e563a6fffc71 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1407 microversion: 2.20 time: 0.503287 Nov 09 20:08:14.707164 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 40/86] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:08:14 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1407 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:08:14.824066 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-87b3306e-f881-46a5-b431-32368a1d6625 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:08:14.831942 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-87b3306e-f881-46a5-b431-32368a1d6625 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1362 microversion: 2.1 time: 0.217978 Nov 09 20:08:14.835170 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 47/87] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:08:14 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1362 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:08:15.003170 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-88de0e9b-5d94-4ffb-8a06-1ed48b6c4a1f tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "25a78a80-225e-4d88-963c-84d34b9c944e"}} {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:08:15.004772 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-88de0e9b-5d94-4ffb-8a06-1ed48b6c4a1f tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] [instance: bf7875f5-a01d-4ea9-8d7b-cbe90b7a6418] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:08:15.013592 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-88de0e9b-5d94-4ffb-8a06-1ed48b6c4a1f tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:15.014217 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-88de0e9b-5d94-4ffb-8a06-1ed48b6c4a1f tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:15.015588 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-88de0e9b-5d94-4ffb-8a06-1ed48b6c4a1f tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:15.016160 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-88de0e9b-5d94-4ffb-8a06-1ed48b6c4a1f tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:15.358997 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [req-5d402e9b-e5c5-4fde-80fb-2aaa56334010 req-bf4255f0-834a-4104-9b2d-c8d1e9161b01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10bef0be-b648-4906-b91c-5582ec00cb5c", "name": "network-vif-plugged", "status": "completed", "tag": "341cb797-77c6-4bd0-a210-da8c6d2f6c39"}]} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:08:15.360535 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 20:08:15.360535 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: warnings.warn(msg) Nov 09 20:08:15.387992 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-5d402e9b-e5c5-4fde-80fb-2aaa56334010 req-bf4255f0-834a-4104-9b2d-c8d1e9161b01 service nova] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:15.388456 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-5d402e9b-e5c5-4fde-80fb-2aaa56334010 req-bf4255f0-834a-4104-9b2d-c8d1e9161b01 service nova] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:15.416081 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.compute.server_external_events [req-5d402e9b-e5c5-4fde-80fb-2aaa56334010 req-bf4255f0-834a-4104-9b2d-c8d1e9161b01 service nova] Creating event network-vif-plugged:341cb797-77c6-4bd0-a210-da8c6d2f6c39 for instance 10bef0be-b648-4906-b91c-5582ec00cb5c on hv-cinder-80135 Nov 09 20:08:15.432589 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [req-5d402e9b-e5c5-4fde-80fb-2aaa56334010 req-bf4255f0-834a-4104-9b2d-c8d1e9161b01 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077105 Nov 09 20:08:15.433202 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 48/88] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Nov 9 20:08:15 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 20:08:15.555090 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-88de0e9b-5d94-4ffb-8a06-1ed48b6c4a1f tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] 10.222.0.25 "POST /compute/v2.1/servers/bf7875f5-a01d-4ea9-8d7b-cbe90b7a6418/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.557593 Nov 09 20:08:15.561902 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 41/89] 10.222.0.25 () {60 vars in 1322 bytes} [Tue Nov 9 20:08:14 2021] POST /compute/v2.1/servers/bf7875f5-a01d-4ea9-8d7b-cbe90b7a6418/os-volume_attachments => generated 194 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:08:15.630468 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-1d266a7b-e0c0-486d-828b-6d728cd80c27 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:08:15.631456 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-1d266a7b-e0c0-486d-828b-6d728cd80c27 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 10bef0be-b648-4906-b91c-5582ec00cb5c] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:08:15.645955 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1d266a7b-e0c0-486d-828b-6d728cd80c27 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:15.652066 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1d266a7b-e0c0-486d-828b-6d728cd80c27 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:15.652924 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1d266a7b-e0c0-486d-828b-6d728cd80c27 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:15.653355 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1d266a7b-e0c0-486d-828b-6d728cd80c27 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:15.726242 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-fa14aabc-27b2-471a-8858-4c6bd5cd0314 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:08:15.727042 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-fa14aabc-27b2-471a-8858-4c6bd5cd0314 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:08:15.756935 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-fa14aabc-27b2-471a-8858-4c6bd5cd0314 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:15.757729 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-fa14aabc-27b2-471a-8858-4c6bd5cd0314 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:15.761203 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-fa14aabc-27b2-471a-8858-4c6bd5cd0314 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:15.765798 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-fa14aabc-27b2-471a-8858-4c6bd5cd0314 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:15.956915 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-1d266a7b-e0c0-486d-828b-6d728cd80c27 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:08:15.983044 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-1d266a7b-e0c0-486d-828b-6d728cd80c27 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/10bef0be-b648-4906-b91c-5582ec00cb5c" status: 200 len: 1321 microversion: 2.1 time: 0.351683 Nov 09 20:08:15.985630 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 49/90] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:08:15 2021] GET /compute/v2.1/servers/10bef0be-b648-4906-b91c-5582ec00cb5c => generated 1321 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:08:15.993184 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-e34f1cfc-3e7e-4cda-ab61-c62e0b8691a9 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:08:15.999718 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-e34f1cfc-3e7e-4cda-ab61-c62e0b8691a9 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:08:16.020236 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e34f1cfc-3e7e-4cda-ab61-c62e0b8691a9 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:16.023658 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e34f1cfc-3e7e-4cda-ab61-c62e0b8691a9 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:16.024417 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e34f1cfc-3e7e-4cda-ab61-c62e0b8691a9 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:16.025206 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e34f1cfc-3e7e-4cda-ab61-c62e0b8691a9 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:16.278825 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-fa14aabc-27b2-471a-8858-4c6bd5cd0314 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:08:16.287540 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-fa14aabc-27b2-471a-8858-4c6bd5cd0314 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:08:16.296823 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-fa14aabc-27b2-471a-8858-4c6bd5cd0314 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:08:16.298215 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-fa14aabc-27b2-471a-8858-4c6bd5cd0314 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1407 microversion: 2.20 time: 0.577214 Nov 09 20:08:16.299244 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 42/91] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:08:15 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1407 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:08:16.366912 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-e34f1cfc-3e7e-4cda-ab61-c62e0b8691a9 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:08:16.375243 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-e34f1cfc-3e7e-4cda-ab61-c62e0b8691a9 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1362 microversion: 2.1 time: 0.388116 Nov 09 20:08:16.376001 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 50/92] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:08:15 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1362 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:08:17.002156 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-87e07290-4b69-4c3a-980a-fabadf86f688 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:08:17.004474 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-87e07290-4b69-4c3a-980a-fabadf86f688 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 10bef0be-b648-4906-b91c-5582ec00cb5c] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:08:17.012910 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-87e07290-4b69-4c3a-980a-fabadf86f688 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:17.013352 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-87e07290-4b69-4c3a-980a-fabadf86f688 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:17.014308 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-87e07290-4b69-4c3a-980a-fabadf86f688 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:17.014929 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-87e07290-4b69-4c3a-980a-fabadf86f688 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:17.234611 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-87e07290-4b69-4c3a-980a-fabadf86f688 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:08:17.242597 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-87e07290-4b69-4c3a-980a-fabadf86f688 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/10bef0be-b648-4906-b91c-5582ec00cb5c" status: 200 len: 1321 microversion: 2.1 time: 0.245612 Nov 09 20:08:17.246768 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 43/93] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:08:16 2021] GET /compute/v2.1/servers/10bef0be-b648-4906-b91c-5582ec00cb5c => generated 1321 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:08:17.316918 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-51e2d4b5-0eee-43c2-a730-b9682207a147 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:08:17.317722 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-51e2d4b5-0eee-43c2-a730-b9682207a147 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:08:17.325415 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-51e2d4b5-0eee-43c2-a730-b9682207a147 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:17.326377 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-51e2d4b5-0eee-43c2-a730-b9682207a147 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:17.328898 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-51e2d4b5-0eee-43c2-a730-b9682207a147 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:17.329527 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-51e2d4b5-0eee-43c2-a730-b9682207a147 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:17.392902 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-13ed2f41-ed6c-4179-9bdb-70ee4ef7948b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:08:17.393508 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-13ed2f41-ed6c-4179-9bdb-70ee4ef7948b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:08:17.403703 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-13ed2f41-ed6c-4179-9bdb-70ee4ef7948b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:17.404098 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-13ed2f41-ed6c-4179-9bdb-70ee4ef7948b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:17.404916 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-13ed2f41-ed6c-4179-9bdb-70ee4ef7948b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:17.405345 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-13ed2f41-ed6c-4179-9bdb-70ee4ef7948b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:17.622790 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-51e2d4b5-0eee-43c2-a730-b9682207a147 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:08:17.639992 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-51e2d4b5-0eee-43c2-a730-b9682207a147 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:08:17.643917 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-13ed2f41-ed6c-4179-9bdb-70ee4ef7948b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:08:17.646615 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-51e2d4b5-0eee-43c2-a730-b9682207a147 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:08:17.647941 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-51e2d4b5-0eee-43c2-a730-b9682207a147 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1407 microversion: 2.20 time: 0.334638 Nov 09 20:08:17.655150 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 51/94] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:08:17 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1407 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 09 20:08:17.664889 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-13ed2f41-ed6c-4179-9bdb-70ee4ef7948b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1362 microversion: 2.1 time: 0.265345 Nov 09 20:08:17.664889 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 44/95] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:08:17 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1362 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 20:08:17.668487 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [req-4ca70cbb-6500-49ce-9ca9-aaaf7dc08dc1 req-b3906f72-185f-4aaa-be10-db57f88d901c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae338c69-d22d-41c2-89b0-b0cec236521e", "name": "network-vif-plugged", "status": "completed", "tag": "8caa7fa5-9183-46fa-9387-e9fbebafe302"}]} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:08:17.670099 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 20:08:17.670099 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: warnings.warn(msg) Nov 09 20:08:17.677524 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-4ca70cbb-6500-49ce-9ca9-aaaf7dc08dc1 req-b3906f72-185f-4aaa-be10-db57f88d901c service nova] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:17.678964 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-4ca70cbb-6500-49ce-9ca9-aaaf7dc08dc1 req-b3906f72-185f-4aaa-be10-db57f88d901c service nova] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:17.692438 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.compute.server_external_events [req-4ca70cbb-6500-49ce-9ca9-aaaf7dc08dc1 req-b3906f72-185f-4aaa-be10-db57f88d901c service nova] Creating event network-vif-plugged:8caa7fa5-9183-46fa-9387-e9fbebafe302 for instance ae338c69-d22d-41c2-89b0-b0cec236521e on hv-cinder-80135 Nov 09 20:08:17.697745 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [req-4ca70cbb-6500-49ce-9ca9-aaaf7dc08dc1 req-b3906f72-185f-4aaa-be10-db57f88d901c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041425 Nov 09 20:08:17.698386 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 52/96] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Nov 9 20:08:17 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:08:18.265208 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-94415141-ca11-4da2-a601-7b41c0bc356a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:08:18.265975 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-94415141-ca11-4da2-a601-7b41c0bc356a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 10bef0be-b648-4906-b91c-5582ec00cb5c] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:08:18.272260 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-94415141-ca11-4da2-a601-7b41c0bc356a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:18.272932 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-94415141-ca11-4da2-a601-7b41c0bc356a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:18.273798 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-94415141-ca11-4da2-a601-7b41c0bc356a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:18.274244 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-94415141-ca11-4da2-a601-7b41c0bc356a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:18.407700 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-94415141-ca11-4da2-a601-7b41c0bc356a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:08:18.415243 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-94415141-ca11-4da2-a601-7b41c0bc356a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/10bef0be-b648-4906-b91c-5582ec00cb5c" status: 200 len: 1321 microversion: 2.1 time: 0.153629 Nov 09 20:08:18.415841 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 45/97] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:08:18 2021] GET /compute/v2.1/servers/10bef0be-b648-4906-b91c-5582ec00cb5c => generated 1321 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:08:18.668431 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-5b2104c9-5a39-44fe-b711-ea5f978578ca tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:08:18.669207 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-5b2104c9-5a39-44fe-b711-ea5f978578ca tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:08:18.678189 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-8f5c3c8a-9863-4957-8d59-d34a9ef8c93b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:08:18.679046 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-8f5c3c8a-9863-4957-8d59-d34a9ef8c93b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:08:18.680528 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5b2104c9-5a39-44fe-b711-ea5f978578ca tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:18.681140 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5b2104c9-5a39-44fe-b711-ea5f978578ca tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:18.681950 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5b2104c9-5a39-44fe-b711-ea5f978578ca tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:18.682771 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5b2104c9-5a39-44fe-b711-ea5f978578ca tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:18.685722 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-8f5c3c8a-9863-4957-8d59-d34a9ef8c93b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:18.686414 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-8f5c3c8a-9863-4957-8d59-d34a9ef8c93b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:18.687262 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-8f5c3c8a-9863-4957-8d59-d34a9ef8c93b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:18.689123 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-8f5c3c8a-9863-4957-8d59-d34a9ef8c93b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:18.889439 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-5b2104c9-5a39-44fe-b711-ea5f978578ca tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:08:18.892110 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-8f5c3c8a-9863-4957-8d59-d34a9ef8c93b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:08:18.897453 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-5b2104c9-5a39-44fe-b711-ea5f978578ca tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:08:18.898938 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-5b2104c9-5a39-44fe-b711-ea5f978578ca tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:08:18.900026 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-5b2104c9-5a39-44fe-b711-ea5f978578ca tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1407 microversion: 2.20 time: 0.236032 Nov 09 20:08:18.900667 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 53/98] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:08:18 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1407 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:08:18.901384 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-8f5c3c8a-9863-4957-8d59-d34a9ef8c93b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1362 microversion: 2.1 time: 0.227886 Nov 09 20:08:18.909319 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 46/99] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:08:18 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1362 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:08:19.430731 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-94ed1887-34e7-4a28-a325-d9c60f6c0dd5 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:08:19.431335 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-94ed1887-34e7-4a28-a325-d9c60f6c0dd5 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 10bef0be-b648-4906-b91c-5582ec00cb5c] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:08:19.437460 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-94ed1887-34e7-4a28-a325-d9c60f6c0dd5 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:19.437968 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-94ed1887-34e7-4a28-a325-d9c60f6c0dd5 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:19.438780 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-94ed1887-34e7-4a28-a325-d9c60f6c0dd5 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:19.439216 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-94ed1887-34e7-4a28-a325-d9c60f6c0dd5 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:19.570493 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-94ed1887-34e7-4a28-a325-d9c60f6c0dd5 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:08:19.577799 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-94ed1887-34e7-4a28-a325-d9c60f6c0dd5 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/10bef0be-b648-4906-b91c-5582ec00cb5c" status: 200 len: 1321 microversion: 2.1 time: 0.150654 Nov 09 20:08:19.578361 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 54/100] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:08:19 2021] GET /compute/v2.1/servers/10bef0be-b648-4906-b91c-5582ec00cb5c => generated 1321 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:08:19.903328 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [req-4f11797e-9746-42b2-a341-d3768686de45 req-ac5c54c2-2c32-43b8-9bb6-639c7e02a4e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "632b79c1-d378-423c-8404-3204223226a6", "name": "network-vif-plugged", "status": "completed", "tag": "bf82cdc8-5318-4cd6-9fbe-fda62638d826"}]} {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:08:19.904909 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 20:08:19.904909 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: warnings.warn(msg) Nov 09 20:08:19.913367 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [req-4f11797e-9746-42b2-a341-d3768686de45 req-ac5c54c2-2c32-43b8-9bb6-639c7e02a4e1 service nova] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:19.922168 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-7228a30c-3d14-4a57-935b-e18080b3a5b4 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:08:19.923364 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-7228a30c-3d14-4a57-935b-e18080b3a5b4 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:08:19.928865 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [req-4f11797e-9746-42b2-a341-d3768686de45 req-ac5c54c2-2c32-43b8-9bb6-639c7e02a4e1 service nova] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:19.931612 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7228a30c-3d14-4a57-935b-e18080b3a5b4 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:19.937064 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7228a30c-3d14-4a57-935b-e18080b3a5b4 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:19.938999 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7228a30c-3d14-4a57-935b-e18080b3a5b4 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:19.940274 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7228a30c-3d14-4a57-935b-e18080b3a5b4 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:19.961781 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.compute.server_external_events [req-4f11797e-9746-42b2-a341-d3768686de45 req-ac5c54c2-2c32-43b8-9bb6-639c7e02a4e1 service nova] Creating event network-vif-plugged:bf82cdc8-5318-4cd6-9fbe-fda62638d826 for instance 632b79c1-d378-423c-8404-3204223226a6 on hv-cinder-80135 Nov 09 20:08:19.975997 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [req-4f11797e-9746-42b2-a341-d3768686de45 req-ac5c54c2-2c32-43b8-9bb6-639c7e02a4e1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074124 Nov 09 20:08:19.978052 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 47/101] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Nov 9 20:08:19 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:08:19.995068 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-7c2b3bbf-a363-48bc-b769-4b656036fc8b tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:08:19.997803 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-7c2b3bbf-a363-48bc-b769-4b656036fc8b tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:08:20.009104 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-7c2b3bbf-a363-48bc-b769-4b656036fc8b tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:20.009439 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-7c2b3bbf-a363-48bc-b769-4b656036fc8b tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:20.010598 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-7c2b3bbf-a363-48bc-b769-4b656036fc8b tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:20.011176 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-7c2b3bbf-a363-48bc-b769-4b656036fc8b tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:20.247977 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-7c2b3bbf-a363-48bc-b769-4b656036fc8b tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:08:20.262121 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-7c2b3bbf-a363-48bc-b769-4b656036fc8b tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:08:20.264422 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-7c2b3bbf-a363-48bc-b769-4b656036fc8b tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:08:20.265906 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-7c2b3bbf-a363-48bc-b769-4b656036fc8b tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1407 microversion: 2.20 time: 0.283554 Nov 09 20:08:20.266460 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 48/102] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:08:19 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1407 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:08:20.290691 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-7228a30c-3d14-4a57-935b-e18080b3a5b4 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:08:20.298731 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-7228a30c-3d14-4a57-935b-e18080b3a5b4 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1362 microversion: 2.1 time: 0.382955 Nov 09 20:08:20.299323 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 55/103] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:08:19 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1362 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:08:20.594816 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-7fa75095-2074-410f-a543-7460a0bca212 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:08:20.596478 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-7fa75095-2074-410f-a543-7460a0bca212 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 10bef0be-b648-4906-b91c-5582ec00cb5c] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:08:20.603065 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-7fa75095-2074-410f-a543-7460a0bca212 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:20.603510 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-7fa75095-2074-410f-a543-7460a0bca212 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:20.604284 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-7fa75095-2074-410f-a543-7460a0bca212 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:20.606492 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-7fa75095-2074-410f-a543-7460a0bca212 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:20.750983 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-7fa75095-2074-410f-a543-7460a0bca212 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:08:20.759928 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-7fa75095-2074-410f-a543-7460a0bca212 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/10bef0be-b648-4906-b91c-5582ec00cb5c" status: 200 len: 1514 microversion: 2.1 time: 0.168717 Nov 09 20:08:20.760710 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 49/104] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:08:20 2021] GET /compute/v2.1/servers/10bef0be-b648-4906-b91c-5582ec00cb5c => generated 1514 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 20:08:20.777782 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-00d25252-7735-4312-8da9-6bd9c7b44b39 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:08:20.779050 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-00d25252-7735-4312-8da9-6bd9c7b44b39 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 10bef0be-b648-4906-b91c-5582ec00cb5c] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:08:20.786923 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-00d25252-7735-4312-8da9-6bd9c7b44b39 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:20.788279 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-00d25252-7735-4312-8da9-6bd9c7b44b39 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:20.789158 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-00d25252-7735-4312-8da9-6bd9c7b44b39 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:20.789657 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-00d25252-7735-4312-8da9-6bd9c7b44b39 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:20.854560 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.objects.instance [None req-00d25252-7735-4312-8da9-6bd9c7b44b39 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lazy-loading 'flavor' on Instance uuid 10bef0be-b648-4906-b91c-5582ec00cb5c {{(pid=116103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 09 20:08:20.938699 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-554fb436-d9fb-4286-8851-515890c71130 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1334446073", "imageRef": "109ded43-8c19-4f17-afac-7625dcfef942", "flavorRef": "452", "networks": [{"uuid": "753a1e87-4e2f-430f-bcfb-26f496dc16de"}]}} {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:08:20.981418 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-00d25252-7735-4312-8da9-6bd9c7b44b39 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "POST /compute/v2.1/servers/10bef0be-b648-4906-b91c-5582ec00cb5c/action" status: 200 len: 32 microversion: 2.1 time: 0.207527 Nov 09 20:08:20.982232 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 56/105] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Nov 9 20:08:20 2021] POST /compute/v2.1/servers/10bef0be-b648-4906-b91c-5582ec00cb5c/action => generated 32 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 09 20:08:20.993767 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-f895e223-059a-4d68-ad74-a08c25fddcda tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:08:20.993877 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-f895e223-059a-4d68-ad74-a08c25fddcda tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 10bef0be-b648-4906-b91c-5582ec00cb5c] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:08:21.000906 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f895e223-059a-4d68-ad74-a08c25fddcda tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:21.001346 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f895e223-059a-4d68-ad74-a08c25fddcda tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:21.002117 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f895e223-059a-4d68-ad74-a08c25fddcda tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:21.002701 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f895e223-059a-4d68-ad74-a08c25fddcda tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:21.010451 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.network.neutron [None req-554fb436-d9fb-4286-8851-515890c71130 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] validate_networks() for [('753a1e87-4e2f-430f-bcfb-26f496dc16de', None, None, None, None, None)] {{(pid=116102) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 09 20:08:21.244487 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-f895e223-059a-4d68-ad74-a08c25fddcda tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:08:21.252647 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-f895e223-059a-4d68-ad74-a08c25fddcda tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/10bef0be-b648-4906-b91c-5582ec00cb5c" status: 200 len: 1520 microversion: 2.1 time: 0.265037 Nov 09 20:08:21.261999 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 57/106] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:08:20 2021] GET /compute/v2.1/servers/10bef0be-b648-4906-b91c-5582ec00cb5c => generated 1520 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 20:08:21.291251 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-4a524f7a-6d73-4617-beff-a25f99cf357f tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:08:21.291853 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-4a524f7a-6d73-4617-beff-a25f99cf357f tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:08:21.299166 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4a524f7a-6d73-4617-beff-a25f99cf357f tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:21.299612 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4a524f7a-6d73-4617-beff-a25f99cf357f tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:21.300785 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4a524f7a-6d73-4617-beff-a25f99cf357f tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:21.301726 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4a524f7a-6d73-4617-beff-a25f99cf357f tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:21.606092 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-4a524f7a-6d73-4617-beff-a25f99cf357f tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:08:21.615090 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-4a524f7a-6d73-4617-beff-a25f99cf357f tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:08:21.622674 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-4a524f7a-6d73-4617-beff-a25f99cf357f tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:08:21.623810 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-4a524f7a-6d73-4617-beff-a25f99cf357f tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1407 microversion: 2.20 time: 0.336760 Nov 09 20:08:21.624380 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 58/107] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:08:21 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1407 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:08:21.641642 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-720de0d9-2eb3-4971-9537-f39dc9beb45d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:08:21.641642 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-720de0d9-2eb3-4971-9537-f39dc9beb45d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:08:21.645995 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-720de0d9-2eb3-4971-9537-f39dc9beb45d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:21.646479 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-720de0d9-2eb3-4971-9537-f39dc9beb45d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:21.647585 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-720de0d9-2eb3-4971-9537-f39dc9beb45d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:21.648098 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.virt.hardware [None req-554fb436-d9fb-4286-8851-515890c71130 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Flavor limits 0:0:0 {{(pid=116102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 09 20:08:21.648446 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-720de0d9-2eb3-4971-9537-f39dc9beb45d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:21.648682 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.virt.hardware [None req-554fb436-d9fb-4286-8851-515890c71130 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Image limits 0:0:0 {{(pid=116102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 09 20:08:21.649231 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.virt.hardware [None req-554fb436-d9fb-4286-8851-515890c71130 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Flavor pref 0:0:0 {{(pid=116102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 09 20:08:21.649715 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.virt.hardware [None req-554fb436-d9fb-4286-8851-515890c71130 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Image pref 0:0:0 {{(pid=116102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 09 20:08:21.650204 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.virt.hardware [None req-554fb436-d9fb-4286-8851-515890c71130 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 09 20:08:21.661473 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-554fb436-d9fb-4286-8851-515890c71130 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:21.662698 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-554fb436-d9fb-4286-8851-515890c71130 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:21.663843 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-554fb436-d9fb-4286-8851-515890c71130 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:21.664381 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-554fb436-d9fb-4286-8851-515890c71130 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:21.688005 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.quota [None req-554fb436-d9fb-4286-8851-515890c71130 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Getting quotas for project 2beabde9f6094ba98b488166018f1748. Resources: {'cores', 'instances', 'ram'} {{(pid=116102) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 09 20:08:21.693379 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.quota [None req-554fb436-d9fb-4286-8851-515890c71130 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Getting quotas for user e0fa5fbfbbac4395b0dfd39bdfd9dd75 and project 2beabde9f6094ba98b488166018f1748. Resources: {'cores', 'instances', 'ram'} {{(pid=116102) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 09 20:08:21.706528 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-554fb436-d9fb-4286-8851-515890c71130 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Going to run 1 instances... {{(pid=116102) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 09 20:08:21.709246 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-554fb436-d9fb-4286-8851-515890c71130 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] [instance: f6a36a00-5cfb-4410-8334-2ab671a7c391] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='109ded43-8c19-4f17-afac-7625dcfef942',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 09 20:08:21.786390 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-554fb436-d9fb-4286-8851-515890c71130 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.851856 Nov 09 20:08:21.787740 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 50/108] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Nov 9 20:08:20 2021] POST /compute/v2.1/servers => generated 380 bytes in 854 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 09 20:08:21.804789 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-292161f9-cfdc-4edf-82ab-3d16109b2563 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:08:21.805947 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-292161f9-cfdc-4edf-82ab-3d16109b2563 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] [instance: f6a36a00-5cfb-4410-8334-2ab671a7c391] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:08:21.874279 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-720de0d9-2eb3-4971-9537-f39dc9beb45d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:08:21.885402 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-720de0d9-2eb3-4971-9537-f39dc9beb45d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1362 microversion: 2.1 time: 0.249156 Nov 09 20:08:21.887933 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 59/109] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:08:21 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1362 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:08:21.929457 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-292161f9-cfdc-4edf-82ab-3d16109b2563 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0fa5fbfbbac4395b0dfd39bdfd9dd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2beabde9f6094ba98b488166018f1748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:08:21.937077 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-292161f9-cfdc-4edf-82ab-3d16109b2563 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] 10.222.0.25 "GET /compute/v2.1/servers/f6a36a00-5cfb-4410-8334-2ab671a7c391" status: 200 len: 1214 microversion: 2.1 time: 0.143054 Nov 09 20:08:21.937653 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 51/110] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:08:21 2021] GET /compute/v2.1/servers/f6a36a00-5cfb-4410-8334-2ab671a7c391 => generated 1214 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:08:22.269063 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-fd0e2f9b-0c39-4f3c-9445-1f417a078b29 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:08:22.269607 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-fd0e2f9b-0c39-4f3c-9445-1f417a078b29 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 10bef0be-b648-4906-b91c-5582ec00cb5c] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:08:22.284231 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fd0e2f9b-0c39-4f3c-9445-1f417a078b29 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:22.284894 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fd0e2f9b-0c39-4f3c-9445-1f417a078b29 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:22.285694 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fd0e2f9b-0c39-4f3c-9445-1f417a078b29 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:22.286132 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fd0e2f9b-0c39-4f3c-9445-1f417a078b29 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:22.453532 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-fd0e2f9b-0c39-4f3c-9445-1f417a078b29 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:08:22.465728 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-fd0e2f9b-0c39-4f3c-9445-1f417a078b29 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/10bef0be-b648-4906-b91c-5582ec00cb5c" status: 200 len: 1520 microversion: 2.1 time: 0.200886 Nov 09 20:08:22.466678 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 60/111] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:08:22 2021] GET /compute/v2.1/servers/10bef0be-b648-4906-b91c-5582ec00cb5c => generated 1520 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:08:22.642393 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-9e5ba092-9566-4196-ac70-fded6623359f tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:08:22.645244 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-9e5ba092-9566-4196-ac70-fded6623359f tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:08:22.652736 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-9e5ba092-9566-4196-ac70-fded6623359f tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:22.653182 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-9e5ba092-9566-4196-ac70-fded6623359f tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:22.654786 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-9e5ba092-9566-4196-ac70-fded6623359f tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:22.655725 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-9e5ba092-9566-4196-ac70-fded6623359f tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:22.827849 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-9e5ba092-9566-4196-ac70-fded6623359f tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:08:22.841430 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-9e5ba092-9566-4196-ac70-fded6623359f tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:08:22.843127 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-9e5ba092-9566-4196-ac70-fded6623359f tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:08:22.844506 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-9e5ba092-9566-4196-ac70-fded6623359f tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1600 microversion: 2.20 time: 0.205678 Nov 09 20:08:22.845529 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 52/112] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:08:22 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1600 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:08:22.864649 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-41dbf6bb-5258-4a5d-9380-d1073b39732f tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:08:22.865599 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-41dbf6bb-5258-4a5d-9380-d1073b39732f tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:08:22.873695 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-41dbf6bb-5258-4a5d-9380-d1073b39732f tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:22.874876 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-41dbf6bb-5258-4a5d-9380-d1073b39732f tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:22.875324 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-41dbf6bb-5258-4a5d-9380-d1073b39732f tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:22.876091 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-41dbf6bb-5258-4a5d-9380-d1073b39732f tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:22.903789 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-4aaf168f-c12c-4707-9d86-1e69f32b1821 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:08:22.904437 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-4aaf168f-c12c-4707-9d86-1e69f32b1821 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:08:22.915905 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-4aaf168f-c12c-4707-9d86-1e69f32b1821 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:22.919318 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-4aaf168f-c12c-4707-9d86-1e69f32b1821 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:22.920206 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-4aaf168f-c12c-4707-9d86-1e69f32b1821 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:22.920687 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-4aaf168f-c12c-4707-9d86-1e69f32b1821 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:23.010799 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-41dbf6bb-5258-4a5d-9380-d1073b39732f tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.150827 Nov 09 20:08:23.012165 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 61/113] 10.222.0.25 () {60 vars in 1315 bytes} [Tue Nov 9 20:08:22 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e/os-interface => generated 285 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 20:08:23.017191 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-d0f5a813-d916-478e-b4cf-7485de259f85 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:08:23.018202 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-d0f5a813-d916-478e-b4cf-7485de259f85 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] [instance: f6a36a00-5cfb-4410-8334-2ab671a7c391] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:08:23.024994 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d0f5a813-d916-478e-b4cf-7485de259f85 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:23.025819 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d0f5a813-d916-478e-b4cf-7485de259f85 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:23.026990 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d0f5a813-d916-478e-b4cf-7485de259f85 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:23.027608 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d0f5a813-d916-478e-b4cf-7485de259f85 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:23.166153 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-d0f5a813-d916-478e-b4cf-7485de259f85 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0fa5fbfbbac4395b0dfd39bdfd9dd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2beabde9f6094ba98b488166018f1748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:08:23.173699 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-d0f5a813-d916-478e-b4cf-7485de259f85 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] 10.222.0.25 "GET /compute/v2.1/servers/f6a36a00-5cfb-4410-8334-2ab671a7c391" status: 200 len: 1266 microversion: 2.1 time: 0.160301 Nov 09 20:08:23.174586 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 62/114] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:08:23 2021] GET /compute/v2.1/servers/f6a36a00-5cfb-4410-8334-2ab671a7c391 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:08:23.344781 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-4aaf168f-c12c-4707-9d86-1e69f32b1821 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:08:23.353940 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-4aaf168f-c12c-4707-9d86-1e69f32b1821 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1548 microversion: 2.1 time: 0.453606 Nov 09 20:08:23.356986 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 53/115] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:08:22 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1548 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:08:23.373817 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-6c3d2713-3c2d-45bd-acaa-720d98f45a0e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:08:23.374358 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-6c3d2713-3c2d-45bd-acaa-720d98f45a0e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:08:23.382513 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6c3d2713-3c2d-45bd-acaa-720d98f45a0e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:23.382953 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6c3d2713-3c2d-45bd-acaa-720d98f45a0e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:23.383742 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6c3d2713-3c2d-45bd-acaa-720d98f45a0e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:23.384162 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6c3d2713-3c2d-45bd-acaa-720d98f45a0e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:23.484556 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-e32b620b-3960-41b8-8998-9be75b7ce1a3 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:08:23.485688 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-e32b620b-3960-41b8-8998-9be75b7ce1a3 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 10bef0be-b648-4906-b91c-5582ec00cb5c] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:08:23.497867 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e32b620b-3960-41b8-8998-9be75b7ce1a3 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:23.498318 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e32b620b-3960-41b8-8998-9be75b7ce1a3 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:23.499127 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e32b620b-3960-41b8-8998-9be75b7ce1a3 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:23.499562 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e32b620b-3960-41b8-8998-9be75b7ce1a3 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:23.870129 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-6c3d2713-3c2d-45bd-acaa-720d98f45a0e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.499380 Nov 09 20:08:23.879612 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 63/116] 10.222.0.25 () {58 vars in 1274 bytes} [Tue Nov 9 20:08:23 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-interface => generated 284 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:08:24.131860 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-e32b620b-3960-41b8-8998-9be75b7ce1a3 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:08:24.140818 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-e32b620b-3960-41b8-8998-9be75b7ce1a3 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/10bef0be-b648-4906-b91c-5582ec00cb5c" status: 200 len: 1520 microversion: 2.1 time: 0.661008 Nov 09 20:08:24.149447 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 54/117] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:08:23 2021] GET /compute/v2.1/servers/10bef0be-b648-4906-b91c-5582ec00cb5c => generated 1520 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 20:08:24.192016 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-4259ea3c-3335-4b49-902a-88abac92af1e tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:08:24.192721 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-4259ea3c-3335-4b49-902a-88abac92af1e tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] [instance: f6a36a00-5cfb-4410-8334-2ab671a7c391] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:08:24.200878 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4259ea3c-3335-4b49-902a-88abac92af1e tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:24.211133 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4259ea3c-3335-4b49-902a-88abac92af1e tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:24.212322 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4259ea3c-3335-4b49-902a-88abac92af1e tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:24.212974 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4259ea3c-3335-4b49-902a-88abac92af1e tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:24.687317 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-4259ea3c-3335-4b49-902a-88abac92af1e tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0fa5fbfbbac4395b0dfd39bdfd9dd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2beabde9f6094ba98b488166018f1748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:08:24.727569 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-4259ea3c-3335-4b49-902a-88abac92af1e tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] 10.222.0.25 "GET /compute/v2.1/servers/f6a36a00-5cfb-4410-8334-2ab671a7c391" status: 200 len: 1314 microversion: 2.1 time: 0.535849 Nov 09 20:08:24.729280 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 64/118] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:08:24 2021] GET /compute/v2.1/servers/f6a36a00-5cfb-4410-8334-2ab671a7c391 => generated 1314 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:08:25.164843 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-ebdff87d-3f29-40dd-84d3-4022bee1546a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:08:25.165541 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-ebdff87d-3f29-40dd-84d3-4022bee1546a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 10bef0be-b648-4906-b91c-5582ec00cb5c] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:08:25.180889 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ebdff87d-3f29-40dd-84d3-4022bee1546a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:25.181596 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ebdff87d-3f29-40dd-84d3-4022bee1546a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:25.183182 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ebdff87d-3f29-40dd-84d3-4022bee1546a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:25.184075 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ebdff87d-3f29-40dd-84d3-4022bee1546a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:25.728814 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-7e0d35c2-0ab0-450d-b5f9-7c9897df404a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:08:25.730778 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-7e0d35c2-0ab0-450d-b5f9-7c9897df404a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:08:25.737536 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7e0d35c2-0ab0-450d-b5f9-7c9897df404a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:25.738311 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7e0d35c2-0ab0-450d-b5f9-7c9897df404a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:25.739333 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7e0d35c2-0ab0-450d-b5f9-7c9897df404a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:25.740017 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7e0d35c2-0ab0-450d-b5f9-7c9897df404a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:25.758012 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-ebdff87d-3f29-40dd-84d3-4022bee1546a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:08:25.766054 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-ebdff87d-3f29-40dd-84d3-4022bee1546a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/10bef0be-b648-4906-b91c-5582ec00cb5c" status: 200 len: 1520 microversion: 2.1 time: 0.605228 Nov 09 20:08:25.769063 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 55/119] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:08:25 2021] GET /compute/v2.1/servers/10bef0be-b648-4906-b91c-5582ec00cb5c => generated 1520 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:08:25.773762 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [req-ef1168e6-cdd4-4bfd-bc7e-bfc4eaafe58e req-3cdf7b4a-d3a9-454a-82db-5ca9e2368de3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae338c69-d22d-41c2-89b0-b0cec236521e", "tag": "8caa7fa5-9183-46fa-9387-e9fbebafe302"}]} {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:08:25.775489 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 20:08:25.775489 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: warnings.warn(msg) Nov 09 20:08:25.783055 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [req-ef1168e6-cdd4-4bfd-bc7e-bfc4eaafe58e req-3cdf7b4a-d3a9-454a-82db-5ca9e2368de3 service nova] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:25.783823 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [req-ef1168e6-cdd4-4bfd-bc7e-bfc4eaafe58e req-3cdf7b4a-d3a9-454a-82db-5ca9e2368de3 service nova] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:25.806325 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.compute.server_external_events [req-ef1168e6-cdd4-4bfd-bc7e-bfc4eaafe58e req-3cdf7b4a-d3a9-454a-82db-5ca9e2368de3 service nova] Creating event network-changed:8caa7fa5-9183-46fa-9387-e9fbebafe302 for instance ae338c69-d22d-41c2-89b0-b0cec236521e on hv-cinder-80135 Nov 09 20:08:25.813920 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [req-ef1168e6-cdd4-4bfd-bc7e-bfc4eaafe58e req-3cdf7b4a-d3a9-454a-82db-5ca9e2368de3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043389 Nov 09 20:08:25.815095 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 56/120] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Nov 9 20:08:25 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:08:25.822751 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-04218c89-45a1-44b8-9827-14f25fc8952f tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:08:25.824514 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-04218c89-45a1-44b8-9827-14f25fc8952f tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] [instance: f6a36a00-5cfb-4410-8334-2ab671a7c391] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:08:25.835365 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-04218c89-45a1-44b8-9827-14f25fc8952f tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:25.836198 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-04218c89-45a1-44b8-9827-14f25fc8952f tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:25.837300 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-04218c89-45a1-44b8-9827-14f25fc8952f tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:25.838229 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-04218c89-45a1-44b8-9827-14f25fc8952f tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:25.871175 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-7e0d35c2-0ab0-450d-b5f9-7c9897df404a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "POST /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e/action" status: 200 len: 14 microversion: 2.20 time: 0.147177 Nov 09 20:08:25.872316 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 65/121] 10.222.0.25 () {62 vars in 1318 bytes} [Tue Nov 9 20:08:25 2021] POST /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e/action => generated 14 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 20:08:26.053619 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-04218c89-45a1-44b8-9827-14f25fc8952f tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0fa5fbfbbac4395b0dfd39bdfd9dd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2beabde9f6094ba98b488166018f1748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:08:26.072444 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-04218c89-45a1-44b8-9827-14f25fc8952f tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] 10.222.0.25 "GET /compute/v2.1/servers/f6a36a00-5cfb-4410-8334-2ab671a7c391" status: 200 len: 1314 microversion: 2.1 time: 0.255761 Nov 09 20:08:26.073588 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 57/122] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:08:25 2021] GET /compute/v2.1/servers/f6a36a00-5cfb-4410-8334-2ab671a7c391 => generated 1314 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:08:26.445096 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-317aaf32-e9b1-4b13-a03f-18a9e116d417 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:08:26.446139 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-317aaf32-e9b1-4b13-a03f-18a9e116d417 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:08:26.457915 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-317aaf32-e9b1-4b13-a03f-18a9e116d417 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:26.458358 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-317aaf32-e9b1-4b13-a03f-18a9e116d417 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:26.461318 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-317aaf32-e9b1-4b13-a03f-18a9e116d417 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:26.470520 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [req-5d1263c6-a62c-4bb4-8eb3-fef6005ed3bb req-3ae78d04-62ec-44e2-bb19-df2f883324ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "632b79c1-d378-423c-8404-3204223226a6", "tag": "bf82cdc8-5318-4cd6-9fbe-fda62638d826"}]} {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:08:26.472675 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 20:08:26.472675 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: warnings.warn(msg) Nov 09 20:08:26.477770 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-317aaf32-e9b1-4b13-a03f-18a9e116d417 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:26.484593 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [req-5d1263c6-a62c-4bb4-8eb3-fef6005ed3bb req-3ae78d04-62ec-44e2-bb19-df2f883324ad service nova] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:26.491740 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [req-5d1263c6-a62c-4bb4-8eb3-fef6005ed3bb req-3ae78d04-62ec-44e2-bb19-df2f883324ad service nova] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:26.526618 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.compute.server_external_events [req-5d1263c6-a62c-4bb4-8eb3-fef6005ed3bb req-3ae78d04-62ec-44e2-bb19-df2f883324ad service nova] Creating event network-changed:bf82cdc8-5318-4cd6-9fbe-fda62638d826 for instance 632b79c1-d378-423c-8404-3204223226a6 on hv-cinder-80135 Nov 09 20:08:26.549787 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [req-5d1263c6-a62c-4bb4-8eb3-fef6005ed3bb req-3ae78d04-62ec-44e2-bb19-df2f883324ad service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078425 Nov 09 20:08:26.550465 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 58/123] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Nov 9 20:08:26 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 20:08:26.648652 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-317aaf32-e9b1-4b13-a03f-18a9e116d417 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "POST /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/action" status: 200 len: 14 microversion: 2.1 time: 0.207969 Nov 09 20:08:26.651795 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 66/124] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Nov 9 20:08:26 2021] POST /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/action => generated 14 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 09 20:08:26.785218 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-1ee1fae9-d081-48c4-9c90-513e01ea98af tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:08:26.785818 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-1ee1fae9-d081-48c4-9c90-513e01ea98af tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 10bef0be-b648-4906-b91c-5582ec00cb5c] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:08:26.793890 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-1ee1fae9-d081-48c4-9c90-513e01ea98af tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:26.794843 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-1ee1fae9-d081-48c4-9c90-513e01ea98af tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:26.795856 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-1ee1fae9-d081-48c4-9c90-513e01ea98af tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:26.796527 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-1ee1fae9-d081-48c4-9c90-513e01ea98af tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:26.888668 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-4f504689-7d12-42bd-9082-22dcf668267c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:08:26.890482 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-4f504689-7d12-42bd-9082-22dcf668267c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:08:26.903394 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4f504689-7d12-42bd-9082-22dcf668267c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:26.904267 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4f504689-7d12-42bd-9082-22dcf668267c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:26.905408 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4f504689-7d12-42bd-9082-22dcf668267c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:26.906106 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4f504689-7d12-42bd-9082-22dcf668267c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:27.000684 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-4f504689-7d12-42bd-9082-22dcf668267c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "POST /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e/action" status: 200 len: 14 microversion: 2.20 time: 0.120370 Nov 09 20:08:27.001971 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 67/125] 10.222.0.25 () {62 vars in 1318 bytes} [Tue Nov 9 20:08:26 2021] POST /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e/action => generated 14 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:08:27.092419 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-852cb326-5887-4b1b-a60c-4a28767796d2 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:08:27.093817 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-852cb326-5887-4b1b-a60c-4a28767796d2 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] [instance: f6a36a00-5cfb-4410-8334-2ab671a7c391] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:08:27.124980 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-852cb326-5887-4b1b-a60c-4a28767796d2 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:27.129878 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-852cb326-5887-4b1b-a60c-4a28767796d2 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:27.131300 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-852cb326-5887-4b1b-a60c-4a28767796d2 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:27.131865 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-852cb326-5887-4b1b-a60c-4a28767796d2 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:27.444286 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-1ee1fae9-d081-48c4-9c90-513e01ea98af tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:08:27.465472 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-1ee1fae9-d081-48c4-9c90-513e01ea98af tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/10bef0be-b648-4906-b91c-5582ec00cb5c" status: 200 len: 1520 microversion: 2.1 time: 0.682679 Nov 09 20:08:27.468079 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 59/126] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:08:26 2021] GET /compute/v2.1/servers/10bef0be-b648-4906-b91c-5582ec00cb5c => generated 1520 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:08:27.659319 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-e845d939-bc75-4420-99c7-21d14ac7bc64 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:08:27.660291 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-e845d939-bc75-4420-99c7-21d14ac7bc64 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:08:27.672302 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-852cb326-5887-4b1b-a60c-4a28767796d2 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0fa5fbfbbac4395b0dfd39bdfd9dd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2beabde9f6094ba98b488166018f1748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:08:27.673884 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e845d939-bc75-4420-99c7-21d14ac7bc64 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:27.674349 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e845d939-bc75-4420-99c7-21d14ac7bc64 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:27.683198 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e845d939-bc75-4420-99c7-21d14ac7bc64 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:27.683667 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e845d939-bc75-4420-99c7-21d14ac7bc64 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:27.685796 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-852cb326-5887-4b1b-a60c-4a28767796d2 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] 10.222.0.25 "GET /compute/v2.1/servers/f6a36a00-5cfb-4410-8334-2ab671a7c391" status: 200 len: 1314 microversion: 2.1 time: 0.598469 Nov 09 20:08:27.698927 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 68/127] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:08:27 2021] GET /compute/v2.1/servers/f6a36a00-5cfb-4410-8334-2ab671a7c391 => generated 1314 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:08:27.818008 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-cd689c62-4252-4757-b0ee-c7146c2fbf2b tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:08:27.819266 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-cd689c62-4252-4757-b0ee-c7146c2fbf2b tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] [instance: bf7875f5-a01d-4ea9-8d7b-cbe90b7a6418] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:08:27.823362 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-e845d939-bc75-4420-99c7-21d14ac7bc64 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "POST /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/action" status: 200 len: 14 microversion: 2.1 time: 0.167825 Nov 09 20:08:27.824215 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 60/128] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Nov 9 20:08:27 2021] POST /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/action => generated 14 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 09 20:08:27.826226 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cd689c62-4252-4757-b0ee-c7146c2fbf2b tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:27.826838 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cd689c62-4252-4757-b0ee-c7146c2fbf2b tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:27.827805 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cd689c62-4252-4757-b0ee-c7146c2fbf2b tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:27.828381 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cd689c62-4252-4757-b0ee-c7146c2fbf2b tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:27.857718 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-cd689c62-4252-4757-b0ee-c7146c2fbf2b tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] [instance: bf7875f5-a01d-4ea9-8d7b-cbe90b7a6418] Going to try to terminate instance {{(pid=116103) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 09 20:08:28.017538 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-e0a8eda0-adef-403b-86c8-9254ce9d6d4b tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:08:28.018792 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-cd689c62-4252-4757-b0ee-c7146c2fbf2b tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] 10.222.0.25 "DELETE /compute/v2.1/servers/bf7875f5-a01d-4ea9-8d7b-cbe90b7a6418" status: 204 len: 0 microversion: 2.1 time: 0.204949 Nov 09 20:08:28.019763 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-e0a8eda0-adef-403b-86c8-9254ce9d6d4b tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:08:28.023345 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 69/129] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Nov 9 20:08:27 2021] DELETE /compute/v2.1/servers/bf7875f5-a01d-4ea9-8d7b-cbe90b7a6418 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 09 20:08:28.040245 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e0a8eda0-adef-403b-86c8-9254ce9d6d4b tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:28.043392 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-cf32b240-5327-4c6c-9269-00da8ff46eef tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:08:28.044188 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e0a8eda0-adef-403b-86c8-9254ce9d6d4b tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:28.045580 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e0a8eda0-adef-403b-86c8-9254ce9d6d4b tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:28.046283 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e0a8eda0-adef-403b-86c8-9254ce9d6d4b tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:28.049456 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-cf32b240-5327-4c6c-9269-00da8ff46eef tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] [instance: bf7875f5-a01d-4ea9-8d7b-cbe90b7a6418] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:08:28.063967 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cf32b240-5327-4c6c-9269-00da8ff46eef tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:28.065701 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cf32b240-5327-4c6c-9269-00da8ff46eef tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:28.067850 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cf32b240-5327-4c6c-9269-00da8ff46eef tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:28.069481 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cf32b240-5327-4c6c-9269-00da8ff46eef tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:28.141101 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-e0a8eda0-adef-403b-86c8-9254ce9d6d4b tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "POST /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e/action" status: 200 len: 14 microversion: 2.20 time: 0.130995 Nov 09 20:08:28.143147 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 61/130] 10.222.0.25 () {62 vars in 1318 bytes} [Tue Nov 9 20:08:28 2021] POST /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e/action => generated 14 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:08:28.489360 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-de8ca990-9572-4463-978e-191e0371dc88 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:08:28.492694 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-de8ca990-9572-4463-978e-191e0371dc88 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 10bef0be-b648-4906-b91c-5582ec00cb5c] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:08:28.533949 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-cf32b240-5327-4c6c-9269-00da8ff46eef tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7c1dc758e548a8a9e638f45e9f2e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4112bf1e0544da3a76ae67c69234248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:08:28.536771 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-de8ca990-9572-4463-978e-191e0371dc88 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:28.539372 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-de8ca990-9572-4463-978e-191e0371dc88 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:28.541607 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-de8ca990-9572-4463-978e-191e0371dc88 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:28.542577 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-de8ca990-9572-4463-978e-191e0371dc88 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:28.543310 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-cf32b240-5327-4c6c-9269-00da8ff46eef tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] 10.222.0.25 "GET /compute/v2.1/servers/bf7875f5-a01d-4ea9-8d7b-cbe90b7a6418" status: 200 len: 1554 microversion: 2.1 time: 0.514811 Nov 09 20:08:28.543885 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 70/131] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:08:28 2021] GET /compute/v2.1/servers/bf7875f5-a01d-4ea9-8d7b-cbe90b7a6418 => generated 1554 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:08:28.594302 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [req-880d91d0-29fe-48fe-8e7d-023dcd2c941c req-19e952c1-7f00-4796-aac0-c7711caf4543 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6a36a00-5cfb-4410-8334-2ab671a7c391", "tag": "c83057f2-bf67-447d-8bfc-bcddabb1b106"}]} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:08:28.597990 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 20:08:28.597990 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: warnings.warn(msg) Nov 09 20:08:28.618776 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-880d91d0-29fe-48fe-8e7d-023dcd2c941c req-19e952c1-7f00-4796-aac0-c7711caf4543 service nova] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:28.619226 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-880d91d0-29fe-48fe-8e7d-023dcd2c941c req-19e952c1-7f00-4796-aac0-c7711caf4543 service nova] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:28.635795 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.compute.server_external_events [req-880d91d0-29fe-48fe-8e7d-023dcd2c941c req-19e952c1-7f00-4796-aac0-c7711caf4543 service nova] Creating event network-changed:c83057f2-bf67-447d-8bfc-bcddabb1b106 for instance f6a36a00-5cfb-4410-8334-2ab671a7c391 on hv-cinder-80135 Nov 09 20:08:28.640842 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [req-880d91d0-29fe-48fe-8e7d-023dcd2c941c req-19e952c1-7f00-4796-aac0-c7711caf4543 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057110 Nov 09 20:08:28.641814 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 71/132] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Nov 9 20:08:28 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 20:08:28.712281 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-4a875ad9-bbcc-4dda-9cf7-3344f491d3ac tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:08:28.713136 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-4a875ad9-bbcc-4dda-9cf7-3344f491d3ac tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] [instance: f6a36a00-5cfb-4410-8334-2ab671a7c391] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:08:28.728153 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4a875ad9-bbcc-4dda-9cf7-3344f491d3ac tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:28.728647 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4a875ad9-bbcc-4dda-9cf7-3344f491d3ac tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:28.729461 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4a875ad9-bbcc-4dda-9cf7-3344f491d3ac tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:28.732743 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4a875ad9-bbcc-4dda-9cf7-3344f491d3ac tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:29.030810 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-de8ca990-9572-4463-978e-191e0371dc88 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:08:29.044975 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-de8ca990-9572-4463-978e-191e0371dc88 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/10bef0be-b648-4906-b91c-5582ec00cb5c" status: 200 len: 1520 microversion: 2.1 time: 0.560819 Nov 09 20:08:29.047529 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 62/133] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:08:28 2021] GET /compute/v2.1/servers/10bef0be-b648-4906-b91c-5582ec00cb5c => generated 1520 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 20:08:29.054797 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-38aca66e-3948-4fe8-8160-37a0c359a053 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:08:29.055822 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-38aca66e-3948-4fe8-8160-37a0c359a053 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:08:29.063524 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-38aca66e-3948-4fe8-8160-37a0c359a053 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:29.064236 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-38aca66e-3948-4fe8-8160-37a0c359a053 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:29.065411 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-38aca66e-3948-4fe8-8160-37a0c359a053 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:29.066310 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-38aca66e-3948-4fe8-8160-37a0c359a053 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:29.119510 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-4a875ad9-bbcc-4dda-9cf7-3344f491d3ac tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0fa5fbfbbac4395b0dfd39bdfd9dd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2beabde9f6094ba98b488166018f1748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:08:29.128108 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-4a875ad9-bbcc-4dda-9cf7-3344f491d3ac tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] 10.222.0.25 "GET /compute/v2.1/servers/f6a36a00-5cfb-4410-8334-2ab671a7c391" status: 200 len: 1314 microversion: 2.1 time: 0.421858 Nov 09 20:08:29.138276 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 72/134] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:08:28 2021] GET /compute/v2.1/servers/f6a36a00-5cfb-4410-8334-2ab671a7c391 => generated 1314 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 20:08:29.158291 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-9c7ab95a-4130-4bf4-9f11-c82379dee54a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:08:29.159498 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-9c7ab95a-4130-4bf4-9f11-c82379dee54a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:08:29.167306 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9c7ab95a-4130-4bf4-9f11-c82379dee54a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:29.167916 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9c7ab95a-4130-4bf4-9f11-c82379dee54a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:29.168880 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9c7ab95a-4130-4bf4-9f11-c82379dee54a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:29.169446 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9c7ab95a-4130-4bf4-9f11-c82379dee54a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:29.181523 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-38aca66e-3948-4fe8-8160-37a0c359a053 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "POST /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/action" status: 200 len: 14 microversion: 2.1 time: 0.131318 Nov 09 20:08:29.182643 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 63/135] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Nov 9 20:08:29 2021] POST /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/action => generated 14 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 09 20:08:29.266369 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-9c7ab95a-4130-4bf4-9f11-c82379dee54a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "POST /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e/action" status: 200 len: 14 microversion: 2.20 time: 0.111392 Nov 09 20:08:29.267301 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 73/136] 10.222.0.25 () {62 vars in 1318 bytes} [Tue Nov 9 20:08:29 2021] POST /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e/action => generated 14 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:08:29.561145 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-9c231c13-ddab-4e75-8a42-daa02d3b580c tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:08:29.562315 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-9c231c13-ddab-4e75-8a42-daa02d3b580c tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] [instance: bf7875f5-a01d-4ea9-8d7b-cbe90b7a6418] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:08:29.570979 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-9c231c13-ddab-4e75-8a42-daa02d3b580c tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:29.571437 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-9c231c13-ddab-4e75-8a42-daa02d3b580c tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:29.572249 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-9c231c13-ddab-4e75-8a42-daa02d3b580c tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:29.572706 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-9c231c13-ddab-4e75-8a42-daa02d3b580c tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:29.722180 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-9c231c13-ddab-4e75-8a42-daa02d3b580c tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7c1dc758e548a8a9e638f45e9f2e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4112bf1e0544da3a76ae67c69234248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:08:29.731245 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-9c231c13-ddab-4e75-8a42-daa02d3b580c tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] 10.222.0.25 "GET /compute/v2.1/servers/bf7875f5-a01d-4ea9-8d7b-cbe90b7a6418" status: 200 len: 1554 microversion: 2.1 time: 0.174060 Nov 09 20:08:29.731823 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 64/137] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:08:29 2021] GET /compute/v2.1/servers/bf7875f5-a01d-4ea9-8d7b-cbe90b7a6418 => generated 1554 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:08:30.063410 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-10015642-1c6e-4193-8474-81eda93026e7 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:08:30.064328 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-10015642-1c6e-4193-8474-81eda93026e7 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 10bef0be-b648-4906-b91c-5582ec00cb5c] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:08:30.074257 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-10015642-1c6e-4193-8474-81eda93026e7 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:30.075094 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-10015642-1c6e-4193-8474-81eda93026e7 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:30.076333 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-10015642-1c6e-4193-8474-81eda93026e7 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:30.076972 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-10015642-1c6e-4193-8474-81eda93026e7 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:30.148251 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-c72433ac-b76c-4515-9585-b8842f838e72 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:08:30.149619 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-c72433ac-b76c-4515-9585-b8842f838e72 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] [instance: f6a36a00-5cfb-4410-8334-2ab671a7c391] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:08:30.157673 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c72433ac-b76c-4515-9585-b8842f838e72 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:30.158384 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c72433ac-b76c-4515-9585-b8842f838e72 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:30.160480 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c72433ac-b76c-4515-9585-b8842f838e72 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:30.161282 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c72433ac-b76c-4515-9585-b8842f838e72 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:30.342705 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-10015642-1c6e-4193-8474-81eda93026e7 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:08:30.351857 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-10015642-1c6e-4193-8474-81eda93026e7 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/10bef0be-b648-4906-b91c-5582ec00cb5c" status: 200 len: 1520 microversion: 2.1 time: 0.292484 Nov 09 20:08:30.352465 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 74/138] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:08:30 2021] GET /compute/v2.1/servers/10bef0be-b648-4906-b91c-5582ec00cb5c => generated 1520 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:08:30.357671 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-905d5353-733c-442b-89c2-7c02f797e6cf tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:08:30.358629 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-905d5353-733c-442b-89c2-7c02f797e6cf tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:08:30.365895 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-905d5353-733c-442b-89c2-7c02f797e6cf tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:30.366338 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-905d5353-733c-442b-89c2-7c02f797e6cf tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:30.367337 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-905d5353-733c-442b-89c2-7c02f797e6cf tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:30.367964 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-905d5353-733c-442b-89c2-7c02f797e6cf tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:30.410594 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-c72433ac-b76c-4515-9585-b8842f838e72 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0fa5fbfbbac4395b0dfd39bdfd9dd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2beabde9f6094ba98b488166018f1748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:08:30.419205 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-c72433ac-b76c-4515-9585-b8842f838e72 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] 10.222.0.25 "GET /compute/v2.1/servers/f6a36a00-5cfb-4410-8334-2ab671a7c391" status: 200 len: 1314 microversion: 2.1 time: 0.277358 Nov 09 20:08:30.420197 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 65/139] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:08:30 2021] GET /compute/v2.1/servers/f6a36a00-5cfb-4410-8334-2ab671a7c391 => generated 1314 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 20:08:30.431533 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-77f8991d-2809-475c-b16f-b36ac2c06098 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:08:30.433451 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-77f8991d-2809-475c-b16f-b36ac2c06098 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:08:30.442004 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-77f8991d-2809-475c-b16f-b36ac2c06098 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:30.442689 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-77f8991d-2809-475c-b16f-b36ac2c06098 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:30.444728 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-77f8991d-2809-475c-b16f-b36ac2c06098 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:30.445664 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-77f8991d-2809-475c-b16f-b36ac2c06098 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:30.449638 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-905d5353-733c-442b-89c2-7c02f797e6cf tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "POST /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/action" status: 200 len: 14 microversion: 2.1 time: 0.095367 Nov 09 20:08:30.450774 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 75/140] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Nov 9 20:08:30 2021] POST /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/action => generated 14 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 09 20:08:30.534263 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-77f8991d-2809-475c-b16f-b36ac2c06098 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "POST /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e/action" status: 200 len: 14 microversion: 2.20 time: 0.112241 Nov 09 20:08:30.535551 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 66/141] 10.222.0.25 () {62 vars in 1318 bytes} [Tue Nov 9 20:08:30 2021] POST /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e/action => generated 14 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:08:30.749261 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-4a8430cf-07b0-47c9-b5b4-d02ffe0a9353 tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:08:30.749964 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-4a8430cf-07b0-47c9-b5b4-d02ffe0a9353 tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] [instance: bf7875f5-a01d-4ea9-8d7b-cbe90b7a6418] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:08:30.761650 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4a8430cf-07b0-47c9-b5b4-d02ffe0a9353 tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:30.762189 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4a8430cf-07b0-47c9-b5b4-d02ffe0a9353 tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:30.762872 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4a8430cf-07b0-47c9-b5b4-d02ffe0a9353 tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:30.763283 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4a8430cf-07b0-47c9-b5b4-d02ffe0a9353 tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:31.004873 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-4a8430cf-07b0-47c9-b5b4-d02ffe0a9353 tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7c1dc758e548a8a9e638f45e9f2e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4112bf1e0544da3a76ae67c69234248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:08:31.016813 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-4a8430cf-07b0-47c9-b5b4-d02ffe0a9353 tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] 10.222.0.25 "GET /compute/v2.1/servers/bf7875f5-a01d-4ea9-8d7b-cbe90b7a6418" status: 200 len: 1554 microversion: 2.1 time: 0.270976 Nov 09 20:08:31.017790 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 76/142] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:08:30 2021] GET /compute/v2.1/servers/bf7875f5-a01d-4ea9-8d7b-cbe90b7a6418 => generated 1554 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:08:31.178699 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [req-9a8c7d2c-8b3b-4856-a54a-db7cd3d9964d req-36c8bfe1-6cf3-4c44-aa7f-264c2ac8001d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf7875f5-a01d-4ea9-8d7b-cbe90b7a6418", "name": "network-vif-deleted", "tag": "ef1d2d21-e309-4954-881c-631a9d9de67c"}]} {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:08:31.180956 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 20:08:31.180956 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: warnings.warn(msg) Nov 09 20:08:31.190523 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [req-9a8c7d2c-8b3b-4856-a54a-db7cd3d9964d req-36c8bfe1-6cf3-4c44-aa7f-264c2ac8001d service nova] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:31.191263 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [req-9a8c7d2c-8b3b-4856-a54a-db7cd3d9964d req-36c8bfe1-6cf3-4c44-aa7f-264c2ac8001d service nova] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:31.217946 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.compute.server_external_events [req-9a8c7d2c-8b3b-4856-a54a-db7cd3d9964d req-36c8bfe1-6cf3-4c44-aa7f-264c2ac8001d service nova] Creating event network-vif-deleted:ef1d2d21-e309-4954-881c-631a9d9de67c for instance bf7875f5-a01d-4ea9-8d7b-cbe90b7a6418 on hv-cinder-80135 Nov 09 20:08:31.222772 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [req-9a8c7d2c-8b3b-4856-a54a-db7cd3d9964d req-36c8bfe1-6cf3-4c44-aa7f-264c2ac8001d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048470 Nov 09 20:08:31.223830 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 67/143] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Nov 9 20:08:31 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:08:31.370154 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-b38460c1-d256-4c58-b55e-3df1d79bc9c8 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:08:31.371487 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-b38460c1-d256-4c58-b55e-3df1d79bc9c8 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 10bef0be-b648-4906-b91c-5582ec00cb5c] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:08:31.377979 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b38460c1-d256-4c58-b55e-3df1d79bc9c8 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:31.378556 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b38460c1-d256-4c58-b55e-3df1d79bc9c8 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:31.380240 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b38460c1-d256-4c58-b55e-3df1d79bc9c8 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:31.380240 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b38460c1-d256-4c58-b55e-3df1d79bc9c8 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:31.441467 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-1d6d533c-1d64-473a-9d5a-48a7ffe65222 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:08:31.442276 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-1d6d533c-1d64-473a-9d5a-48a7ffe65222 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] [instance: f6a36a00-5cfb-4410-8334-2ab671a7c391] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:08:31.457674 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-1d6d533c-1d64-473a-9d5a-48a7ffe65222 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:31.462321 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-1d6d533c-1d64-473a-9d5a-48a7ffe65222 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:31.466761 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-1d6d533c-1d64-473a-9d5a-48a7ffe65222 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:31.467404 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-1d6d533c-1d64-473a-9d5a-48a7ffe65222 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:31.585845 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-b38460c1-d256-4c58-b55e-3df1d79bc9c8 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:08:31.628990 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-b38460c1-d256-4c58-b55e-3df1d79bc9c8 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/10bef0be-b648-4906-b91c-5582ec00cb5c" status: 200 len: 1520 microversion: 2.1 time: 0.262812 Nov 09 20:08:31.633238 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 77/144] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:08:31 2021] GET /compute/v2.1/servers/10bef0be-b648-4906-b91c-5582ec00cb5c => generated 1520 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 20:08:31.645353 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-0138a420-79ba-4aed-9fac-bd20c0a8eeb9 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:08:31.650991 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-0138a420-79ba-4aed-9fac-bd20c0a8eeb9 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:08:31.668116 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0138a420-79ba-4aed-9fac-bd20c0a8eeb9 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:31.668599 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0138a420-79ba-4aed-9fac-bd20c0a8eeb9 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:31.669383 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0138a420-79ba-4aed-9fac-bd20c0a8eeb9 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:31.670971 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0138a420-79ba-4aed-9fac-bd20c0a8eeb9 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:31.692063 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-1d6d533c-1d64-473a-9d5a-48a7ffe65222 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0fa5fbfbbac4395b0dfd39bdfd9dd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2beabde9f6094ba98b488166018f1748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:08:31.700827 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-1d6d533c-1d64-473a-9d5a-48a7ffe65222 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] 10.222.0.25 "GET /compute/v2.1/servers/f6a36a00-5cfb-4410-8334-2ab671a7c391" status: 200 len: 1314 microversion: 2.1 time: 0.265675 Nov 09 20:08:31.703578 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 68/145] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:08:31 2021] GET /compute/v2.1/servers/f6a36a00-5cfb-4410-8334-2ab671a7c391 => generated 1314 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:08:31.717672 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-b07ca587-7cf3-48af-8a0d-0f833bca6fdc tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:08:31.719512 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-b07ca587-7cf3-48af-8a0d-0f833bca6fdc tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:08:31.730619 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b07ca587-7cf3-48af-8a0d-0f833bca6fdc tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:31.731565 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b07ca587-7cf3-48af-8a0d-0f833bca6fdc tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:31.732686 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b07ca587-7cf3-48af-8a0d-0f833bca6fdc tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:31.733355 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b07ca587-7cf3-48af-8a0d-0f833bca6fdc tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:31.795934 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-0138a420-79ba-4aed-9fac-bd20c0a8eeb9 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "POST /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/action" status: 200 len: 14 microversion: 2.1 time: 0.161145 Nov 09 20:08:31.796931 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 78/146] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Nov 9 20:08:31 2021] POST /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/action => generated 14 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 09 20:08:31.822843 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-b07ca587-7cf3-48af-8a0d-0f833bca6fdc tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "POST /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e/action" status: 200 len: 14 microversion: 2.20 time: 0.117849 Nov 09 20:08:31.823694 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 69/147] 10.222.0.25 () {62 vars in 1318 bytes} [Tue Nov 9 20:08:31 2021] POST /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e/action => generated 14 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:08:32.035640 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-720974c3-bb6d-4a1e-a80e-b871298f3c10 tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:08:32.036341 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-720974c3-bb6d-4a1e-a80e-b871298f3c10 tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] [instance: bf7875f5-a01d-4ea9-8d7b-cbe90b7a6418] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:08:32.044214 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-720974c3-bb6d-4a1e-a80e-b871298f3c10 tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:32.044732 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-720974c3-bb6d-4a1e-a80e-b871298f3c10 tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:32.045562 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-720974c3-bb6d-4a1e-a80e-b871298f3c10 tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:32.045991 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-720974c3-bb6d-4a1e-a80e-b871298f3c10 tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:32.082639 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-720974c3-bb6d-4a1e-a80e-b871298f3c10 tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:32.083292 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-720974c3-bb6d-4a1e-a80e-b871298f3c10 tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:32.083515 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.objects.instance [None req-720974c3-bb6d-4a1e-a80e-b871298f3c10 tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] Lazy-loading 'fault' on Instance uuid bf7875f5-a01d-4ea9-8d7b-cbe90b7a6418 {{(pid=116103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 09 20:08:32.128958 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-720974c3-bb6d-4a1e-a80e-b871298f3c10 tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7c1dc758e548a8a9e638f45e9f2e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4112bf1e0544da3a76ae67c69234248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:08:32.138920 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-720974c3-bb6d-4a1e-a80e-b871298f3c10 tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] 10.222.0.25 "GET /compute/v2.1/servers/bf7875f5-a01d-4ea9-8d7b-cbe90b7a6418" status: 200 len: 1351 microversion: 2.1 time: 0.107257 Nov 09 20:08:32.140096 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 79/148] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:08:32 2021] GET /compute/v2.1/servers/bf7875f5-a01d-4ea9-8d7b-cbe90b7a6418 => generated 1351 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:08:32.650569 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-906645b1-5303-4135-929a-6fde7059d364 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:08:32.651252 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-906645b1-5303-4135-929a-6fde7059d364 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 10bef0be-b648-4906-b91c-5582ec00cb5c] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:08:32.659930 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-906645b1-5303-4135-929a-6fde7059d364 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:32.660376 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-906645b1-5303-4135-929a-6fde7059d364 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:32.661201 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-906645b1-5303-4135-929a-6fde7059d364 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:32.661632 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-906645b1-5303-4135-929a-6fde7059d364 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:32.720752 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-9437aac8-2e56-45c7-8141-5a3adfcab8d1 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:08:32.722583 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-9437aac8-2e56-45c7-8141-5a3adfcab8d1 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] [instance: f6a36a00-5cfb-4410-8334-2ab671a7c391] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:08:32.734100 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9437aac8-2e56-45c7-8141-5a3adfcab8d1 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:32.738149 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9437aac8-2e56-45c7-8141-5a3adfcab8d1 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:32.738513 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9437aac8-2e56-45c7-8141-5a3adfcab8d1 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:32.738948 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9437aac8-2e56-45c7-8141-5a3adfcab8d1 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:33.082622 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-906645b1-5303-4135-929a-6fde7059d364 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:08:33.090527 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-906645b1-5303-4135-929a-6fde7059d364 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/10bef0be-b648-4906-b91c-5582ec00cb5c" status: 200 len: 1520 microversion: 2.1 time: 0.443834 Nov 09 20:08:33.091272 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 70/149] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:08:32 2021] GET /compute/v2.1/servers/10bef0be-b648-4906-b91c-5582ec00cb5c => generated 1520 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 20:08:33.095725 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-50545cce-704d-478d-91d8-76e70ca3f544 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:08:33.096866 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-50545cce-704d-478d-91d8-76e70ca3f544 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:08:33.103559 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-50545cce-704d-478d-91d8-76e70ca3f544 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:33.104342 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-50545cce-704d-478d-91d8-76e70ca3f544 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:33.105279 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-50545cce-704d-478d-91d8-76e70ca3f544 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:33.106270 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-50545cce-704d-478d-91d8-76e70ca3f544 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:33.138170 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-9437aac8-2e56-45c7-8141-5a3adfcab8d1 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0fa5fbfbbac4395b0dfd39bdfd9dd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2beabde9f6094ba98b488166018f1748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:08:33.148651 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-9437aac8-2e56-45c7-8141-5a3adfcab8d1 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] 10.222.0.25 "GET /compute/v2.1/servers/f6a36a00-5cfb-4410-8334-2ab671a7c391" status: 200 len: 1314 microversion: 2.1 time: 0.432053 Nov 09 20:08:33.149230 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 80/150] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:08:32 2021] GET /compute/v2.1/servers/f6a36a00-5cfb-4410-8334-2ab671a7c391 => generated 1314 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 20:08:33.153570 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-1007816d-1af6-4dce-8068-eb90a1c00a79 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:08:33.154568 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-1007816d-1af6-4dce-8068-eb90a1c00a79 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:08:33.160980 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1007816d-1af6-4dce-8068-eb90a1c00a79 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:33.161586 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1007816d-1af6-4dce-8068-eb90a1c00a79 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:33.162494 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1007816d-1af6-4dce-8068-eb90a1c00a79 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:33.162921 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1007816d-1af6-4dce-8068-eb90a1c00a79 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:33.182570 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-50545cce-704d-478d-91d8-76e70ca3f544 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "POST /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/action" status: 200 len: 14 microversion: 2.1 time: 0.089779 Nov 09 20:08:33.183265 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 71/151] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Nov 9 20:08:33 2021] POST /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/action => generated 14 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 09 20:08:33.188820 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-922c527c-97ea-463b-b2fa-42311a2839d8 tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:08:33.189494 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-922c527c-97ea-463b-b2fa-42311a2839d8 tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] [instance: bf7875f5-a01d-4ea9-8d7b-cbe90b7a6418] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:08:33.196594 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-922c527c-97ea-463b-b2fa-42311a2839d8 tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:33.197033 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-922c527c-97ea-463b-b2fa-42311a2839d8 tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:33.197872 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-922c527c-97ea-463b-b2fa-42311a2839d8 tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:33.198300 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-922c527c-97ea-463b-b2fa-42311a2839d8 tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:33.212649 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.wsgi [None req-922c527c-97ea-463b-b2fa-42311a2839d8 tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] HTTP exception thrown: Instance bf7875f5-a01d-4ea9-8d7b-cbe90b7a6418 could not be found. Nov 09 20:08:33.213245 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-922c527c-97ea-463b-b2fa-42311a2839d8 tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] Returning 404 to user: Instance bf7875f5-a01d-4ea9-8d7b-cbe90b7a6418 could not be found. {{(pid=116102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 09 20:08:33.214053 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-922c527c-97ea-463b-b2fa-42311a2839d8 tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] 10.222.0.25 "GET /compute/v2.1/servers/bf7875f5-a01d-4ea9-8d7b-cbe90b7a6418" status: 404 len: 111 microversion: 2.1 time: 0.029605 Nov 09 20:08:33.214764 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 72/152] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:08:33 2021] GET /compute/v2.1/servers/bf7875f5-a01d-4ea9-8d7b-cbe90b7a6418 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 09 20:08:33.234602 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-1007816d-1af6-4dce-8068-eb90a1c00a79 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "POST /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e/action" status: 200 len: 14 microversion: 2.20 time: 0.084140 Nov 09 20:08:33.235351 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 81/153] 10.222.0.25 () {62 vars in 1318 bytes} [Tue Nov 9 20:08:33 2021] POST /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e/action => generated 14 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:08:33.317236 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-23e673a2-211e-4172-8840-f8aafaabf8ae tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:08:33.318222 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-23e673a2-211e-4172-8840-f8aafaabf8ae tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] [instance: bf7875f5-a01d-4ea9-8d7b-cbe90b7a6418] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:08:33.324265 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-23e673a2-211e-4172-8840-f8aafaabf8ae tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:33.324748 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-23e673a2-211e-4172-8840-f8aafaabf8ae tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:33.325514 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-23e673a2-211e-4172-8840-f8aafaabf8ae tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:33.325945 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-23e673a2-211e-4172-8840-f8aafaabf8ae tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:33.339154 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.wsgi [None req-23e673a2-211e-4172-8840-f8aafaabf8ae tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] HTTP exception thrown: Instance bf7875f5-a01d-4ea9-8d7b-cbe90b7a6418 could not be found. Nov 09 20:08:33.339867 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-23e673a2-211e-4172-8840-f8aafaabf8ae tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] Returning 404 to user: Instance bf7875f5-a01d-4ea9-8d7b-cbe90b7a6418 could not be found. {{(pid=116102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 09 20:08:33.340732 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-23e673a2-211e-4172-8840-f8aafaabf8ae tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] 10.222.0.25 "GET /compute/v2.1/servers/bf7875f5-a01d-4ea9-8d7b-cbe90b7a6418/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.027221 Nov 09 20:08:33.341265 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 73/154] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:08:33 2021] GET /compute/v2.1/servers/bf7875f5-a01d-4ea9-8d7b-cbe90b7a6418/os-volume_attachments => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 09 20:08:33.906424 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [req-3ecbf3b7-fd78-4bfa-8409-20bd1805e08c req-fd501c72-2e8c-43c6-bc13-56b69b36239d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6a36a00-5cfb-4410-8334-2ab671a7c391", "name": "network-vif-plugged", "status": "completed", "tag": "c83057f2-bf67-447d-8bfc-bcddabb1b106"}]} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:08:33.908250 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 20:08:33.908250 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: warnings.warn(msg) Nov 09 20:08:33.917645 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-3ecbf3b7-fd78-4bfa-8409-20bd1805e08c req-fd501c72-2e8c-43c6-bc13-56b69b36239d service nova] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:33.918061 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-3ecbf3b7-fd78-4bfa-8409-20bd1805e08c req-fd501c72-2e8c-43c6-bc13-56b69b36239d service nova] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:33.930511 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.compute.server_external_events [req-3ecbf3b7-fd78-4bfa-8409-20bd1805e08c req-fd501c72-2e8c-43c6-bc13-56b69b36239d service nova] Creating event network-vif-plugged:c83057f2-bf67-447d-8bfc-bcddabb1b106 for instance f6a36a00-5cfb-4410-8334-2ab671a7c391 on hv-cinder-80135 Nov 09 20:08:33.936357 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [req-3ecbf3b7-fd78-4bfa-8409-20bd1805e08c req-fd501c72-2e8c-43c6-bc13-56b69b36239d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033412 Nov 09 20:08:33.937191 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 82/155] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Nov 9 20:08:33 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 20:08:34.106987 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-bc919f11-4db3-41e7-8e8b-38157aa11d59 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:08:34.107862 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-bc919f11-4db3-41e7-8e8b-38157aa11d59 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 10bef0be-b648-4906-b91c-5582ec00cb5c] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:08:34.114451 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-bc919f11-4db3-41e7-8e8b-38157aa11d59 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:34.115975 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-bc919f11-4db3-41e7-8e8b-38157aa11d59 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:34.116832 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-bc919f11-4db3-41e7-8e8b-38157aa11d59 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:34.117269 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-bc919f11-4db3-41e7-8e8b-38157aa11d59 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:34.166656 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-cce217f8-30fb-40e5-bc8d-3fe7b9b1a02a tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:08:34.167341 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-cce217f8-30fb-40e5-bc8d-3fe7b9b1a02a tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] [instance: f6a36a00-5cfb-4410-8334-2ab671a7c391] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:08:34.173759 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cce217f8-30fb-40e5-bc8d-3fe7b9b1a02a tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:34.174204 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cce217f8-30fb-40e5-bc8d-3fe7b9b1a02a tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:34.175690 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cce217f8-30fb-40e5-bc8d-3fe7b9b1a02a tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:34.176123 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cce217f8-30fb-40e5-bc8d-3fe7b9b1a02a tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:34.322362 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-bc919f11-4db3-41e7-8e8b-38157aa11d59 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:08:34.329922 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-bc919f11-4db3-41e7-8e8b-38157aa11d59 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/10bef0be-b648-4906-b91c-5582ec00cb5c" status: 200 len: 1520 microversion: 2.1 time: 0.226564 Nov 09 20:08:34.330662 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 74/156] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:08:34 2021] GET /compute/v2.1/servers/10bef0be-b648-4906-b91c-5582ec00cb5c => generated 1520 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:08:34.335298 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-4c7b783a-d487-46ad-9166-95342bfe2337 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:08:34.336429 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-4c7b783a-d487-46ad-9166-95342bfe2337 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:08:34.342435 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-4c7b783a-d487-46ad-9166-95342bfe2337 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:34.342949 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-4c7b783a-d487-46ad-9166-95342bfe2337 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:34.343835 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-4c7b783a-d487-46ad-9166-95342bfe2337 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:34.344453 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-4c7b783a-d487-46ad-9166-95342bfe2337 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:34.366762 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-cce217f8-30fb-40e5-bc8d-3fe7b9b1a02a tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0fa5fbfbbac4395b0dfd39bdfd9dd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2beabde9f6094ba98b488166018f1748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:08:34.374430 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-cce217f8-30fb-40e5-bc8d-3fe7b9b1a02a tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] 10.222.0.25 "GET /compute/v2.1/servers/f6a36a00-5cfb-4410-8334-2ab671a7c391" status: 200 len: 1314 microversion: 2.1 time: 0.212143 Nov 09 20:08:34.375003 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 83/157] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:08:34 2021] GET /compute/v2.1/servers/f6a36a00-5cfb-4410-8334-2ab671a7c391 => generated 1314 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:08:34.379479 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-730888c5-5db5-4e24-8639-49cb100c7482 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:08:34.381724 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-730888c5-5db5-4e24-8639-49cb100c7482 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:08:34.387536 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-730888c5-5db5-4e24-8639-49cb100c7482 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:34.388022 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-730888c5-5db5-4e24-8639-49cb100c7482 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:34.388796 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-730888c5-5db5-4e24-8639-49cb100c7482 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:34.389220 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-730888c5-5db5-4e24-8639-49cb100c7482 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:34.492804 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-4c7b783a-d487-46ad-9166-95342bfe2337 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "POST /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/action" status: 200 len: 14 microversion: 2.1 time: 0.160615 Nov 09 20:08:34.493762 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 75/158] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Nov 9 20:08:34 2021] POST /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/action => generated 14 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 09 20:08:34.495154 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-730888c5-5db5-4e24-8639-49cb100c7482 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "POST /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e/action" status: 200 len: 14 microversion: 2.20 time: 0.118842 Nov 09 20:08:34.495851 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 84/159] 10.222.0.25 () {62 vars in 1318 bytes} [Tue Nov 9 20:08:34 2021] POST /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e/action => generated 14 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:08:34.539066 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-6531e726-97ab-4cf2-8fe9-a78b9d076f9e tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:08:34.539759 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-6531e726-97ab-4cf2-8fe9-a78b9d076f9e tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] [instance: bf7875f5-a01d-4ea9-8d7b-cbe90b7a6418] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:08:34.546978 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6531e726-97ab-4cf2-8fe9-a78b9d076f9e tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:34.547453 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6531e726-97ab-4cf2-8fe9-a78b9d076f9e tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:34.548228 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6531e726-97ab-4cf2-8fe9-a78b9d076f9e tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:34.548710 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6531e726-97ab-4cf2-8fe9-a78b9d076f9e tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:34.562803 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.wsgi [None req-6531e726-97ab-4cf2-8fe9-a78b9d076f9e tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] HTTP exception thrown: Instance bf7875f5-a01d-4ea9-8d7b-cbe90b7a6418 could not be found. Nov 09 20:08:34.563476 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-6531e726-97ab-4cf2-8fe9-a78b9d076f9e tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] Returning 404 to user: Instance bf7875f5-a01d-4ea9-8d7b-cbe90b7a6418 could not be found. {{(pid=116102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 09 20:08:34.564314 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-6531e726-97ab-4cf2-8fe9-a78b9d076f9e tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] 10.222.0.25 "DELETE /compute/v2.1/servers/bf7875f5-a01d-4ea9-8d7b-cbe90b7a6418" status: 404 len: 111 microversion: 2.1 time: 0.029914 Nov 09 20:08:34.564853 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 76/160] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Nov 9 20:08:34 2021] DELETE /compute/v2.1/servers/bf7875f5-a01d-4ea9-8d7b-cbe90b7a6418 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 09 20:08:34.573299 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-f521ec00-f2cc-4158-b4ab-b6e65392197d tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:08:34.573992 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-f521ec00-f2cc-4158-b4ab-b6e65392197d tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] [instance: bf7875f5-a01d-4ea9-8d7b-cbe90b7a6418] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:08:34.580926 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f521ec00-f2cc-4158-b4ab-b6e65392197d tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:34.581375 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f521ec00-f2cc-4158-b4ab-b6e65392197d tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:34.582150 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f521ec00-f2cc-4158-b4ab-b6e65392197d tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:34.582583 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f521ec00-f2cc-4158-b4ab-b6e65392197d tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:34.596122 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.wsgi [None req-f521ec00-f2cc-4158-b4ab-b6e65392197d tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] HTTP exception thrown: Instance bf7875f5-a01d-4ea9-8d7b-cbe90b7a6418 could not be found. Nov 09 20:08:34.596745 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-f521ec00-f2cc-4158-b4ab-b6e65392197d tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] Returning 404 to user: Instance bf7875f5-a01d-4ea9-8d7b-cbe90b7a6418 could not be found. {{(pid=116103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 09 20:08:34.597576 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-f521ec00-f2cc-4158-b4ab-b6e65392197d tempest-DeleteServersTestJSON-927894387 tempest-DeleteServersTestJSON-927894387-project] 10.222.0.25 "GET /compute/v2.1/servers/bf7875f5-a01d-4ea9-8d7b-cbe90b7a6418" status: 404 len: 111 microversion: 2.1 time: 0.028302 Nov 09 20:08:34.598107 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 85/161] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:08:34 2021] GET /compute/v2.1/servers/bf7875f5-a01d-4ea9-8d7b-cbe90b7a6418 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 09 20:08:35.347080 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-8a577f64-73b0-4a07-8be7-6e9b98b1b44b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:08:35.348375 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-8a577f64-73b0-4a07-8be7-6e9b98b1b44b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 10bef0be-b648-4906-b91c-5582ec00cb5c] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:08:35.356187 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-8a577f64-73b0-4a07-8be7-6e9b98b1b44b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:35.356767 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-8a577f64-73b0-4a07-8be7-6e9b98b1b44b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:35.358104 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-8a577f64-73b0-4a07-8be7-6e9b98b1b44b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:35.358645 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-8a577f64-73b0-4a07-8be7-6e9b98b1b44b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:35.392150 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-3f525a1c-02df-4416-91e6-37cc50ce84ba tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:08:35.393331 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-3f525a1c-02df-4416-91e6-37cc50ce84ba tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] [instance: f6a36a00-5cfb-4410-8334-2ab671a7c391] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:08:35.403519 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3f525a1c-02df-4416-91e6-37cc50ce84ba tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:35.409672 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3f525a1c-02df-4416-91e6-37cc50ce84ba tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:35.410690 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3f525a1c-02df-4416-91e6-37cc50ce84ba tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:35.413944 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3f525a1c-02df-4416-91e6-37cc50ce84ba tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:35.655873 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-8a577f64-73b0-4a07-8be7-6e9b98b1b44b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:08:35.667314 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-8a577f64-73b0-4a07-8be7-6e9b98b1b44b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/10bef0be-b648-4906-b91c-5582ec00cb5c" status: 200 len: 1520 microversion: 2.1 time: 0.324200 Nov 09 20:08:35.668589 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 77/162] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:08:35 2021] GET /compute/v2.1/servers/10bef0be-b648-4906-b91c-5582ec00cb5c => generated 1520 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:08:35.678877 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-f69af34d-851f-4b48-ac87-ca030502887a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:08:35.680045 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-f69af34d-851f-4b48-ac87-ca030502887a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:08:35.702914 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f69af34d-851f-4b48-ac87-ca030502887a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:35.703360 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f69af34d-851f-4b48-ac87-ca030502887a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:35.706964 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f69af34d-851f-4b48-ac87-ca030502887a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:35.707412 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f69af34d-851f-4b48-ac87-ca030502887a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:35.729223 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-3f525a1c-02df-4416-91e6-37cc50ce84ba tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0fa5fbfbbac4395b0dfd39bdfd9dd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2beabde9f6094ba98b488166018f1748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:08:35.736337 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-3f525a1c-02df-4416-91e6-37cc50ce84ba tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] 10.222.0.25 "GET /compute/v2.1/servers/f6a36a00-5cfb-4410-8334-2ab671a7c391" status: 200 len: 1314 microversion: 2.1 time: 0.347874 Nov 09 20:08:35.736987 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 86/163] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:08:35 2021] GET /compute/v2.1/servers/f6a36a00-5cfb-4410-8334-2ab671a7c391 => generated 1314 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:08:35.741964 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-6e894a29-d21a-44e1-96a0-4bb41ba9054e tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:08:35.743219 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-6e894a29-d21a-44e1-96a0-4bb41ba9054e tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:08:35.749327 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6e894a29-d21a-44e1-96a0-4bb41ba9054e tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:35.749981 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6e894a29-d21a-44e1-96a0-4bb41ba9054e tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:35.750911 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6e894a29-d21a-44e1-96a0-4bb41ba9054e tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:35.751496 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6e894a29-d21a-44e1-96a0-4bb41ba9054e tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:35.799123 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-f69af34d-851f-4b48-ac87-ca030502887a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "POST /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/action" status: 200 len: 14 microversion: 2.1 time: 0.125017 Nov 09 20:08:35.799945 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 78/164] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Nov 9 20:08:35 2021] POST /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/action => generated 14 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 09 20:08:35.825772 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-6e894a29-d21a-44e1-96a0-4bb41ba9054e tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "POST /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e/action" status: 200 len: 14 microversion: 2.20 time: 0.086375 Nov 09 20:08:35.826472 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 87/165] 10.222.0.25 () {62 vars in 1318 bytes} [Tue Nov 9 20:08:35 2021] POST /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e/action => generated 14 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:08:36.684779 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-670c3715-09b0-462e-88f0-2dab414d29f0 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:08:36.685552 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-670c3715-09b0-462e-88f0-2dab414d29f0 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 10bef0be-b648-4906-b91c-5582ec00cb5c] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:08:36.691776 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-670c3715-09b0-462e-88f0-2dab414d29f0 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:36.692292 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-670c3715-09b0-462e-88f0-2dab414d29f0 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:36.693278 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-670c3715-09b0-462e-88f0-2dab414d29f0 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:36.693778 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-670c3715-09b0-462e-88f0-2dab414d29f0 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:36.754266 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-da9ae5da-7e2b-4e5d-9828-100e1c689e6a tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:08:36.755126 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-da9ae5da-7e2b-4e5d-9828-100e1c689e6a tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] [instance: f6a36a00-5cfb-4410-8334-2ab671a7c391] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:08:36.763291 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-da9ae5da-7e2b-4e5d-9828-100e1c689e6a tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:36.763999 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-da9ae5da-7e2b-4e5d-9828-100e1c689e6a tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:36.765844 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-da9ae5da-7e2b-4e5d-9828-100e1c689e6a tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:36.766868 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-da9ae5da-7e2b-4e5d-9828-100e1c689e6a tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:36.903184 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-670c3715-09b0-462e-88f0-2dab414d29f0 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:08:36.911068 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-670c3715-09b0-462e-88f0-2dab414d29f0 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/10bef0be-b648-4906-b91c-5582ec00cb5c" status: 200 len: 1520 microversion: 2.1 time: 0.230058 Nov 09 20:08:36.911621 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 79/166] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:08:36 2021] GET /compute/v2.1/servers/10bef0be-b648-4906-b91c-5582ec00cb5c => generated 1520 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:08:36.919370 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-b2c4bf63-6bc5-4cde-b462-75ebeb39f0b8 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:08:36.920181 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-b2c4bf63-6bc5-4cde-b462-75ebeb39f0b8 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:08:36.938589 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b2c4bf63-6bc5-4cde-b462-75ebeb39f0b8 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:36.940785 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b2c4bf63-6bc5-4cde-b462-75ebeb39f0b8 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:36.941736 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b2c4bf63-6bc5-4cde-b462-75ebeb39f0b8 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:36.942530 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b2c4bf63-6bc5-4cde-b462-75ebeb39f0b8 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:37.010072 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-da9ae5da-7e2b-4e5d-9828-100e1c689e6a tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0fa5fbfbbac4395b0dfd39bdfd9dd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2beabde9f6094ba98b488166018f1748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:08:37.017357 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-b2c4bf63-6bc5-4cde-b462-75ebeb39f0b8 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "POST /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/action" status: 200 len: 14 microversion: 2.1 time: 0.101299 Nov 09 20:08:37.018506 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-da9ae5da-7e2b-4e5d-9828-100e1c689e6a tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] 10.222.0.25 "GET /compute/v2.1/servers/f6a36a00-5cfb-4410-8334-2ab671a7c391" status: 200 len: 1498 microversion: 2.1 time: 0.268897 Nov 09 20:08:37.028458 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 88/167] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:08:36 2021] GET /compute/v2.1/servers/f6a36a00-5cfb-4410-8334-2ab671a7c391 => generated 1498 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:08:37.028867 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 80/168] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Nov 9 20:08:36 2021] POST /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/action => generated 14 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 09 20:08:37.028957 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-0cf0fcc3-13f0-47cb-80ab-fe9fc65c24e8 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:08:37.028957 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-0cf0fcc3-13f0-47cb-80ab-fe9fc65c24e8 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:08:37.033375 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0cf0fcc3-13f0-47cb-80ab-fe9fc65c24e8 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:37.034026 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0cf0fcc3-13f0-47cb-80ab-fe9fc65c24e8 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:37.035099 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0cf0fcc3-13f0-47cb-80ab-fe9fc65c24e8 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:37.035992 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0cf0fcc3-13f0-47cb-80ab-fe9fc65c24e8 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:37.122420 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-0cf0fcc3-13f0-47cb-80ab-fe9fc65c24e8 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "POST /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e/action" status: 200 len: 14 microversion: 2.20 time: 0.100781 Nov 09 20:08:37.123206 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 89/169] 10.222.0.25 () {62 vars in 1318 bytes} [Tue Nov 9 20:08:37 2021] POST /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e/action => generated 14 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:08:37.687557 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-3ba7646e-b023-415d-9ee0-519a2dc87950 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:08:37.687992 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-3ba7646e-b023-415d-9ee0-519a2dc87950 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] [instance: f6a36a00-5cfb-4410-8334-2ab671a7c391] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:08:37.696493 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-3ba7646e-b023-415d-9ee0-519a2dc87950 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:37.696921 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-3ba7646e-b023-415d-9ee0-519a2dc87950 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:37.697750 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-3ba7646e-b023-415d-9ee0-519a2dc87950 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:37.698201 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-3ba7646e-b023-415d-9ee0-519a2dc87950 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:37.726435 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-3ba7646e-b023-415d-9ee0-519a2dc87950 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] [instance: f6a36a00-5cfb-4410-8334-2ab671a7c391] Going to try to terminate instance {{(pid=116102) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 09 20:08:37.839847 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-3ba7646e-b023-415d-9ee0-519a2dc87950 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] 10.222.0.25 "DELETE /compute/v2.1/servers/f6a36a00-5cfb-4410-8334-2ab671a7c391" status: 204 len: 0 microversion: 2.1 time: 0.156909 Nov 09 20:08:37.840635 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 81/170] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Nov 9 20:08:37 2021] DELETE /compute/v2.1/servers/f6a36a00-5cfb-4410-8334-2ab671a7c391 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 09 20:08:37.851244 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-9b91e909-d332-4e19-90b5-60d6114c852e tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:08:37.851933 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-9b91e909-d332-4e19-90b5-60d6114c852e tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] [instance: f6a36a00-5cfb-4410-8334-2ab671a7c391] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:08:37.859773 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9b91e909-d332-4e19-90b5-60d6114c852e tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:37.860391 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9b91e909-d332-4e19-90b5-60d6114c852e tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:37.861336 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9b91e909-d332-4e19-90b5-60d6114c852e tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:37.861767 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9b91e909-d332-4e19-90b5-60d6114c852e tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:37.930479 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-66e96d38-616d-4c99-b8bf-996e14ec687d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:08:37.931550 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-66e96d38-616d-4c99-b8bf-996e14ec687d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 10bef0be-b648-4906-b91c-5582ec00cb5c] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:08:37.939902 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-66e96d38-616d-4c99-b8bf-996e14ec687d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:37.941721 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-66e96d38-616d-4c99-b8bf-996e14ec687d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:37.942666 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-66e96d38-616d-4c99-b8bf-996e14ec687d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:37.943483 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-66e96d38-616d-4c99-b8bf-996e14ec687d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:38.137988 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-9b91e909-d332-4e19-90b5-60d6114c852e tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0fa5fbfbbac4395b0dfd39bdfd9dd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2beabde9f6094ba98b488166018f1748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:08:38.149564 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-9b91e909-d332-4e19-90b5-60d6114c852e tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] 10.222.0.25 "GET /compute/v2.1/servers/f6a36a00-5cfb-4410-8334-2ab671a7c391" status: 200 len: 1504 microversion: 2.1 time: 0.304335 Nov 09 20:08:38.150515 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 90/171] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:08:37 2021] GET /compute/v2.1/servers/f6a36a00-5cfb-4410-8334-2ab671a7c391 => generated 1504 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:08:38.157855 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-2d3d1c94-0ebd-4c7a-b992-40006b148f6d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:08:38.159075 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-2d3d1c94-0ebd-4c7a-b992-40006b148f6d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:08:38.171067 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2d3d1c94-0ebd-4c7a-b992-40006b148f6d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:38.172011 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2d3d1c94-0ebd-4c7a-b992-40006b148f6d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:38.173462 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2d3d1c94-0ebd-4c7a-b992-40006b148f6d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:38.174525 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2d3d1c94-0ebd-4c7a-b992-40006b148f6d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:38.255565 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-2d3d1c94-0ebd-4c7a-b992-40006b148f6d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "POST /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/action" status: 200 len: 14 microversion: 2.1 time: 0.103287 Nov 09 20:08:38.256227 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 91/172] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Nov 9 20:08:38 2021] POST /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/action => generated 14 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 09 20:08:38.266233 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-244ef056-d746-4b34-9070-0530ad510fc8 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:08:38.267570 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-244ef056-d746-4b34-9070-0530ad510fc8 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:08:38.276129 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-244ef056-d746-4b34-9070-0530ad510fc8 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:38.277092 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-244ef056-d746-4b34-9070-0530ad510fc8 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:38.278037 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-244ef056-d746-4b34-9070-0530ad510fc8 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:38.278661 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-244ef056-d746-4b34-9070-0530ad510fc8 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:38.306257 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-66e96d38-616d-4c99-b8bf-996e14ec687d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:08:38.319103 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-66e96d38-616d-4c99-b8bf-996e14ec687d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/10bef0be-b648-4906-b91c-5582ec00cb5c" status: 200 len: 1520 microversion: 2.1 time: 0.393193 Nov 09 20:08:38.324878 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 82/173] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:08:37 2021] GET /compute/v2.1/servers/10bef0be-b648-4906-b91c-5582ec00cb5c => generated 1520 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:08:38.356099 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-244ef056-d746-4b34-9070-0530ad510fc8 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "POST /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e/action" status: 200 len: 14 microversion: 2.20 time: 0.098319 Nov 09 20:08:38.359664 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 92/174] 10.222.0.25 () {62 vars in 1318 bytes} [Tue Nov 9 20:08:38 2021] POST /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e/action => generated 14 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:08:39.170485 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-0dafe768-4396-46cb-b146-b51b0b0f7a47 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:08:39.171980 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-0dafe768-4396-46cb-b146-b51b0b0f7a47 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] [instance: f6a36a00-5cfb-4410-8334-2ab671a7c391] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:08:39.186651 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-0dafe768-4396-46cb-b146-b51b0b0f7a47 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:39.187531 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-0dafe768-4396-46cb-b146-b51b0b0f7a47 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:39.188733 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-0dafe768-4396-46cb-b146-b51b0b0f7a47 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:39.189406 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-0dafe768-4396-46cb-b146-b51b0b0f7a47 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:39.267259 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-2eb30952-660a-4c30-8d25-7bee62aeea89 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:08:39.269944 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-2eb30952-660a-4c30-8d25-7bee62aeea89 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:08:39.284159 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2eb30952-660a-4c30-8d25-7bee62aeea89 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:39.286060 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2eb30952-660a-4c30-8d25-7bee62aeea89 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:39.288833 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2eb30952-660a-4c30-8d25-7bee62aeea89 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:39.289773 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2eb30952-660a-4c30-8d25-7bee62aeea89 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:39.379148 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-0dafe768-4396-46cb-b146-b51b0b0f7a47 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0fa5fbfbbac4395b0dfd39bdfd9dd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2beabde9f6094ba98b488166018f1748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:08:39.387258 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-0dafe768-4396-46cb-b146-b51b0b0f7a47 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] 10.222.0.25 "GET /compute/v2.1/servers/f6a36a00-5cfb-4410-8334-2ab671a7c391" status: 200 len: 1504 microversion: 2.1 time: 0.223206 Nov 09 20:08:39.387892 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 83/175] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:08:39 2021] GET /compute/v2.1/servers/f6a36a00-5cfb-4410-8334-2ab671a7c391 => generated 1504 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:08:39.388343 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-2eb30952-660a-4c30-8d25-7bee62aeea89 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "POST /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/action" status: 200 len: 6451 microversion: 2.1 time: 0.125079 Nov 09 20:08:39.389073 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 93/176] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Nov 9 20:08:39 2021] POST /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/action => generated 6451 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:08:39.394211 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-29c34cf4-147f-4d52-88e7-1d34a56df1bf tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:08:39.399766 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-29c34cf4-147f-4d52-88e7-1d34a56df1bf tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:08:39.404555 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-239a5b59-ed43-419c-9781-8651d875b042 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:08:39.405245 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-239a5b59-ed43-419c-9781-8651d875b042 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 10bef0be-b648-4906-b91c-5582ec00cb5c] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:08:39.414371 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-239a5b59-ed43-419c-9781-8651d875b042 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:39.416172 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-239a5b59-ed43-419c-9781-8651d875b042 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:39.418755 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-239a5b59-ed43-419c-9781-8651d875b042 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:39.420149 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-239a5b59-ed43-419c-9781-8651d875b042 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:39.424632 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-29c34cf4-147f-4d52-88e7-1d34a56df1bf tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:39.425364 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-29c34cf4-147f-4d52-88e7-1d34a56df1bf tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:39.426391 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-29c34cf4-147f-4d52-88e7-1d34a56df1bf tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:39.427020 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-29c34cf4-147f-4d52-88e7-1d34a56df1bf tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:39.513284 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-29c34cf4-147f-4d52-88e7-1d34a56df1bf tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "POST /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e/action" status: 200 len: 6451 microversion: 2.20 time: 0.122818 Nov 09 20:08:39.514139 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 94/177] 10.222.0.25 () {62 vars in 1318 bytes} [Tue Nov 9 20:08:39 2021] POST /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e/action => generated 6451 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:08:39.617880 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-239a5b59-ed43-419c-9781-8651d875b042 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:08:39.625981 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-239a5b59-ed43-419c-9781-8651d875b042 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/10bef0be-b648-4906-b91c-5582ec00cb5c" status: 200 len: 1520 microversion: 2.1 time: 0.236639 Nov 09 20:08:39.626854 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 84/178] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:08:39 2021] GET /compute/v2.1/servers/10bef0be-b648-4906-b91c-5582ec00cb5c => generated 1520 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:08:40.403829 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [req-c38bcca5-6054-45bb-9ae3-422c890627c7 req-66f698e2-c1c2-4333-84e5-02a66597904b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6a36a00-5cfb-4410-8334-2ab671a7c391", "name": "network-vif-deleted", "tag": "c83057f2-bf67-447d-8bfc-bcddabb1b106"}]} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:08:40.405458 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 20:08:40.405458 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: warnings.warn(msg) Nov 09 20:08:40.407605 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-2be64703-2f93-4b1b-b23f-6806a87334a3 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:08:40.408353 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-2be64703-2f93-4b1b-b23f-6806a87334a3 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] [instance: f6a36a00-5cfb-4410-8334-2ab671a7c391] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:08:40.415877 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-c38bcca5-6054-45bb-9ae3-422c890627c7 req-66f698e2-c1c2-4333-84e5-02a66597904b service nova] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:40.416678 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-c38bcca5-6054-45bb-9ae3-422c890627c7 req-66f698e2-c1c2-4333-84e5-02a66597904b service nova] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:40.419848 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-2be64703-2f93-4b1b-b23f-6806a87334a3 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:40.422428 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-2be64703-2f93-4b1b-b23f-6806a87334a3 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:40.423169 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-2be64703-2f93-4b1b-b23f-6806a87334a3 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:40.424059 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-2be64703-2f93-4b1b-b23f-6806a87334a3 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:40.437117 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.compute.server_external_events [req-c38bcca5-6054-45bb-9ae3-422c890627c7 req-66f698e2-c1c2-4333-84e5-02a66597904b service nova] Creating event network-vif-deleted:c83057f2-bf67-447d-8bfc-bcddabb1b106 for instance f6a36a00-5cfb-4410-8334-2ab671a7c391 on hv-cinder-80135 Nov 09 20:08:40.442788 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [req-c38bcca5-6054-45bb-9ae3-422c890627c7 req-66f698e2-c1c2-4333-84e5-02a66597904b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045061 Nov 09 20:08:40.450888 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 95/179] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Nov 9 20:08:40 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:08:40.456244 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-22374cdf-80f5-4504-b337-39076d34c77e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:08:40.457676 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-22374cdf-80f5-4504-b337-39076d34c77e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:08:40.469786 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-22374cdf-80f5-4504-b337-39076d34c77e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:40.470587 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-22374cdf-80f5-4504-b337-39076d34c77e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:40.471584 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-22374cdf-80f5-4504-b337-39076d34c77e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:40.472258 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-22374cdf-80f5-4504-b337-39076d34c77e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:40.546563 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-2be64703-2f93-4b1b-b23f-6806a87334a3 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0fa5fbfbbac4395b0dfd39bdfd9dd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2beabde9f6094ba98b488166018f1748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:08:40.556817 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-2be64703-2f93-4b1b-b23f-6806a87334a3 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] 10.222.0.25 "GET /compute/v2.1/servers/f6a36a00-5cfb-4410-8334-2ab671a7c391" status: 200 len: 1299 microversion: 2.1 time: 0.155323 Nov 09 20:08:40.558090 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 85/180] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:08:40 2021] GET /compute/v2.1/servers/f6a36a00-5cfb-4410-8334-2ab671a7c391 => generated 1299 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:08:40.563771 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-fc4cd1d6-d6cf-489c-89e2-4110df26c063 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:08:40.565113 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-fc4cd1d6-d6cf-489c-89e2-4110df26c063 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:08:40.571637 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-22374cdf-80f5-4504-b337-39076d34c77e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "POST /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/action" status: 200 len: 13379 microversion: 2.1 time: 0.119009 Nov 09 20:08:40.572678 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 96/181] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Nov 9 20:08:40 2021] POST /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/action => generated 13379 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 20:08:40.586947 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-fc4cd1d6-d6cf-489c-89e2-4110df26c063 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:40.588989 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-fc4cd1d6-d6cf-489c-89e2-4110df26c063 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:40.590182 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-fc4cd1d6-d6cf-489c-89e2-4110df26c063 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:40.590763 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-fc4cd1d6-d6cf-489c-89e2-4110df26c063 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:40.645457 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-2177c121-41c3-4e7e-aaea-ce2e652d7cba tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:08:40.646266 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-2177c121-41c3-4e7e-aaea-ce2e652d7cba tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 10bef0be-b648-4906-b91c-5582ec00cb5c] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:08:40.655378 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2177c121-41c3-4e7e-aaea-ce2e652d7cba tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:40.655873 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2177c121-41c3-4e7e-aaea-ce2e652d7cba tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:40.657196 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2177c121-41c3-4e7e-aaea-ce2e652d7cba tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:40.658153 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2177c121-41c3-4e7e-aaea-ce2e652d7cba tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:40.698781 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-fc4cd1d6-d6cf-489c-89e2-4110df26c063 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "POST /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e/action" status: 200 len: 12804 microversion: 2.20 time: 0.138530 Nov 09 20:08:40.700636 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 86/182] 10.222.0.25 () {62 vars in 1318 bytes} [Tue Nov 9 20:08:40 2021] POST /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e/action => generated 12804 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 20:08:40.958416 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-2177c121-41c3-4e7e-aaea-ce2e652d7cba tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:08:40.970439 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-2177c121-41c3-4e7e-aaea-ce2e652d7cba tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/10bef0be-b648-4906-b91c-5582ec00cb5c" status: 200 len: 1520 microversion: 2.1 time: 0.329817 Nov 09 20:08:40.971362 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 97/183] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:08:40 2021] GET /compute/v2.1/servers/10bef0be-b648-4906-b91c-5582ec00cb5c => generated 1520 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 20:08:41.574745 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-784eeee6-4dc6-41dd-b517-894f97e8cf0c tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:08:41.575515 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-784eeee6-4dc6-41dd-b517-894f97e8cf0c tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] [instance: f6a36a00-5cfb-4410-8334-2ab671a7c391] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:08:41.582788 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-784eeee6-4dc6-41dd-b517-894f97e8cf0c tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:41.583621 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-784eeee6-4dc6-41dd-b517-894f97e8cf0c tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:41.585388 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-784eeee6-4dc6-41dd-b517-894f97e8cf0c tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:41.586097 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-784eeee6-4dc6-41dd-b517-894f97e8cf0c tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:41.599961 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-3ac8ae67-55fc-4ec2-afb8-0e7c9effdf65 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:08:41.601843 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-3ac8ae67-55fc-4ec2-afb8-0e7c9effdf65 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:08:41.606986 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.wsgi [None req-784eeee6-4dc6-41dd-b517-894f97e8cf0c tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] HTTP exception thrown: Instance f6a36a00-5cfb-4410-8334-2ab671a7c391 could not be found. Nov 09 20:08:41.607701 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-784eeee6-4dc6-41dd-b517-894f97e8cf0c tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Returning 404 to user: Instance f6a36a00-5cfb-4410-8334-2ab671a7c391 could not be found. {{(pid=116102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 09 20:08:41.609047 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-784eeee6-4dc6-41dd-b517-894f97e8cf0c tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] 10.222.0.25 "GET /compute/v2.1/servers/f6a36a00-5cfb-4410-8334-2ab671a7c391" status: 404 len: 111 microversion: 2.1 time: 0.038260 Nov 09 20:08:41.610231 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 87/184] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:08:41 2021] GET /compute/v2.1/servers/f6a36a00-5cfb-4410-8334-2ab671a7c391 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 09 20:08:41.623065 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3ac8ae67-55fc-4ec2-afb8-0e7c9effdf65 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:41.624164 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3ac8ae67-55fc-4ec2-afb8-0e7c9effdf65 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:41.625306 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3ac8ae67-55fc-4ec2-afb8-0e7c9effdf65 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:41.626776 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3ac8ae67-55fc-4ec2-afb8-0e7c9effdf65 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:41.710834 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-3ac8ae67-55fc-4ec2-afb8-0e7c9effdf65 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "POST /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/action" status: 200 len: 17914 microversion: 2.1 time: 0.129791 Nov 09 20:08:41.711792 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-65dbe2e3-481d-4aa1-b711-29a9cb307ee5 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:08:41.712777 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 98/185] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Nov 9 20:08:41 2021] POST /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/action => generated 17914 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 09 20:08:41.713159 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-65dbe2e3-481d-4aa1-b711-29a9cb307ee5 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:08:41.719503 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-65dbe2e3-481d-4aa1-b711-29a9cb307ee5 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:41.720189 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-65dbe2e3-481d-4aa1-b711-29a9cb307ee5 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:41.721024 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-65dbe2e3-481d-4aa1-b711-29a9cb307ee5 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:41.721457 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-65dbe2e3-481d-4aa1-b711-29a9cb307ee5 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:41.801550 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-65dbe2e3-481d-4aa1-b711-29a9cb307ee5 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "POST /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e/action" status: 200 len: 17737 microversion: 2.20 time: 0.093810 Nov 09 20:08:41.803204 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 88/186] 10.222.0.25 () {62 vars in 1318 bytes} [Tue Nov 9 20:08:41 2021] POST /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e/action => generated 17737 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 09 20:08:41.825577 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-6e53a49d-ccb7-46c8-a4b8-4c1685416749 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-915650063", "imageRef": "109ded43-8c19-4f17-afac-7625dcfef942", "flavorRef": "452", "networks": [{"uuid": "753a1e87-4e2f-430f-bcfb-26f496dc16de"}]}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:08:41.898812 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.network.neutron [None req-6e53a49d-ccb7-46c8-a4b8-4c1685416749 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] validate_networks() for [('753a1e87-4e2f-430f-bcfb-26f496dc16de', None, None, None, None, None)] {{(pid=116103) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 09 20:08:41.990945 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-7960230a-1dc8-4721-8fb5-c7abdf4ee433 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:08:41.992099 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-7960230a-1dc8-4721-8fb5-c7abdf4ee433 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 10bef0be-b648-4906-b91c-5582ec00cb5c] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:08:42.001192 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-7960230a-1dc8-4721-8fb5-c7abdf4ee433 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:42.001870 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-7960230a-1dc8-4721-8fb5-c7abdf4ee433 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:42.003121 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-7960230a-1dc8-4721-8fb5-c7abdf4ee433 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:42.003905 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-7960230a-1dc8-4721-8fb5-c7abdf4ee433 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:42.291451 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-7960230a-1dc8-4721-8fb5-c7abdf4ee433 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:08:42.299368 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-7960230a-1dc8-4721-8fb5-c7abdf4ee433 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/10bef0be-b648-4906-b91c-5582ec00cb5c" status: 200 len: 1520 microversion: 2.1 time: 0.313807 Nov 09 20:08:42.300544 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 89/187] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:08:41 2021] GET /compute/v2.1/servers/10bef0be-b648-4906-b91c-5582ec00cb5c => generated 1520 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 20:08:42.409375 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.virt.hardware [None req-6e53a49d-ccb7-46c8-a4b8-4c1685416749 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Flavor limits 0:0:0 {{(pid=116103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 09 20:08:42.409768 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.virt.hardware [None req-6e53a49d-ccb7-46c8-a4b8-4c1685416749 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Image limits 0:0:0 {{(pid=116103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 09 20:08:42.410355 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.virt.hardware [None req-6e53a49d-ccb7-46c8-a4b8-4c1685416749 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Flavor pref 0:0:0 {{(pid=116103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 09 20:08:42.410678 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.virt.hardware [None req-6e53a49d-ccb7-46c8-a4b8-4c1685416749 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Image pref 0:0:0 {{(pid=116103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 09 20:08:42.411034 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.virt.hardware [None req-6e53a49d-ccb7-46c8-a4b8-4c1685416749 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 09 20:08:42.421841 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6e53a49d-ccb7-46c8-a4b8-4c1685416749 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:42.422278 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6e53a49d-ccb7-46c8-a4b8-4c1685416749 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:42.423065 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6e53a49d-ccb7-46c8-a4b8-4c1685416749 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:42.423491 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6e53a49d-ccb7-46c8-a4b8-4c1685416749 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:42.441048 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.quota [None req-6e53a49d-ccb7-46c8-a4b8-4c1685416749 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Getting quotas for project 2beabde9f6094ba98b488166018f1748. Resources: {'cores', 'instances', 'ram'} {{(pid=116103) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 09 20:08:42.445045 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.quota [None req-6e53a49d-ccb7-46c8-a4b8-4c1685416749 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Getting quotas for user e0fa5fbfbbac4395b0dfd39bdfd9dd75 and project 2beabde9f6094ba98b488166018f1748. Resources: {'cores', 'instances', 'ram'} {{(pid=116103) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 09 20:08:42.456096 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-6e53a49d-ccb7-46c8-a4b8-4c1685416749 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Going to run 1 instances... {{(pid=116103) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 09 20:08:42.458987 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-6e53a49d-ccb7-46c8-a4b8-4c1685416749 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] [instance: 7af83497-777d-41ec-9439-e90a042880c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='109ded43-8c19-4f17-afac-7625dcfef942',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116103) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 09 20:08:42.516141 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-6e53a49d-ccb7-46c8-a4b8-4c1685416749 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.698922 Nov 09 20:08:42.518312 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 99/188] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Nov 9 20:08:41 2021] POST /compute/v2.1/servers => generated 380 bytes in 702 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 09 20:08:42.528502 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-8d57691c-5040-4e41-bac9-ec2dbd54a8b0 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:08:42.529128 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-8d57691c-5040-4e41-bac9-ec2dbd54a8b0 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] [instance: 7af83497-777d-41ec-9439-e90a042880c7] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:08:42.623225 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-8d57691c-5040-4e41-bac9-ec2dbd54a8b0 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0fa5fbfbbac4395b0dfd39bdfd9dd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2beabde9f6094ba98b488166018f1748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:08:42.631860 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-8d57691c-5040-4e41-bac9-ec2dbd54a8b0 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] 10.222.0.25 "GET /compute/v2.1/servers/7af83497-777d-41ec-9439-e90a042880c7" status: 200 len: 1213 microversion: 2.1 time: 0.107051 Nov 09 20:08:42.646914 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 90/189] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:08:42 2021] GET /compute/v2.1/servers/7af83497-777d-41ec-9439-e90a042880c7 => generated 1213 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:08:42.723563 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-d06de73c-62e4-4bf9-811f-973dfab20638 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:08:42.725203 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-d06de73c-62e4-4bf9-811f-973dfab20638 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:08:42.736196 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d06de73c-62e4-4bf9-811f-973dfab20638 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:42.736495 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d06de73c-62e4-4bf9-811f-973dfab20638 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:42.737346 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d06de73c-62e4-4bf9-811f-973dfab20638 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:42.737803 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d06de73c-62e4-4bf9-811f-973dfab20638 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:42.815359 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-4199e44f-5a88-4703-af6b-84ddd208418c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:08:42.816332 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-4199e44f-5a88-4703-af6b-84ddd208418c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:08:42.823795 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-4199e44f-5a88-4703-af6b-84ddd208418c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:42.824246 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-4199e44f-5a88-4703-af6b-84ddd208418c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:42.825065 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-4199e44f-5a88-4703-af6b-84ddd208418c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:42.825504 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-4199e44f-5a88-4703-af6b-84ddd208418c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:42.882855 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-d06de73c-62e4-4bf9-811f-973dfab20638 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "POST /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/action" status: 200 len: 18238 microversion: 2.1 time: 0.163380 Nov 09 20:08:42.884090 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 100/190] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Nov 9 20:08:42 2021] POST /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/action => generated 18238 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 20:08:42.961766 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-4199e44f-5a88-4703-af6b-84ddd208418c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "POST /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e/action" status: 200 len: 18449 microversion: 2.20 time: 0.149959 Nov 09 20:08:42.962606 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 91/191] 10.222.0.25 () {62 vars in 1318 bytes} [Tue Nov 9 20:08:42 2021] POST /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e/action => generated 18449 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 20:08:43.326574 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-d259bf4a-6e8a-4533-add8-ff3aef976304 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:08:43.327276 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-d259bf4a-6e8a-4533-add8-ff3aef976304 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 10bef0be-b648-4906-b91c-5582ec00cb5c] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:08:43.335118 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d259bf4a-6e8a-4533-add8-ff3aef976304 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:43.335675 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d259bf4a-6e8a-4533-add8-ff3aef976304 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:43.337224 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d259bf4a-6e8a-4533-add8-ff3aef976304 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:43.337880 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d259bf4a-6e8a-4533-add8-ff3aef976304 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:43.517463 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-d259bf4a-6e8a-4533-add8-ff3aef976304 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:08:43.526162 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-d259bf4a-6e8a-4533-add8-ff3aef976304 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/10bef0be-b648-4906-b91c-5582ec00cb5c" status: 200 len: 1520 microversion: 2.1 time: 0.204050 Nov 09 20:08:43.527177 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 101/192] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:08:43 2021] GET /compute/v2.1/servers/10bef0be-b648-4906-b91c-5582ec00cb5c => generated 1520 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 20:08:43.653745 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-d79717ca-14c1-436f-994d-cdccc307b3f5 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:08:43.654435 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-d79717ca-14c1-436f-994d-cdccc307b3f5 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] [instance: 7af83497-777d-41ec-9439-e90a042880c7] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:08:43.662653 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d79717ca-14c1-436f-994d-cdccc307b3f5 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:43.663814 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d79717ca-14c1-436f-994d-cdccc307b3f5 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:43.665654 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d79717ca-14c1-436f-994d-cdccc307b3f5 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:43.666294 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d79717ca-14c1-436f-994d-cdccc307b3f5 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:43.782452 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-d79717ca-14c1-436f-994d-cdccc307b3f5 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0fa5fbfbbac4395b0dfd39bdfd9dd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2beabde9f6094ba98b488166018f1748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:08:43.790249 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-d79717ca-14c1-436f-994d-cdccc307b3f5 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] 10.222.0.25 "GET /compute/v2.1/servers/7af83497-777d-41ec-9439-e90a042880c7" status: 200 len: 1265 microversion: 2.1 time: 0.140389 Nov 09 20:08:43.800089 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 92/193] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:08:43 2021] GET /compute/v2.1/servers/7af83497-777d-41ec-9439-e90a042880c7 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:08:43.895380 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-fcf0e83f-66f8-42fe-b104-04e9777f857c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:08:43.896443 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-fcf0e83f-66f8-42fe-b104-04e9777f857c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:08:43.904593 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fcf0e83f-66f8-42fe-b104-04e9777f857c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:43.904593 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fcf0e83f-66f8-42fe-b104-04e9777f857c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:43.904593 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fcf0e83f-66f8-42fe-b104-04e9777f857c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:43.916606 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fcf0e83f-66f8-42fe-b104-04e9777f857c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:43.973116 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-c05426cc-6c5d-4edc-926c-0b9bdbcf38b9 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:08:43.974075 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-c05426cc-6c5d-4edc-926c-0b9bdbcf38b9 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:08:43.987245 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c05426cc-6c5d-4edc-926c-0b9bdbcf38b9 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:43.990568 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c05426cc-6c5d-4edc-926c-0b9bdbcf38b9 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:43.991611 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c05426cc-6c5d-4edc-926c-0b9bdbcf38b9 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:43.995571 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c05426cc-6c5d-4edc-926c-0b9bdbcf38b9 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:44.043400 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-fcf0e83f-66f8-42fe-b104-04e9777f857c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "POST /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/action" status: 200 len: 20593 microversion: 2.1 time: 0.151695 Nov 09 20:08:44.044587 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 102/194] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Nov 9 20:08:43 2021] POST /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/action => generated 20593 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 20:08:44.088751 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-c05426cc-6c5d-4edc-926c-0b9bdbcf38b9 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "POST /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e/action" status: 200 len: 20195 microversion: 2.20 time: 0.119042 Nov 09 20:08:44.090350 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 93/195] 10.222.0.25 () {62 vars in 1318 bytes} [Tue Nov 9 20:08:43 2021] POST /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e/action => generated 20195 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 20:08:44.545920 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-6e093423-50b9-4ea2-b856-760b9f7861e7 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:08:44.546748 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-6e093423-50b9-4ea2-b856-760b9f7861e7 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 10bef0be-b648-4906-b91c-5582ec00cb5c] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:08:44.555483 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6e093423-50b9-4ea2-b856-760b9f7861e7 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:44.555954 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6e093423-50b9-4ea2-b856-760b9f7861e7 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:44.559036 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6e093423-50b9-4ea2-b856-760b9f7861e7 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:44.564389 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6e093423-50b9-4ea2-b856-760b9f7861e7 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:44.811222 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-4e111974-680b-4ce1-bea2-e3ea9372eefb tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:08:44.812030 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-4e111974-680b-4ce1-bea2-e3ea9372eefb tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] [instance: 7af83497-777d-41ec-9439-e90a042880c7] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:08:44.838439 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-4e111974-680b-4ce1-bea2-e3ea9372eefb tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:44.839048 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-4e111974-680b-4ce1-bea2-e3ea9372eefb tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:44.840162 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-4e111974-680b-4ce1-bea2-e3ea9372eefb tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:44.842394 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-4e111974-680b-4ce1-bea2-e3ea9372eefb tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:45.040055 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-6e093423-50b9-4ea2-b856-760b9f7861e7 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:08:45.054369 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-6e093423-50b9-4ea2-b856-760b9f7861e7 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/10bef0be-b648-4906-b91c-5582ec00cb5c" status: 200 len: 1520 microversion: 2.1 time: 0.512930 Nov 09 20:08:45.058581 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 103/196] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:08:44 2021] GET /compute/v2.1/servers/10bef0be-b648-4906-b91c-5582ec00cb5c => generated 1520 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:08:45.063126 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-fa92f025-d77e-4191-8997-7e21ae80860b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:08:45.064444 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-fa92f025-d77e-4191-8997-7e21ae80860b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:08:45.072506 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fa92f025-d77e-4191-8997-7e21ae80860b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:45.073134 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fa92f025-d77e-4191-8997-7e21ae80860b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:45.074094 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fa92f025-d77e-4191-8997-7e21ae80860b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:45.074676 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fa92f025-d77e-4191-8997-7e21ae80860b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:45.156358 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-4e111974-680b-4ce1-bea2-e3ea9372eefb tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0fa5fbfbbac4395b0dfd39bdfd9dd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2beabde9f6094ba98b488166018f1748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:08:45.167006 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-4e111974-680b-4ce1-bea2-e3ea9372eefb tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] 10.222.0.25 "GET /compute/v2.1/servers/7af83497-777d-41ec-9439-e90a042880c7" status: 200 len: 1313 microversion: 2.1 time: 0.363055 Nov 09 20:08:45.170126 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 94/197] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:08:44 2021] GET /compute/v2.1/servers/7af83497-777d-41ec-9439-e90a042880c7 => generated 1313 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:08:45.176270 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-69dec86b-a4e1-457e-8b4a-569e1ef1db6b tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:08:45.177287 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-69dec86b-a4e1-457e-8b4a-569e1ef1db6b tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:08:45.192698 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-69dec86b-a4e1-457e-8b4a-569e1ef1db6b tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:45.196654 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-fa92f025-d77e-4191-8997-7e21ae80860b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "POST /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/action" status: 200 len: 22494 microversion: 2.1 time: 0.136798 Nov 09 20:08:45.198102 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 104/198] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Nov 9 20:08:45 2021] POST /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/action => generated 22494 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 20:08:45.198942 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-69dec86b-a4e1-457e-8b4a-569e1ef1db6b tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:45.202792 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-69dec86b-a4e1-457e-8b4a-569e1ef1db6b tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:45.203252 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-69dec86b-a4e1-457e-8b4a-569e1ef1db6b tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:45.290808 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-69dec86b-a4e1-457e-8b4a-569e1ef1db6b tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "POST /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e/action" status: 200 len: 22494 microversion: 2.20 time: 0.119220 Nov 09 20:08:45.294539 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 95/199] 10.222.0.25 () {62 vars in 1318 bytes} [Tue Nov 9 20:08:45 2021] POST /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e/action => generated 22494 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 20:08:45.852068 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [req-13da33b2-095f-43d3-be73-a2624761324f req-3975d104-1887-47e1-a09d-a4cdacad91ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7af83497-777d-41ec-9439-e90a042880c7", "tag": "d36653fe-01e1-435f-91c7-09318aa30f49"}]} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:08:45.856548 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 20:08:45.856548 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: warnings.warn(msg) Nov 09 20:08:45.867456 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-13da33b2-095f-43d3-be73-a2624761324f req-3975d104-1887-47e1-a09d-a4cdacad91ba service nova] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:45.868972 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-13da33b2-095f-43d3-be73-a2624761324f req-3975d104-1887-47e1-a09d-a4cdacad91ba service nova] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:45.894907 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.compute.server_external_events [req-13da33b2-095f-43d3-be73-a2624761324f req-3975d104-1887-47e1-a09d-a4cdacad91ba service nova] Creating event network-changed:d36653fe-01e1-435f-91c7-09318aa30f49 for instance 7af83497-777d-41ec-9439-e90a042880c7 on hv-cinder-80135 Nov 09 20:08:45.899722 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [req-13da33b2-095f-43d3-be73-a2624761324f req-3975d104-1887-47e1-a09d-a4cdacad91ba service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058315 Nov 09 20:08:45.900386 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 105/200] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Nov 9 20:08:45 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:08:46.076339 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-925f9548-8ff4-4018-a309-a2515c007372 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:08:46.077975 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-925f9548-8ff4-4018-a309-a2515c007372 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 10bef0be-b648-4906-b91c-5582ec00cb5c] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:08:46.089595 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-925f9548-8ff4-4018-a309-a2515c007372 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:46.091998 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-925f9548-8ff4-4018-a309-a2515c007372 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:46.094652 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-925f9548-8ff4-4018-a309-a2515c007372 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:46.096158 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-925f9548-8ff4-4018-a309-a2515c007372 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:46.189460 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-4b53b966-499d-4035-be64-f858a8966fda tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:08:46.191008 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-4b53b966-499d-4035-be64-f858a8966fda tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] [instance: 7af83497-777d-41ec-9439-e90a042880c7] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:08:46.214437 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4b53b966-499d-4035-be64-f858a8966fda tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:46.217225 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4b53b966-499d-4035-be64-f858a8966fda tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:46.221211 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4b53b966-499d-4035-be64-f858a8966fda tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:46.222735 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4b53b966-499d-4035-be64-f858a8966fda tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:46.389871 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-925f9548-8ff4-4018-a309-a2515c007372 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:08:46.399259 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-925f9548-8ff4-4018-a309-a2515c007372 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/10bef0be-b648-4906-b91c-5582ec00cb5c" status: 200 len: 1520 microversion: 2.1 time: 0.327959 Nov 09 20:08:46.399838 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 96/201] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:08:46 2021] GET /compute/v2.1/servers/10bef0be-b648-4906-b91c-5582ec00cb5c => generated 1520 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:08:46.415941 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-5865e08c-4046-4e2c-9d18-4e2d237c04e9 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:08:46.419819 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-5865e08c-4046-4e2c-9d18-4e2d237c04e9 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:08:46.428310 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-4b53b966-499d-4035-be64-f858a8966fda tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0fa5fbfbbac4395b0dfd39bdfd9dd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2beabde9f6094ba98b488166018f1748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:08:46.436275 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-4b53b966-499d-4035-be64-f858a8966fda tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] 10.222.0.25 "GET /compute/v2.1/servers/7af83497-777d-41ec-9439-e90a042880c7" status: 200 len: 1313 microversion: 2.1 time: 0.252875 Nov 09 20:08:46.436867 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 106/202] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:08:46 2021] GET /compute/v2.1/servers/7af83497-777d-41ec-9439-e90a042880c7 => generated 1313 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 20:08:46.450353 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-5865e08c-4046-4e2c-9d18-4e2d237c04e9 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:46.451143 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-5865e08c-4046-4e2c-9d18-4e2d237c04e9 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:46.453760 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-1065b3e1-a116-49a9-b7cf-c35eb4a4e359 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:08:46.455158 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-5865e08c-4046-4e2c-9d18-4e2d237c04e9 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:46.455589 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-5865e08c-4046-4e2c-9d18-4e2d237c04e9 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:46.458357 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-1065b3e1-a116-49a9-b7cf-c35eb4a4e359 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:08:46.471111 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1065b3e1-a116-49a9-b7cf-c35eb4a4e359 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:46.477412 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1065b3e1-a116-49a9-b7cf-c35eb4a4e359 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:46.478365 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1065b3e1-a116-49a9-b7cf-c35eb4a4e359 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:46.478842 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1065b3e1-a116-49a9-b7cf-c35eb4a4e359 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:46.562316 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-5865e08c-4046-4e2c-9d18-4e2d237c04e9 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "POST /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/action" status: 200 len: 23901 microversion: 2.1 time: 0.150976 Nov 09 20:08:46.563979 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 97/203] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Nov 9 20:08:46 2021] POST /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/action => generated 23901 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 20:08:46.586631 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-1065b3e1-a116-49a9-b7cf-c35eb4a4e359 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "POST /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e/action" status: 200 len: 23947 microversion: 2.20 time: 0.140737 Nov 09 20:08:46.587509 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 107/204] 10.222.0.25 () {62 vars in 1318 bytes} [Tue Nov 9 20:08:46 2021] POST /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e/action => generated 23947 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 20:08:47.419000 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-4011121f-d0f4-4525-807b-1e4f0a3e327a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:08:47.419693 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-4011121f-d0f4-4525-807b-1e4f0a3e327a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 10bef0be-b648-4906-b91c-5582ec00cb5c] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:08:47.435577 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-4011121f-d0f4-4525-807b-1e4f0a3e327a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:47.436141 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-4011121f-d0f4-4525-807b-1e4f0a3e327a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:47.436983 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-4011121f-d0f4-4525-807b-1e4f0a3e327a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:47.438373 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-4011121f-d0f4-4525-807b-1e4f0a3e327a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:47.454796 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-cd016349-37d3-4a89-9573-cafa10a8cdc2 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:08:47.455793 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-cd016349-37d3-4a89-9573-cafa10a8cdc2 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] [instance: 7af83497-777d-41ec-9439-e90a042880c7] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:08:47.465865 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cd016349-37d3-4a89-9573-cafa10a8cdc2 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:47.466923 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cd016349-37d3-4a89-9573-cafa10a8cdc2 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:47.467924 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cd016349-37d3-4a89-9573-cafa10a8cdc2 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:47.468511 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cd016349-37d3-4a89-9573-cafa10a8cdc2 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:47.665994 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-4011121f-d0f4-4525-807b-1e4f0a3e327a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:08:47.693942 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-4011121f-d0f4-4525-807b-1e4f0a3e327a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/10bef0be-b648-4906-b91c-5582ec00cb5c" status: 200 len: 1520 microversion: 2.1 time: 0.258847 Nov 09 20:08:47.696021 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-cd016349-37d3-4a89-9573-cafa10a8cdc2 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0fa5fbfbbac4395b0dfd39bdfd9dd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2beabde9f6094ba98b488166018f1748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:08:47.706556 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 98/205] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:08:47 2021] GET /compute/v2.1/servers/10bef0be-b648-4906-b91c-5582ec00cb5c => generated 1520 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:08:47.711929 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-d7ebc577-74af-4a5b-ac91-53e62f5dbae5 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:08:47.713100 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-cd016349-37d3-4a89-9573-cafa10a8cdc2 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] 10.222.0.25 "GET /compute/v2.1/servers/7af83497-777d-41ec-9439-e90a042880c7" status: 200 len: 1313 microversion: 2.1 time: 0.263065 Nov 09 20:08:47.713243 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-d7ebc577-74af-4a5b-ac91-53e62f5dbae5 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:08:47.713820 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 108/206] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:08:47 2021] GET /compute/v2.1/servers/7af83497-777d-41ec-9439-e90a042880c7 => generated 1313 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 20:08:47.719096 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-e1a348de-db18-4eb7-82f9-738fc89295fb tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:08:47.719363 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d7ebc577-74af-4a5b-ac91-53e62f5dbae5 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:47.719999 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d7ebc577-74af-4a5b-ac91-53e62f5dbae5 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:47.720564 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-e1a348de-db18-4eb7-82f9-738fc89295fb tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:08:47.721183 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d7ebc577-74af-4a5b-ac91-53e62f5dbae5 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:47.721784 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d7ebc577-74af-4a5b-ac91-53e62f5dbae5 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:47.733330 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e1a348de-db18-4eb7-82f9-738fc89295fb tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:47.733952 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e1a348de-db18-4eb7-82f9-738fc89295fb tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:47.735337 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e1a348de-db18-4eb7-82f9-738fc89295fb tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:47.735817 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e1a348de-db18-4eb7-82f9-738fc89295fb tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:47.809328 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-d7ebc577-74af-4a5b-ac91-53e62f5dbae5 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "POST /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/action" status: 200 len: 25293 microversion: 2.1 time: 0.101238 Nov 09 20:08:47.809966 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 99/207] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Nov 9 20:08:47 2021] POST /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/action => generated 25293 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 20:08:47.838735 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-e1a348de-db18-4eb7-82f9-738fc89295fb tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "POST /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e/action" status: 200 len: 25138 microversion: 2.20 time: 0.122859 Nov 09 20:08:47.839877 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 109/208] 10.222.0.25 () {62 vars in 1318 bytes} [Tue Nov 9 20:08:47 2021] POST /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e/action => generated 25138 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 20:08:48.711450 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-3b64f11a-fc02-47e7-b6cf-26c941fab59b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:08:48.712226 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-3b64f11a-fc02-47e7-b6cf-26c941fab59b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 10bef0be-b648-4906-b91c-5582ec00cb5c] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:08:48.719305 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-3b64f11a-fc02-47e7-b6cf-26c941fab59b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:48.720109 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-3b64f11a-fc02-47e7-b6cf-26c941fab59b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:48.721005 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-3b64f11a-fc02-47e7-b6cf-26c941fab59b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:48.721665 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-3b64f11a-fc02-47e7-b6cf-26c941fab59b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:48.731297 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-d837ddec-25d8-4f26-a139-e2eece457429 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:08:48.732216 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-d837ddec-25d8-4f26-a139-e2eece457429 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] [instance: 7af83497-777d-41ec-9439-e90a042880c7] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:08:48.739495 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d837ddec-25d8-4f26-a139-e2eece457429 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:48.740527 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d837ddec-25d8-4f26-a139-e2eece457429 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:48.741683 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d837ddec-25d8-4f26-a139-e2eece457429 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:48.742417 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d837ddec-25d8-4f26-a139-e2eece457429 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:49.219375 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-d837ddec-25d8-4f26-a139-e2eece457429 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0fa5fbfbbac4395b0dfd39bdfd9dd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2beabde9f6094ba98b488166018f1748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:08:49.236384 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-d837ddec-25d8-4f26-a139-e2eece457429 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] 10.222.0.25 "GET /compute/v2.1/servers/7af83497-777d-41ec-9439-e90a042880c7" status: 200 len: 1313 microversion: 2.1 time: 0.509757 Nov 09 20:08:49.239551 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 110/209] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:08:48 2021] GET /compute/v2.1/servers/7af83497-777d-41ec-9439-e90a042880c7 => generated 1313 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 20:08:49.242446 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-3b64f11a-fc02-47e7-b6cf-26c941fab59b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:08:49.247347 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-057fb7c9-089e-408e-b37f-645664a1bbbb tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:08:49.248264 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-057fb7c9-089e-408e-b37f-645664a1bbbb tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:08:49.256183 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-057fb7c9-089e-408e-b37f-645664a1bbbb tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:49.257032 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-057fb7c9-089e-408e-b37f-645664a1bbbb tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:49.257584 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-3b64f11a-fc02-47e7-b6cf-26c941fab59b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/10bef0be-b648-4906-b91c-5582ec00cb5c" status: 200 len: 1520 microversion: 2.1 time: 0.550297 Nov 09 20:08:49.258316 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-057fb7c9-089e-408e-b37f-645664a1bbbb tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:49.258971 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-057fb7c9-089e-408e-b37f-645664a1bbbb tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:49.269354 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 100/210] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:08:48 2021] GET /compute/v2.1/servers/10bef0be-b648-4906-b91c-5582ec00cb5c => generated 1520 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:08:49.276510 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-d916a4d8-0650-4ff4-867d-b46ab226462a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:08:49.277439 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-d916a4d8-0650-4ff4-867d-b46ab226462a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:08:49.287312 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d916a4d8-0650-4ff4-867d-b46ab226462a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:49.288069 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d916a4d8-0650-4ff4-867d-b46ab226462a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:49.289560 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d916a4d8-0650-4ff4-867d-b46ab226462a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:49.290156 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d916a4d8-0650-4ff4-867d-b46ab226462a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:51.227034 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-057fb7c9-089e-408e-b37f-645664a1bbbb tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "POST /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/action" status: 200 len: 27609 microversion: 2.1 time: 1.983767 Nov 09 20:08:51.227670 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 111/211] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Nov 9 20:08:49 2021] POST /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/action => generated 27609 bytes in 1987 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 20:08:51.235849 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-f0c66f51-6521-4fe7-899e-f3ceadda325c tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:08:51.236632 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-f0c66f51-6521-4fe7-899e-f3ceadda325c tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] [instance: 7af83497-777d-41ec-9439-e90a042880c7] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:08:51.243807 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f0c66f51-6521-4fe7-899e-f3ceadda325c tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:51.244353 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f0c66f51-6521-4fe7-899e-f3ceadda325c tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:51.245170 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f0c66f51-6521-4fe7-899e-f3ceadda325c tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:51.245592 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f0c66f51-6521-4fe7-899e-f3ceadda325c tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:51.269523 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-d916a4d8-0650-4ff4-867d-b46ab226462a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "POST /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e/action" status: 200 len: 27455 microversion: 2.20 time: 1.998593 Nov 09 20:08:51.274531 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 101/212] 10.222.0.25 () {62 vars in 1318 bytes} [Tue Nov 9 20:08:49 2021] POST /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e/action => generated 27455 bytes in 2004 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 20:08:51.289038 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-9fcc98bb-7ffe-4f8d-b11d-f09c077170b9 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:08:51.289960 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-9fcc98bb-7ffe-4f8d-b11d-f09c077170b9 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 10bef0be-b648-4906-b91c-5582ec00cb5c] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:08:51.299373 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-9fcc98bb-7ffe-4f8d-b11d-f09c077170b9 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:51.300019 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-9fcc98bb-7ffe-4f8d-b11d-f09c077170b9 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:51.300986 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-9fcc98bb-7ffe-4f8d-b11d-f09c077170b9 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:51.301705 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-9fcc98bb-7ffe-4f8d-b11d-f09c077170b9 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:51.469447 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-f0c66f51-6521-4fe7-899e-f3ceadda325c tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0fa5fbfbbac4395b0dfd39bdfd9dd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2beabde9f6094ba98b488166018f1748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:08:51.495446 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-f0c66f51-6521-4fe7-899e-f3ceadda325c tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] 10.222.0.25 "GET /compute/v2.1/servers/7af83497-777d-41ec-9439-e90a042880c7" status: 200 len: 1313 microversion: 2.1 time: 0.265581 Nov 09 20:08:51.496911 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 112/213] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:08:51 2021] GET /compute/v2.1/servers/7af83497-777d-41ec-9439-e90a042880c7 => generated 1313 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:08:51.555742 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-9fcc98bb-7ffe-4f8d-b11d-f09c077170b9 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:08:51.566717 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-9fcc98bb-7ffe-4f8d-b11d-f09c077170b9 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/10bef0be-b648-4906-b91c-5582ec00cb5c" status: 200 len: 1520 microversion: 2.1 time: 0.290712 Nov 09 20:08:51.573604 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 102/214] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:08:51 2021] GET /compute/v2.1/servers/10bef0be-b648-4906-b91c-5582ec00cb5c => generated 1520 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:08:52.238968 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-c64b5541-cebf-4dc1-a0fb-55fcd1fe948f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:08:52.240690 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-c64b5541-cebf-4dc1-a0fb-55fcd1fe948f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:08:52.247875 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c64b5541-cebf-4dc1-a0fb-55fcd1fe948f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:52.248492 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c64b5541-cebf-4dc1-a0fb-55fcd1fe948f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:52.249625 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c64b5541-cebf-4dc1-a0fb-55fcd1fe948f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:52.250156 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c64b5541-cebf-4dc1-a0fb-55fcd1fe948f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:52.280913 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-ced9ed6c-f06a-422e-8444-2d95419d4f98 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:08:52.282492 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-ced9ed6c-f06a-422e-8444-2d95419d4f98 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:08:52.292896 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ced9ed6c-f06a-422e-8444-2d95419d4f98 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:52.293643 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ced9ed6c-f06a-422e-8444-2d95419d4f98 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:52.294585 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ced9ed6c-f06a-422e-8444-2d95419d4f98 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:52.295167 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ced9ed6c-f06a-422e-8444-2d95419d4f98 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:52.358208 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-c64b5541-cebf-4dc1-a0fb-55fcd1fe948f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "POST /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/action" status: 200 len: 27798 microversion: 2.1 time: 0.122815 Nov 09 20:08:52.362305 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 113/215] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Nov 9 20:08:52 2021] POST /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/action => generated 27798 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 20:08:52.422064 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-ced9ed6c-f06a-422e-8444-2d95419d4f98 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "POST /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e/action" status: 200 len: 27686 microversion: 2.20 time: 0.144345 Nov 09 20:08:52.423542 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 103/216] 10.222.0.25 () {62 vars in 1318 bytes} [Tue Nov 9 20:08:52 2021] POST /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e/action => generated 27686 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 09 20:08:52.513457 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-976fa014-85bd-467e-ad93-24ccee468012 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:08:52.514334 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-976fa014-85bd-467e-ad93-24ccee468012 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] [instance: 7af83497-777d-41ec-9439-e90a042880c7] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:08:52.530682 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-976fa014-85bd-467e-ad93-24ccee468012 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:52.534153 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-976fa014-85bd-467e-ad93-24ccee468012 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:52.536086 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-976fa014-85bd-467e-ad93-24ccee468012 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:52.540062 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-976fa014-85bd-467e-ad93-24ccee468012 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:52.591837 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-63ad95a3-df78-4565-a36a-4b5c6d363fdd tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:08:52.592564 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-63ad95a3-df78-4565-a36a-4b5c6d363fdd tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 10bef0be-b648-4906-b91c-5582ec00cb5c] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:08:52.615825 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-63ad95a3-df78-4565-a36a-4b5c6d363fdd tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:52.616568 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-63ad95a3-df78-4565-a36a-4b5c6d363fdd tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:52.617434 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-63ad95a3-df78-4565-a36a-4b5c6d363fdd tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:52.618449 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-63ad95a3-df78-4565-a36a-4b5c6d363fdd tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:52.763087 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-976fa014-85bd-467e-ad93-24ccee468012 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0fa5fbfbbac4395b0dfd39bdfd9dd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2beabde9f6094ba98b488166018f1748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:08:52.771919 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-976fa014-85bd-467e-ad93-24ccee468012 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] 10.222.0.25 "GET /compute/v2.1/servers/7af83497-777d-41ec-9439-e90a042880c7" status: 200 len: 1313 microversion: 2.1 time: 0.261734 Nov 09 20:08:52.775204 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 114/217] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:08:52 2021] GET /compute/v2.1/servers/7af83497-777d-41ec-9439-e90a042880c7 => generated 1313 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:08:52.844917 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-63ad95a3-df78-4565-a36a-4b5c6d363fdd tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:08:52.853137 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-63ad95a3-df78-4565-a36a-4b5c6d363fdd tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/10bef0be-b648-4906-b91c-5582ec00cb5c" status: 200 len: 1520 microversion: 2.1 time: 0.266135 Nov 09 20:08:52.853824 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 104/218] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:08:52 2021] GET /compute/v2.1/servers/10bef0be-b648-4906-b91c-5582ec00cb5c => generated 1520 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 20:08:53.370040 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-63f5e056-c2bf-4ed9-99c8-b160315e2635 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:08:53.370974 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-63f5e056-c2bf-4ed9-99c8-b160315e2635 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:08:53.377782 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-63f5e056-c2bf-4ed9-99c8-b160315e2635 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:53.378231 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-63f5e056-c2bf-4ed9-99c8-b160315e2635 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:53.379207 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-63f5e056-c2bf-4ed9-99c8-b160315e2635 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:53.379643 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-63f5e056-c2bf-4ed9-99c8-b160315e2635 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:53.435409 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-59c45b60-d64b-4d9d-bd1b-f9fa0962d47d tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:08:53.436330 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-59c45b60-d64b-4d9d-bd1b-f9fa0962d47d tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:08:53.443363 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-59c45b60-d64b-4d9d-bd1b-f9fa0962d47d tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:53.443924 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-59c45b60-d64b-4d9d-bd1b-f9fa0962d47d tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:53.445557 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-59c45b60-d64b-4d9d-bd1b-f9fa0962d47d tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:53.446835 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-59c45b60-d64b-4d9d-bd1b-f9fa0962d47d tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:55.580075 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-63f5e056-c2bf-4ed9-99c8-b160315e2635 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "POST /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/action" status: 200 len: 27925 microversion: 2.1 time: 2.213433 Nov 09 20:08:55.581471 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 115/219] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Nov 9 20:08:53 2021] POST /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/action => generated 27925 bytes in 2216 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 20:08:55.585968 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-63828aec-655f-4358-a012-2ccbc4e67a8b tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:08:55.586644 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-63828aec-655f-4358-a012-2ccbc4e67a8b tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] [instance: 7af83497-777d-41ec-9439-e90a042880c7] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:08:55.593314 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-63828aec-655f-4358-a012-2ccbc4e67a8b tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:55.593751 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-63828aec-655f-4358-a012-2ccbc4e67a8b tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:55.594504 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-63828aec-655f-4358-a012-2ccbc4e67a8b tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:55.594929 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-63828aec-655f-4358-a012-2ccbc4e67a8b tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:55.614562 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-59c45b60-d64b-4d9d-bd1b-f9fa0962d47d tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "POST /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e/action" status: 200 len: 28083 microversion: 2.20 time: 2.182591 Nov 09 20:08:55.620581 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 105/220] 10.222.0.25 () {62 vars in 1318 bytes} [Tue Nov 9 20:08:53 2021] POST /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e/action => generated 28083 bytes in 2185 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 09 20:08:55.621461 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-cbd9a04b-e2b9-4585-82da-4e72ff6bb3e4 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:08:55.622147 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-cbd9a04b-e2b9-4585-82da-4e72ff6bb3e4 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 10bef0be-b648-4906-b91c-5582ec00cb5c] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:08:55.652022 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-cbd9a04b-e2b9-4585-82da-4e72ff6bb3e4 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:55.652496 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-cbd9a04b-e2b9-4585-82da-4e72ff6bb3e4 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:55.653321 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-cbd9a04b-e2b9-4585-82da-4e72ff6bb3e4 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:55.653721 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-cbd9a04b-e2b9-4585-82da-4e72ff6bb3e4 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:55.769270 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-63828aec-655f-4358-a012-2ccbc4e67a8b tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0fa5fbfbbac4395b0dfd39bdfd9dd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2beabde9f6094ba98b488166018f1748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:08:55.777631 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-63828aec-655f-4358-a012-2ccbc4e67a8b tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] 10.222.0.25 "GET /compute/v2.1/servers/7af83497-777d-41ec-9439-e90a042880c7" status: 200 len: 1313 microversion: 2.1 time: 0.195510 Nov 09 20:08:55.778227 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 116/221] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:08:55 2021] GET /compute/v2.1/servers/7af83497-777d-41ec-9439-e90a042880c7 => generated 1313 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:08:55.783073 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [req-801049d7-b5ba-46d4-911b-2c94aa90f0af req-c5bae1dc-0e12-4121-b693-e31f5275b451 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7af83497-777d-41ec-9439-e90a042880c7", "name": "network-vif-plugged", "status": "completed", "tag": "d36653fe-01e1-435f-91c7-09318aa30f49"}]} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:08:55.784637 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 20:08:55.784637 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: warnings.warn(msg) Nov 09 20:08:55.795536 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-801049d7-b5ba-46d4-911b-2c94aa90f0af req-c5bae1dc-0e12-4121-b693-e31f5275b451 service nova] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:55.796078 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-801049d7-b5ba-46d4-911b-2c94aa90f0af req-c5bae1dc-0e12-4121-b693-e31f5275b451 service nova] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:55.808900 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.compute.server_external_events [req-801049d7-b5ba-46d4-911b-2c94aa90f0af req-c5bae1dc-0e12-4121-b693-e31f5275b451 service nova] Creating event network-vif-plugged:d36653fe-01e1-435f-91c7-09318aa30f49 for instance 7af83497-777d-41ec-9439-e90a042880c7 on hv-cinder-80135 Nov 09 20:08:55.813713 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [req-801049d7-b5ba-46d4-911b-2c94aa90f0af req-c5bae1dc-0e12-4121-b693-e31f5275b451 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034320 Nov 09 20:08:55.814351 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 117/222] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Nov 9 20:08:55 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:08:55.958830 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-cbd9a04b-e2b9-4585-82da-4e72ff6bb3e4 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:08:55.967259 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-cbd9a04b-e2b9-4585-82da-4e72ff6bb3e4 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/10bef0be-b648-4906-b91c-5582ec00cb5c" status: 200 len: 1520 microversion: 2.1 time: 0.350249 Nov 09 20:08:55.967883 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 106/223] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:08:55 2021] GET /compute/v2.1/servers/10bef0be-b648-4906-b91c-5582ec00cb5c => generated 1520 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:08:56.593214 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-8e663165-50e9-4805-9dd4-a3b7e1cabeeb tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:08:56.594232 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-8e663165-50e9-4805-9dd4-a3b7e1cabeeb tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:08:56.602752 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8e663165-50e9-4805-9dd4-a3b7e1cabeeb tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:56.603503 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8e663165-50e9-4805-9dd4-a3b7e1cabeeb tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:56.604553 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8e663165-50e9-4805-9dd4-a3b7e1cabeeb tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:56.605309 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8e663165-50e9-4805-9dd4-a3b7e1cabeeb tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:56.630998 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-9eef0cb4-12cd-4a5c-b514-1f2c3cd6fe20 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:08:56.632141 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-9eef0cb4-12cd-4a5c-b514-1f2c3cd6fe20 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:08:56.640367 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-9eef0cb4-12cd-4a5c-b514-1f2c3cd6fe20 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:56.640797 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-9eef0cb4-12cd-4a5c-b514-1f2c3cd6fe20 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:56.641859 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-9eef0cb4-12cd-4a5c-b514-1f2c3cd6fe20 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:56.642628 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-9eef0cb4-12cd-4a5c-b514-1f2c3cd6fe20 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:56.735617 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-8e663165-50e9-4805-9dd4-a3b7e1cabeeb tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "POST /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/action" status: 200 len: 28221 microversion: 2.1 time: 0.144846 Nov 09 20:08:56.743461 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 118/224] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Nov 9 20:08:56 2021] POST /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/action => generated 28221 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 20:08:56.751789 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-85de7041-c7f4-451d-92d8-3c361c47371a tempest-VolumesNegativeTest-1335498923 tempest-VolumesNegativeTest-1335498923-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1512399792", "imageRef": "109ded43-8c19-4f17-afac-7625dcfef942", "flavorRef": "452"}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:08:56.768105 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-9eef0cb4-12cd-4a5c-b514-1f2c3cd6fe20 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "POST /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e/action" status: 200 len: 28232 microversion: 2.20 time: 0.143121 Nov 09 20:08:56.769130 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 107/225] 10.222.0.25 () {62 vars in 1318 bytes} [Tue Nov 9 20:08:56 2021] POST /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e/action => generated 28232 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 20:08:56.797690 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-e6cbd627-f727-42a6-b289-6df05e347ea5 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:08:56.798670 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-e6cbd627-f727-42a6-b289-6df05e347ea5 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] [instance: 7af83497-777d-41ec-9439-e90a042880c7] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:08:56.808484 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e6cbd627-f727-42a6-b289-6df05e347ea5 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:56.809757 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e6cbd627-f727-42a6-b289-6df05e347ea5 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:56.813056 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e6cbd627-f727-42a6-b289-6df05e347ea5 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:56.813701 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e6cbd627-f727-42a6-b289-6df05e347ea5 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:56.824006 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.network.neutron [None req-85de7041-c7f4-451d-92d8-3c361c47371a tempest-VolumesNegativeTest-1335498923 tempest-VolumesNegativeTest-1335498923-project] validate_networks() for None {{(pid=116103) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 09 20:08:57.188101 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-e6cbd627-f727-42a6-b289-6df05e347ea5 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0fa5fbfbbac4395b0dfd39bdfd9dd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2beabde9f6094ba98b488166018f1748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:08:57.196538 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-e6cbd627-f727-42a6-b289-6df05e347ea5 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] 10.222.0.25 "GET /compute/v2.1/servers/7af83497-777d-41ec-9439-e90a042880c7" status: 200 len: 1313 microversion: 2.1 time: 0.405122 Nov 09 20:08:57.205817 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 108/226] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:08:56 2021] GET /compute/v2.1/servers/7af83497-777d-41ec-9439-e90a042880c7 => generated 1313 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 20:08:57.211486 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-110ba43c-9eef-482a-996e-3d6bd5fae3e9 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:08:57.212091 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-110ba43c-9eef-482a-996e-3d6bd5fae3e9 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 10bef0be-b648-4906-b91c-5582ec00cb5c] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:08:57.218269 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-110ba43c-9eef-482a-996e-3d6bd5fae3e9 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:57.218713 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-110ba43c-9eef-482a-996e-3d6bd5fae3e9 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:57.219495 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-110ba43c-9eef-482a-996e-3d6bd5fae3e9 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:57.219921 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-110ba43c-9eef-482a-996e-3d6bd5fae3e9 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:57.261272 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.virt.hardware [None req-85de7041-c7f4-451d-92d8-3c361c47371a tempest-VolumesNegativeTest-1335498923 tempest-VolumesNegativeTest-1335498923-project] Flavor limits 0:0:0 {{(pid=116103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 09 20:08:57.261739 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.virt.hardware [None req-85de7041-c7f4-451d-92d8-3c361c47371a tempest-VolumesNegativeTest-1335498923 tempest-VolumesNegativeTest-1335498923-project] Image limits 0:0:0 {{(pid=116103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 09 20:08:57.262324 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.virt.hardware [None req-85de7041-c7f4-451d-92d8-3c361c47371a tempest-VolumesNegativeTest-1335498923 tempest-VolumesNegativeTest-1335498923-project] Flavor pref 0:0:0 {{(pid=116103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 09 20:08:57.262742 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.virt.hardware [None req-85de7041-c7f4-451d-92d8-3c361c47371a tempest-VolumesNegativeTest-1335498923 tempest-VolumesNegativeTest-1335498923-project] Image pref 0:0:0 {{(pid=116103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 09 20:08:57.263248 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.virt.hardware [None req-85de7041-c7f4-451d-92d8-3c361c47371a tempest-VolumesNegativeTest-1335498923 tempest-VolumesNegativeTest-1335498923-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 09 20:08:57.273533 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-85de7041-c7f4-451d-92d8-3c361c47371a tempest-VolumesNegativeTest-1335498923 tempest-VolumesNegativeTest-1335498923-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:57.273984 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-85de7041-c7f4-451d-92d8-3c361c47371a tempest-VolumesNegativeTest-1335498923 tempest-VolumesNegativeTest-1335498923-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:57.275207 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-85de7041-c7f4-451d-92d8-3c361c47371a tempest-VolumesNegativeTest-1335498923 tempest-VolumesNegativeTest-1335498923-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:57.275650 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-85de7041-c7f4-451d-92d8-3c361c47371a tempest-VolumesNegativeTest-1335498923 tempest-VolumesNegativeTest-1335498923-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:57.298118 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.quota [None req-85de7041-c7f4-451d-92d8-3c361c47371a tempest-VolumesNegativeTest-1335498923 tempest-VolumesNegativeTest-1335498923-project] Getting quotas for project 13362a810cb04a01ad455f9e12d7c09c. Resources: {'cores', 'instances', 'ram'} {{(pid=116103) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 09 20:08:57.302758 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.quota [None req-85de7041-c7f4-451d-92d8-3c361c47371a tempest-VolumesNegativeTest-1335498923 tempest-VolumesNegativeTest-1335498923-project] Getting quotas for user a524589370ee4a99af09d9d55613b940 and project 13362a810cb04a01ad455f9e12d7c09c. Resources: {'cores', 'instances', 'ram'} {{(pid=116103) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 09 20:08:57.314672 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-85de7041-c7f4-451d-92d8-3c361c47371a tempest-VolumesNegativeTest-1335498923 tempest-VolumesNegativeTest-1335498923-project] Going to run 1 instances... {{(pid=116103) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 09 20:08:57.317353 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-85de7041-c7f4-451d-92d8-3c361c47371a tempest-VolumesNegativeTest-1335498923 tempest-VolumesNegativeTest-1335498923-project] [instance: a584c766-9a09-4ae0-af66-50f92ab01886] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='109ded43-8c19-4f17-afac-7625dcfef942',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116103) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 09 20:08:57.376992 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-110ba43c-9eef-482a-996e-3d6bd5fae3e9 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:08:57.385440 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-85de7041-c7f4-451d-92d8-3c361c47371a tempest-VolumesNegativeTest-1335498923 tempest-VolumesNegativeTest-1335498923-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.640047 Nov 09 20:08:57.387075 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 119/227] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Nov 9 20:08:56 2021] POST /compute/v2.1/servers => generated 380 bytes in 643 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 09 20:08:57.394122 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-110ba43c-9eef-482a-996e-3d6bd5fae3e9 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/10bef0be-b648-4906-b91c-5582ec00cb5c" status: 200 len: 1520 microversion: 2.1 time: 0.182618 Nov 09 20:08:57.395696 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 109/228] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:08:57 2021] GET /compute/v2.1/servers/10bef0be-b648-4906-b91c-5582ec00cb5c => generated 1520 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:08:57.407106 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-e2a3d184-8be4-421f-977c-b185c2eb1229 tempest-VolumesNegativeTest-1335498923 tempest-VolumesNegativeTest-1335498923-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:08:57.407786 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-e2a3d184-8be4-421f-977c-b185c2eb1229 tempest-VolumesNegativeTest-1335498923 tempest-VolumesNegativeTest-1335498923-project] [instance: a584c766-9a09-4ae0-af66-50f92ab01886] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:08:57.461612 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-e2a3d184-8be4-421f-977c-b185c2eb1229 tempest-VolumesNegativeTest-1335498923 tempest-VolumesNegativeTest-1335498923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a524589370ee4a99af09d9d55613b940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13362a810cb04a01ad455f9e12d7c09c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:08:57.469932 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-e2a3d184-8be4-421f-977c-b185c2eb1229 tempest-VolumesNegativeTest-1335498923 tempest-VolumesNegativeTest-1335498923-project] 10.222.0.25 "GET /compute/v2.1/servers/a584c766-9a09-4ae0-af66-50f92ab01886" status: 200 len: 1215 microversion: 2.1 time: 0.076279 Nov 09 20:08:57.470494 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 120/229] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:08:57 2021] GET /compute/v2.1/servers/a584c766-9a09-4ae0-af66-50f92ab01886 => generated 1215 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:08:57.749669 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-62be2382-d1a0-439f-a20c-4cbdc807c830 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:08:57.750809 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-62be2382-d1a0-439f-a20c-4cbdc807c830 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:08:57.765482 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-62be2382-d1a0-439f-a20c-4cbdc807c830 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:57.766026 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-62be2382-d1a0-439f-a20c-4cbdc807c830 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:57.766754 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-62be2382-d1a0-439f-a20c-4cbdc807c830 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:57.767218 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-62be2382-d1a0-439f-a20c-4cbdc807c830 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:57.780751 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-c45cef1c-256a-4fb7-9c94-bddfd9445a54 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:08:57.781841 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-c45cef1c-256a-4fb7-9c94-bddfd9445a54 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:08:57.791872 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c45cef1c-256a-4fb7-9c94-bddfd9445a54 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:57.792321 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c45cef1c-256a-4fb7-9c94-bddfd9445a54 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:08:57.795301 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c45cef1c-256a-4fb7-9c94-bddfd9445a54 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:08:57.795732 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c45cef1c-256a-4fb7-9c94-bddfd9445a54 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:00.383907 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-62be2382-d1a0-439f-a20c-4cbdc807c830 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "POST /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/action" status: 200 len: 28221 microversion: 2.1 time: 2.638085 Nov 09 20:09:00.384635 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 110/230] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Nov 9 20:08:57 2021] POST /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/action => generated 28221 bytes in 2640 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 20:09:00.389001 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-c45cef1c-256a-4fb7-9c94-bddfd9445a54 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "POST /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e/action" status: 200 len: 28232 microversion: 2.20 time: 2.612109 Nov 09 20:09:00.390530 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 121/231] 10.222.0.25 () {62 vars in 1318 bytes} [Tue Nov 9 20:08:57 2021] POST /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e/action => generated 28232 bytes in 2615 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 09 20:09:00.391407 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-a9cd3ad0-aa69-42be-8422-d401a584f934 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:09:00.392188 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-a9cd3ad0-aa69-42be-8422-d401a584f934 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] [instance: 7af83497-777d-41ec-9439-e90a042880c7] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:09:00.397368 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-dbde872c-01dc-43d2-bd0d-36d772122649 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:09:00.398066 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-dbde872c-01dc-43d2-bd0d-36d772122649 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 10bef0be-b648-4906-b91c-5582ec00cb5c] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:09:00.399569 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a9cd3ad0-aa69-42be-8422-d401a584f934 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:00.400127 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a9cd3ad0-aa69-42be-8422-d401a584f934 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:00.401064 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a9cd3ad0-aa69-42be-8422-d401a584f934 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:00.401716 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a9cd3ad0-aa69-42be-8422-d401a584f934 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:00.404316 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-dbde872c-01dc-43d2-bd0d-36d772122649 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:00.404796 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-dbde872c-01dc-43d2-bd0d-36d772122649 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:00.405625 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-dbde872c-01dc-43d2-bd0d-36d772122649 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:00.406164 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-dbde872c-01dc-43d2-bd0d-36d772122649 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:00.600388 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-a9cd3ad0-aa69-42be-8422-d401a584f934 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0fa5fbfbbac4395b0dfd39bdfd9dd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2beabde9f6094ba98b488166018f1748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:09:00.607839 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-a9cd3ad0-aa69-42be-8422-d401a584f934 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] 10.222.0.25 "GET /compute/v2.1/servers/7af83497-777d-41ec-9439-e90a042880c7" status: 200 len: 1313 microversion: 2.1 time: 0.222159 Nov 09 20:09:00.608420 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 111/232] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:09:00 2021] GET /compute/v2.1/servers/7af83497-777d-41ec-9439-e90a042880c7 => generated 1313 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:09:00.611978 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-dbde872c-01dc-43d2-bd0d-36d772122649 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:09:00.612721 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-6c917597-8d10-423d-8930-07e32da2c3ba tempest-VolumesNegativeTest-1335498923 tempest-VolumesNegativeTest-1335498923-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:09:00.613318 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-6c917597-8d10-423d-8930-07e32da2c3ba tempest-VolumesNegativeTest-1335498923 tempest-VolumesNegativeTest-1335498923-project] [instance: a584c766-9a09-4ae0-af66-50f92ab01886] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:09:00.619525 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6c917597-8d10-423d-8930-07e32da2c3ba tempest-VolumesNegativeTest-1335498923 tempest-VolumesNegativeTest-1335498923-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:00.619959 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6c917597-8d10-423d-8930-07e32da2c3ba tempest-VolumesNegativeTest-1335498923 tempest-VolumesNegativeTest-1335498923-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:00.620706 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-dbde872c-01dc-43d2-bd0d-36d772122649 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/10bef0be-b648-4906-b91c-5582ec00cb5c" status: 200 len: 1520 microversion: 2.1 time: 0.228844 Nov 09 20:09:00.620939 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6c917597-8d10-423d-8930-07e32da2c3ba tempest-VolumesNegativeTest-1335498923 tempest-VolumesNegativeTest-1335498923-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:00.621301 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 122/233] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:09:00 2021] GET /compute/v2.1/servers/10bef0be-b648-4906-b91c-5582ec00cb5c => generated 1520 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:09:00.621420 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6c917597-8d10-423d-8930-07e32da2c3ba tempest-VolumesNegativeTest-1335498923 tempest-VolumesNegativeTest-1335498923-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:00.683274 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-6c917597-8d10-423d-8930-07e32da2c3ba tempest-VolumesNegativeTest-1335498923 tempest-VolumesNegativeTest-1335498923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a524589370ee4a99af09d9d55613b940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13362a810cb04a01ad455f9e12d7c09c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:09:00.690401 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-6c917597-8d10-423d-8930-07e32da2c3ba tempest-VolumesNegativeTest-1335498923 tempest-VolumesNegativeTest-1335498923-project] 10.222.0.25 "GET /compute/v2.1/servers/a584c766-9a09-4ae0-af66-50f92ab01886" status: 200 len: 1267 microversion: 2.1 time: 0.081055 Nov 09 20:09:00.690955 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 112/234] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:09:00 2021] GET /compute/v2.1/servers/a584c766-9a09-4ae0-af66-50f92ab01886 => generated 1267 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:09:01.076683 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-f82d78f9-11ac-4d78-83ca-dcfd8241b9d1 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-846803671", "imageRef": "109ded43-8c19-4f17-afac-7625dcfef942", "flavorRef": "452", "networks": [{"uuid": "32873de2-bb5b-4ab8-8b44-11a0a374ab76"}]}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:09:01.171721 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.network.neutron [None req-f82d78f9-11ac-4d78-83ca-dcfd8241b9d1 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] validate_networks() for [('32873de2-bb5b-4ab8-8b44-11a0a374ab76', None, None, None, None, None)] {{(pid=116103) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 09 20:09:01.404123 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-9e02ab5a-15a5-4083-985f-988a68bdf47a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:09:01.410135 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-9e02ab5a-15a5-4083-985f-988a68bdf47a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:09:01.435277 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-9e02ab5a-15a5-4083-985f-988a68bdf47a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:01.435853 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-9e02ab5a-15a5-4083-985f-988a68bdf47a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:01.436913 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-9e02ab5a-15a5-4083-985f-988a68bdf47a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:01.438176 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-9e02ab5a-15a5-4083-985f-988a68bdf47a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:01.527984 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-9e02ab5a-15a5-4083-985f-988a68bdf47a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "POST /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/action" status: 200 len: 28221 microversion: 2.1 time: 0.135363 Nov 09 20:09:01.529516 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 113/235] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Nov 9 20:09:01 2021] POST /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/action => generated 28221 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 09 20:09:01.545950 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-c952ad5f-58b1-49b4-88a3-c410fc2dc391 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:09:01.551314 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-c952ad5f-58b1-49b4-88a3-c410fc2dc391 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:09:01.563547 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c952ad5f-58b1-49b4-88a3-c410fc2dc391 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:01.565176 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c952ad5f-58b1-49b4-88a3-c410fc2dc391 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:01.566217 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c952ad5f-58b1-49b4-88a3-c410fc2dc391 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:01.566800 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c952ad5f-58b1-49b4-88a3-c410fc2dc391 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:01.667697 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-c952ad5f-58b1-49b4-88a3-c410fc2dc391 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "POST /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e/action" status: 200 len: 28232 microversion: 2.20 time: 0.136596 Nov 09 20:09:01.668349 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 114/236] 10.222.0.25 () {62 vars in 1318 bytes} [Tue Nov 9 20:09:01 2021] POST /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e/action => generated 28232 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 20:09:01.682598 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-60b8b475-904a-44ad-9e8f-183db02e4be4 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:09:01.683468 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-60b8b475-904a-44ad-9e8f-183db02e4be4 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] [instance: 7af83497-777d-41ec-9439-e90a042880c7] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:09:01.690909 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-60b8b475-904a-44ad-9e8f-183db02e4be4 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:01.691719 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-60b8b475-904a-44ad-9e8f-183db02e4be4 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:01.693401 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-60b8b475-904a-44ad-9e8f-183db02e4be4 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:01.694020 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-60b8b475-904a-44ad-9e8f-183db02e4be4 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:01.876282 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.virt.hardware [None req-f82d78f9-11ac-4d78-83ca-dcfd8241b9d1 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Flavor limits 0:0:0 {{(pid=116103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 09 20:09:01.877358 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.virt.hardware [None req-f82d78f9-11ac-4d78-83ca-dcfd8241b9d1 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Image limits 0:0:0 {{(pid=116103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 09 20:09:01.878017 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.virt.hardware [None req-f82d78f9-11ac-4d78-83ca-dcfd8241b9d1 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Flavor pref 0:0:0 {{(pid=116103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 09 20:09:01.878749 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.virt.hardware [None req-f82d78f9-11ac-4d78-83ca-dcfd8241b9d1 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Image pref 0:0:0 {{(pid=116103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 09 20:09:01.879531 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.virt.hardware [None req-f82d78f9-11ac-4d78-83ca-dcfd8241b9d1 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 09 20:09:01.909260 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f82d78f9-11ac-4d78-83ca-dcfd8241b9d1 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:01.912266 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f82d78f9-11ac-4d78-83ca-dcfd8241b9d1 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:01.917776 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f82d78f9-11ac-4d78-83ca-dcfd8241b9d1 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:01.918481 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f82d78f9-11ac-4d78-83ca-dcfd8241b9d1 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:01.938423 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.quota [None req-f82d78f9-11ac-4d78-83ca-dcfd8241b9d1 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Getting quotas for project bb677ce693194a32b39358f5b613069f. Resources: {'cores', 'instances', 'ram'} {{(pid=116103) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 09 20:09:01.943256 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.quota [None req-f82d78f9-11ac-4d78-83ca-dcfd8241b9d1 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Getting quotas for user d7370bcbf19947a7bb00ab954a6f2d95 and project bb677ce693194a32b39358f5b613069f. Resources: {'cores', 'instances', 'ram'} {{(pid=116103) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 09 20:09:01.947251 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-60b8b475-904a-44ad-9e8f-183db02e4be4 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0fa5fbfbbac4395b0dfd39bdfd9dd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2beabde9f6094ba98b488166018f1748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:09:01.955274 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-f82d78f9-11ac-4d78-83ca-dcfd8241b9d1 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Going to run 1 instances... {{(pid=116103) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 09 20:09:01.956464 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-60b8b475-904a-44ad-9e8f-183db02e4be4 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] 10.222.0.25 "GET /compute/v2.1/servers/7af83497-777d-41ec-9439-e90a042880c7" status: 200 len: 1497 microversion: 2.1 time: 0.279087 Nov 09 20:09:01.957052 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 115/237] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:09:01 2021] GET /compute/v2.1/servers/7af83497-777d-41ec-9439-e90a042880c7 => generated 1497 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:09:01.963301 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-d286388d-17c9-4cb5-939f-44ccac7bf52d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:09:01.964084 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-d286388d-17c9-4cb5-939f-44ccac7bf52d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 10bef0be-b648-4906-b91c-5582ec00cb5c] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:09:01.969790 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-f82d78f9-11ac-4d78-83ca-dcfd8241b9d1 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='109ded43-8c19-4f17-afac-7625dcfef942',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116103) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 09 20:09:01.970958 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d286388d-17c9-4cb5-939f-44ccac7bf52d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:01.972093 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d286388d-17c9-4cb5-939f-44ccac7bf52d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:01.973230 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d286388d-17c9-4cb5-939f-44ccac7bf52d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:01.973904 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d286388d-17c9-4cb5-939f-44ccac7bf52d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:02.040529 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-f82d78f9-11ac-4d78-83ca-dcfd8241b9d1 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.967883 Nov 09 20:09:02.044096 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 123/238] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Nov 9 20:09:01 2021] POST /compute/v2.1/servers => generated 380 bytes in 971 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 09 20:09:02.055341 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-f4ab75af-11f1-45c1-886e-57a2317dd345 tempest-VolumesNegativeTest-1335498923 tempest-VolumesNegativeTest-1335498923-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:09:02.056964 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-f4ab75af-11f1-45c1-886e-57a2317dd345 tempest-VolumesNegativeTest-1335498923 tempest-VolumesNegativeTest-1335498923-project] [instance: a584c766-9a09-4ae0-af66-50f92ab01886] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:09:02.066022 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f4ab75af-11f1-45c1-886e-57a2317dd345 tempest-VolumesNegativeTest-1335498923 tempest-VolumesNegativeTest-1335498923-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:02.066696 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f4ab75af-11f1-45c1-886e-57a2317dd345 tempest-VolumesNegativeTest-1335498923 tempest-VolumesNegativeTest-1335498923-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:02.067960 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f4ab75af-11f1-45c1-886e-57a2317dd345 tempest-VolumesNegativeTest-1335498923 tempest-VolumesNegativeTest-1335498923-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:02.068818 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f4ab75af-11f1-45c1-886e-57a2317dd345 tempest-VolumesNegativeTest-1335498923 tempest-VolumesNegativeTest-1335498923-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:02.165401 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-d286388d-17c9-4cb5-939f-44ccac7bf52d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:09:02.175149 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-d286388d-17c9-4cb5-939f-44ccac7bf52d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/10bef0be-b648-4906-b91c-5582ec00cb5c" status: 200 len: 1500 microversion: 2.1 time: 0.216683 Nov 09 20:09:02.176441 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 116/239] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:09:01 2021] GET /compute/v2.1/servers/10bef0be-b648-4906-b91c-5582ec00cb5c => generated 1500 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:09:02.182175 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-a9674681-c9b4-4201-ab9b-4675537aaba0 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:09:02.183137 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-a9674681-c9b4-4201-ab9b-4675537aaba0 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:09:02.194775 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-f4ab75af-11f1-45c1-886e-57a2317dd345 tempest-VolumesNegativeTest-1335498923 tempest-VolumesNegativeTest-1335498923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a524589370ee4a99af09d9d55613b940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13362a810cb04a01ad455f9e12d7c09c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:09:02.202422 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-f4ab75af-11f1-45c1-886e-57a2317dd345 tempest-VolumesNegativeTest-1335498923 tempest-VolumesNegativeTest-1335498923-project] 10.222.0.25 "GET /compute/v2.1/servers/a584c766-9a09-4ae0-af66-50f92ab01886" status: 200 len: 1273 microversion: 2.1 time: 0.156946 Nov 09 20:09:02.202999 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 124/240] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:09:02 2021] GET /compute/v2.1/servers/a584c766-9a09-4ae0-af66-50f92ab01886 => generated 1273 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:09:02.207347 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-fc03df9e-fc28-46c0-9553-761e90941f59 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:09:02.207995 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-fc03df9e-fc28-46c0-9553-761e90941f59 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:09:02.214447 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fc03df9e-fc28-46c0-9553-761e90941f59 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:02.214965 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fc03df9e-fc28-46c0-9553-761e90941f59 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:02.215752 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fc03df9e-fc28-46c0-9553-761e90941f59 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:02.216176 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fc03df9e-fc28-46c0-9553-761e90941f59 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:02.279606 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-a9674681-c9b4-4201-ab9b-4675537aaba0 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:09:02.291675 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-a9674681-c9b4-4201-ab9b-4675537aaba0 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1218 microversion: 2.1 time: 0.113053 Nov 09 20:09:02.293783 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 117/241] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:09:02 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1218 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:09:02.431993 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-fc03df9e-fc28-46c0-9553-761e90941f59 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:09:02.441046 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-fc03df9e-fc28-46c0-9553-761e90941f59 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1515 microversion: 2.1 time: 0.236976 Nov 09 20:09:02.442439 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 125/242] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:09:02 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1515 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:09:02.550376 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-03727efc-859e-4478-a2cd-ec46c8136e48 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:09:02.551715 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-03727efc-859e-4478-a2cd-ec46c8136e48 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:09:02.560660 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-03727efc-859e-4478-a2cd-ec46c8136e48 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:02.561597 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-03727efc-859e-4478-a2cd-ec46c8136e48 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:02.562858 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-03727efc-859e-4478-a2cd-ec46c8136e48 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:02.563457 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-03727efc-859e-4478-a2cd-ec46c8136e48 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:02.671288 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-03727efc-859e-4478-a2cd-ec46c8136e48 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "POST /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/action" status: 200 len: 28346 microversion: 2.1 time: 0.134618 Nov 09 20:09:02.672171 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 118/243] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Nov 9 20:09:02 2021] POST /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/action => generated 28346 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 20:09:02.682497 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-e139355b-4d78-45d6-ac49-62a3268dba61 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:09:02.683732 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-e139355b-4d78-45d6-ac49-62a3268dba61 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:09:02.713575 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e139355b-4d78-45d6-ac49-62a3268dba61 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:02.714020 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e139355b-4d78-45d6-ac49-62a3268dba61 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:02.714821 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e139355b-4d78-45d6-ac49-62a3268dba61 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:02.715433 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e139355b-4d78-45d6-ac49-62a3268dba61 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:02.756793 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-078d6049-33be-4f6a-8c27-50fb2a009b14 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:09:02.757864 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-078d6049-33be-4f6a-8c27-50fb2a009b14 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] [instance: 7af83497-777d-41ec-9439-e90a042880c7] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:09:02.766926 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-078d6049-33be-4f6a-8c27-50fb2a009b14 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:02.768031 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-078d6049-33be-4f6a-8c27-50fb2a009b14 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:02.769472 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-078d6049-33be-4f6a-8c27-50fb2a009b14 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:02.770435 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-078d6049-33be-4f6a-8c27-50fb2a009b14 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:02.802665 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-078d6049-33be-4f6a-8c27-50fb2a009b14 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] [instance: 7af83497-777d-41ec-9439-e90a042880c7] Going to try to terminate instance {{(pid=116102) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 09 20:09:02.884272 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-e139355b-4d78-45d6-ac49-62a3268dba61 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "POST /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e/action" status: 200 len: 28474 microversion: 2.20 time: 0.207490 Nov 09 20:09:02.888499 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 126/244] 10.222.0.25 () {62 vars in 1318 bytes} [Tue Nov 9 20:09:02 2021] POST /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e/action => generated 28474 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 20:09:02.939208 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-078d6049-33be-4f6a-8c27-50fb2a009b14 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] 10.222.0.25 "DELETE /compute/v2.1/servers/7af83497-777d-41ec-9439-e90a042880c7" status: 204 len: 0 microversion: 2.1 time: 0.187325 Nov 09 20:09:02.940324 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 119/245] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Nov 9 20:09:02 2021] DELETE /compute/v2.1/servers/7af83497-777d-41ec-9439-e90a042880c7 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 09 20:09:02.956611 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-fd2ddb79-3b3d-4b38-8fde-16afe828849b tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:09:02.957579 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-fd2ddb79-3b3d-4b38-8fde-16afe828849b tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] [instance: 7af83497-777d-41ec-9439-e90a042880c7] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:09:02.966912 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fd2ddb79-3b3d-4b38-8fde-16afe828849b tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:02.967432 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fd2ddb79-3b3d-4b38-8fde-16afe828849b tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:02.968221 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fd2ddb79-3b3d-4b38-8fde-16afe828849b tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:02.968892 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fd2ddb79-3b3d-4b38-8fde-16afe828849b tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:03.196354 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-fd2ddb79-3b3d-4b38-8fde-16afe828849b tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0fa5fbfbbac4395b0dfd39bdfd9dd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2beabde9f6094ba98b488166018f1748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:09:03.205689 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-fd2ddb79-3b3d-4b38-8fde-16afe828849b tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] 10.222.0.25 "GET /compute/v2.1/servers/7af83497-777d-41ec-9439-e90a042880c7" status: 200 len: 1503 microversion: 2.1 time: 0.259711 Nov 09 20:09:03.206488 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 127/246] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:09:02 2021] GET /compute/v2.1/servers/7af83497-777d-41ec-9439-e90a042880c7 => generated 1503 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:09:03.221026 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-4c9dc916-1a73-4764-a1fa-e5216eff58b7 tempest-VolumesNegativeTest-1335498923 tempest-VolumesNegativeTest-1335498923-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:09:03.221731 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-4c9dc916-1a73-4764-a1fa-e5216eff58b7 tempest-VolumesNegativeTest-1335498923 tempest-VolumesNegativeTest-1335498923-project] [instance: a584c766-9a09-4ae0-af66-50f92ab01886] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:09:03.231835 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-4c9dc916-1a73-4764-a1fa-e5216eff58b7 tempest-VolumesNegativeTest-1335498923 tempest-VolumesNegativeTest-1335498923-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:03.232285 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-4c9dc916-1a73-4764-a1fa-e5216eff58b7 tempest-VolumesNegativeTest-1335498923 tempest-VolumesNegativeTest-1335498923-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:03.233159 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-4c9dc916-1a73-4764-a1fa-e5216eff58b7 tempest-VolumesNegativeTest-1335498923 tempest-VolumesNegativeTest-1335498923-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:03.233593 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-4c9dc916-1a73-4764-a1fa-e5216eff58b7 tempest-VolumesNegativeTest-1335498923 tempest-VolumesNegativeTest-1335498923-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:03.256614 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [req-06ff4bf3-21bb-42d7-92a6-7ec1eddd0963 req-4997ff52-6f23-46f2-835d-59c61b73da98 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a584c766-9a09-4ae0-af66-50f92ab01886", "tag": "3fd3fcd5-ca67-4fea-b422-278c129e1d72"}]} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:09:03.259677 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 20:09:03.259677 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: warnings.warn(msg) Nov 09 20:09:03.269612 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-06ff4bf3-21bb-42d7-92a6-7ec1eddd0963 req-4997ff52-6f23-46f2-835d-59c61b73da98 service nova] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:03.270275 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-06ff4bf3-21bb-42d7-92a6-7ec1eddd0963 req-4997ff52-6f23-46f2-835d-59c61b73da98 service nova] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:03.282873 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.compute.server_external_events [req-06ff4bf3-21bb-42d7-92a6-7ec1eddd0963 req-4997ff52-6f23-46f2-835d-59c61b73da98 service nova] Creating event network-changed:3fd3fcd5-ca67-4fea-b422-278c129e1d72 for instance a584c766-9a09-4ae0-af66-50f92ab01886 on hv-cinder-80135 Nov 09 20:09:03.298262 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [req-06ff4bf3-21bb-42d7-92a6-7ec1eddd0963 req-4997ff52-6f23-46f2-835d-59c61b73da98 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047145 Nov 09 20:09:03.299438 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 128/247] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Nov 9 20:09:03 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 20:09:03.311619 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-9db064e9-d1e9-4416-a1d6-57e9d81c71c3 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:09:03.315762 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-9db064e9-d1e9-4416-a1d6-57e9d81c71c3 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:09:03.323802 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9db064e9-d1e9-4416-a1d6-57e9d81c71c3 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:03.324252 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9db064e9-d1e9-4416-a1d6-57e9d81c71c3 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:03.325067 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9db064e9-d1e9-4416-a1d6-57e9d81c71c3 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:03.325511 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9db064e9-d1e9-4416-a1d6-57e9d81c71c3 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:03.431564 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-9db064e9-d1e9-4416-a1d6-57e9d81c71c3 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:09:03.440373 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-9db064e9-d1e9-4416-a1d6-57e9d81c71c3 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1270 microversion: 2.1 time: 0.133283 Nov 09 20:09:03.444657 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-4c9dc916-1a73-4764-a1fa-e5216eff58b7 tempest-VolumesNegativeTest-1335498923 tempest-VolumesNegativeTest-1335498923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a524589370ee4a99af09d9d55613b940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13362a810cb04a01ad455f9e12d7c09c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:09:03.448849 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 129/248] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:09:03 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1270 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 20:09:03.465328 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-4c9dc916-1a73-4764-a1fa-e5216eff58b7 tempest-VolumesNegativeTest-1335498923 tempest-VolumesNegativeTest-1335498923-project] 10.222.0.25 "GET /compute/v2.1/servers/a584c766-9a09-4ae0-af66-50f92ab01886" status: 200 len: 1315 microversion: 2.1 time: 0.248495 Nov 09 20:09:03.466038 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 120/249] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:09:03 2021] GET /compute/v2.1/servers/a584c766-9a09-4ae0-af66-50f92ab01886 => generated 1315 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 20:09:03.683644 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-f3a41f13-5b31-4192-9ea0-3b655e2eb1aa tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:09:03.684557 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-f3a41f13-5b31-4192-9ea0-3b655e2eb1aa tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:09:03.690754 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f3a41f13-5b31-4192-9ea0-3b655e2eb1aa tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:03.691203 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f3a41f13-5b31-4192-9ea0-3b655e2eb1aa tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:03.691981 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f3a41f13-5b31-4192-9ea0-3b655e2eb1aa tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:03.692423 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f3a41f13-5b31-4192-9ea0-3b655e2eb1aa tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:03.813264 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-f3a41f13-5b31-4192-9ea0-3b655e2eb1aa tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "POST /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/action" status: 200 len: 28511 microversion: 2.1 time: 0.133425 Nov 09 20:09:03.814157 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 130/250] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Nov 9 20:09:03 2021] POST /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/action => generated 28511 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 20:09:03.898499 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-0e88ef45-d75c-4622-bd76-785695d6d2c0 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:09:03.899598 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-0e88ef45-d75c-4622-bd76-785695d6d2c0 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:09:03.906006 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-0e88ef45-d75c-4622-bd76-785695d6d2c0 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:03.906555 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-0e88ef45-d75c-4622-bd76-785695d6d2c0 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:03.907685 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-0e88ef45-d75c-4622-bd76-785695d6d2c0 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:03.908293 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-0e88ef45-d75c-4622-bd76-785695d6d2c0 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:03.943747 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-0fbffc4f-b5e7-4656-8723-a4ebc57c2e04 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:09:03.944820 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-0fbffc4f-b5e7-4656-8723-a4ebc57c2e04 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:09:03.951708 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0fbffc4f-b5e7-4656-8723-a4ebc57c2e04 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:03.952182 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0fbffc4f-b5e7-4656-8723-a4ebc57c2e04 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:03.953003 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0fbffc4f-b5e7-4656-8723-a4ebc57c2e04 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:03.953428 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0fbffc4f-b5e7-4656-8723-a4ebc57c2e04 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:03.978908 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.objects.instance [None req-0fbffc4f-b5e7-4656-8723-a4ebc57c2e04 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lazy-loading 'flavor' on Instance uuid 80ce5722-8f51-457b-9f9b-ff4b63b103df {{(pid=116103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 09 20:09:04.051143 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-0e88ef45-d75c-4622-bd76-785695d6d2c0 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "POST /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e/action" status: 200 len: 28523 microversion: 2.20 time: 0.157811 Nov 09 20:09:04.053946 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 121/251] 10.222.0.25 () {62 vars in 1318 bytes} [Tue Nov 9 20:09:03 2021] POST /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e/action => generated 28523 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 20:09:04.064725 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-0fbffc4f-b5e7-4656-8723-a4ebc57c2e04 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "POST /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/action" status: 200 len: 32 microversion: 2.1 time: 0.126394 Nov 09 20:09:04.065465 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 131/252] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Nov 9 20:09:03 2021] POST /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/action => generated 32 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 09 20:09:04.084416 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-a1de5e7e-38f7-42b6-afa0-1547a349dd6e tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:09:04.085200 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-a1de5e7e-38f7-42b6-afa0-1547a349dd6e tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:09:04.091747 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a1de5e7e-38f7-42b6-afa0-1547a349dd6e tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:04.092191 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a1de5e7e-38f7-42b6-afa0-1547a349dd6e tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:04.092998 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a1de5e7e-38f7-42b6-afa0-1547a349dd6e tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:04.095009 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a1de5e7e-38f7-42b6-afa0-1547a349dd6e tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:04.225779 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-3132c97a-ee09-4ec6-a12d-33796a41ef53 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:09:04.227030 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-3132c97a-ee09-4ec6-a12d-33796a41ef53 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] [instance: 7af83497-777d-41ec-9439-e90a042880c7] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:09:04.235468 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3132c97a-ee09-4ec6-a12d-33796a41ef53 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:04.236277 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3132c97a-ee09-4ec6-a12d-33796a41ef53 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:04.237439 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3132c97a-ee09-4ec6-a12d-33796a41ef53 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:04.239124 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3132c97a-ee09-4ec6-a12d-33796a41ef53 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:04.408736 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-a1de5e7e-38f7-42b6-afa0-1547a349dd6e tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:09:04.418936 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-a1de5e7e-38f7-42b6-afa0-1547a349dd6e tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1521 microversion: 2.1 time: 0.346803 Nov 09 20:09:04.420790 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 122/253] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:09:04 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1521 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:09:04.465862 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-92fe4100-4d9a-415f-a133-6a64ea07ae80 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:09:04.466478 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-92fe4100-4d9a-415f-a133-6a64ea07ae80 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:09:04.472991 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-92fe4100-4d9a-415f-a133-6a64ea07ae80 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:04.473687 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-92fe4100-4d9a-415f-a133-6a64ea07ae80 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:04.475169 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-92fe4100-4d9a-415f-a133-6a64ea07ae80 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:04.475874 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-92fe4100-4d9a-415f-a133-6a64ea07ae80 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:04.479343 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-3132c97a-ee09-4ec6-a12d-33796a41ef53 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0fa5fbfbbac4395b0dfd39bdfd9dd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2beabde9f6094ba98b488166018f1748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:09:04.487531 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-3132c97a-ee09-4ec6-a12d-33796a41ef53 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] 10.222.0.25 "GET /compute/v2.1/servers/7af83497-777d-41ec-9439-e90a042880c7" status: 200 len: 1503 microversion: 2.1 time: 0.267005 Nov 09 20:09:04.488679 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 132/254] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:09:04 2021] GET /compute/v2.1/servers/7af83497-777d-41ec-9439-e90a042880c7 => generated 1503 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:09:04.494911 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-7f4493e6-b042-44a6-9a40-dcf7b9cf31de tempest-VolumesNegativeTest-1335498923 tempest-VolumesNegativeTest-1335498923-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:09:04.495742 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-7f4493e6-b042-44a6-9a40-dcf7b9cf31de tempest-VolumesNegativeTest-1335498923 tempest-VolumesNegativeTest-1335498923-project] [instance: a584c766-9a09-4ae0-af66-50f92ab01886] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:09:04.503075 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7f4493e6-b042-44a6-9a40-dcf7b9cf31de tempest-VolumesNegativeTest-1335498923 tempest-VolumesNegativeTest-1335498923-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:04.503770 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7f4493e6-b042-44a6-9a40-dcf7b9cf31de tempest-VolumesNegativeTest-1335498923 tempest-VolumesNegativeTest-1335498923-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:04.504761 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7f4493e6-b042-44a6-9a40-dcf7b9cf31de tempest-VolumesNegativeTest-1335498923 tempest-VolumesNegativeTest-1335498923-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:04.505400 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7f4493e6-b042-44a6-9a40-dcf7b9cf31de tempest-VolumesNegativeTest-1335498923 tempest-VolumesNegativeTest-1335498923-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:04.549383 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-92fe4100-4d9a-415f-a133-6a64ea07ae80 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:09:04.558036 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-92fe4100-4d9a-415f-a133-6a64ea07ae80 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1276 microversion: 2.1 time: 0.095722 Nov 09 20:09:04.558877 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 123/255] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:09:04 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1276 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 20:09:04.824687 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-a9360864-eb40-4611-9e94-92cf211f50fa tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:09:04.825615 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-a9360864-eb40-4611-9e94-92cf211f50fa tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:09:04.836326 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a9360864-eb40-4611-9e94-92cf211f50fa tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:04.836935 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a9360864-eb40-4611-9e94-92cf211f50fa tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:04.838136 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a9360864-eb40-4611-9e94-92cf211f50fa tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:04.838332 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a9360864-eb40-4611-9e94-92cf211f50fa tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:04.879037 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-7f4493e6-b042-44a6-9a40-dcf7b9cf31de tempest-VolumesNegativeTest-1335498923 tempest-VolumesNegativeTest-1335498923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a524589370ee4a99af09d9d55613b940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13362a810cb04a01ad455f9e12d7c09c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:09:04.890735 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-7f4493e6-b042-44a6-9a40-dcf7b9cf31de tempest-VolumesNegativeTest-1335498923 tempest-VolumesNegativeTest-1335498923-project] 10.222.0.25 "GET /compute/v2.1/servers/a584c766-9a09-4ae0-af66-50f92ab01886" status: 200 len: 1315 microversion: 2.1 time: 0.400589 Nov 09 20:09:04.893539 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 133/256] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:09:04 2021] GET /compute/v2.1/servers/a584c766-9a09-4ae0-af66-50f92ab01886 => generated 1315 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:09:04.933446 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-a9360864-eb40-4611-9e94-92cf211f50fa tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "POST /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/action" status: 200 len: 28511 microversion: 2.1 time: 0.112173 Nov 09 20:09:04.937420 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 124/257] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Nov 9 20:09:04 2021] POST /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/action => generated 28511 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 09 20:09:05.064898 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-9ad154d1-7b24-476d-8754-5add17a3b375 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:09:05.065778 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-9ad154d1-7b24-476d-8754-5add17a3b375 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:09:05.072698 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9ad154d1-7b24-476d-8754-5add17a3b375 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:05.073142 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9ad154d1-7b24-476d-8754-5add17a3b375 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:05.073929 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9ad154d1-7b24-476d-8754-5add17a3b375 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:05.074413 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9ad154d1-7b24-476d-8754-5add17a3b375 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:05.215877 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-9ad154d1-7b24-476d-8754-5add17a3b375 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "POST /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e/action" status: 200 len: 28541 microversion: 2.20 time: 0.154552 Nov 09 20:09:05.219927 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 134/258] 10.222.0.25 () {62 vars in 1318 bytes} [Tue Nov 9 20:09:05 2021] POST /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e/action => generated 28541 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 20:09:05.438882 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-b080de6f-9895-4112-be6e-c997d655b186 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:09:05.439915 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-b080de6f-9895-4112-be6e-c997d655b186 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:09:05.458083 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b080de6f-9895-4112-be6e-c997d655b186 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:05.458979 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b080de6f-9895-4112-be6e-c997d655b186 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:05.459925 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b080de6f-9895-4112-be6e-c997d655b186 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:05.460583 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b080de6f-9895-4112-be6e-c997d655b186 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:05.506204 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-cf95d9c9-cfa0-4c9f-a55f-42f2809e17c4 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:09:05.507024 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-cf95d9c9-cfa0-4c9f-a55f-42f2809e17c4 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] [instance: 7af83497-777d-41ec-9439-e90a042880c7] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:09:05.515528 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cf95d9c9-cfa0-4c9f-a55f-42f2809e17c4 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:05.516490 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cf95d9c9-cfa0-4c9f-a55f-42f2809e17c4 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:05.517397 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cf95d9c9-cfa0-4c9f-a55f-42f2809e17c4 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:05.517920 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cf95d9c9-cfa0-4c9f-a55f-42f2809e17c4 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:05.651964 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-b080de6f-9895-4112-be6e-c997d655b186 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:09:05.665511 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-b080de6f-9895-4112-be6e-c997d655b186 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1521 microversion: 2.1 time: 0.233528 Nov 09 20:09:05.666141 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 125/259] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:09:05 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1521 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 20:09:05.673101 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-e67668db-5126-482f-a9f6-1f0658e85083 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:09:05.673724 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-e67668db-5126-482f-a9f6-1f0658e85083 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:09:05.680597 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e67668db-5126-482f-a9f6-1f0658e85083 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:05.681299 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e67668db-5126-482f-a9f6-1f0658e85083 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:05.682294 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e67668db-5126-482f-a9f6-1f0658e85083 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:05.682963 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e67668db-5126-482f-a9f6-1f0658e85083 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:05.712059 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-cf95d9c9-cfa0-4c9f-a55f-42f2809e17c4 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0fa5fbfbbac4395b0dfd39bdfd9dd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2beabde9f6094ba98b488166018f1748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:09:05.719580 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-cf95d9c9-cfa0-4c9f-a55f-42f2809e17c4 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] 10.222.0.25 "GET /compute/v2.1/servers/7af83497-777d-41ec-9439-e90a042880c7" status: 200 len: 1503 microversion: 2.1 time: 0.218307 Nov 09 20:09:05.720165 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 135/260] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:09:05 2021] GET /compute/v2.1/servers/7af83497-777d-41ec-9439-e90a042880c7 => generated 1503 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 20:09:05.734639 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [req-c234e22f-3990-4158-b568-b810e9b4667c req-a479f609-2e76-478b-813c-0d9463c9f713 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75e5847b-18ff-4332-be8a-f77ffae72997", "tag": "444d6d36-0a3d-4e0d-8c9a-cf6c03c32d1f"}]} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:09:05.736372 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 20:09:05.736372 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: warnings.warn(msg) Nov 09 20:09:05.743735 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-c234e22f-3990-4158-b568-b810e9b4667c req-a479f609-2e76-478b-813c-0d9463c9f713 service nova] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:05.744178 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-c234e22f-3990-4158-b568-b810e9b4667c req-a479f609-2e76-478b-813c-0d9463c9f713 service nova] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:05.757805 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.compute.server_external_events [req-c234e22f-3990-4158-b568-b810e9b4667c req-a479f609-2e76-478b-813c-0d9463c9f713 service nova] Creating event network-changed:444d6d36-0a3d-4e0d-8c9a-cf6c03c32d1f for instance 75e5847b-18ff-4332-be8a-f77ffae72997 on hv-cinder-80135 Nov 09 20:09:05.763210 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [req-c234e22f-3990-4158-b568-b810e9b4667c req-a479f609-2e76-478b-813c-0d9463c9f713 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032053 Nov 09 20:09:05.764032 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 136/261] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Nov 9 20:09:05 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:09:05.841486 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-e67668db-5126-482f-a9f6-1f0658e85083 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:09:05.850210 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-e67668db-5126-482f-a9f6-1f0658e85083 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1318 microversion: 2.1 time: 0.182715 Nov 09 20:09:05.850797 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 126/262] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:09:05 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1318 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:09:05.909263 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-9a173edb-ffb7-482e-8b91-8182e4437f3e tempest-VolumesNegativeTest-1335498923 tempest-VolumesNegativeTest-1335498923-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:09:05.909944 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-9a173edb-ffb7-482e-8b91-8182e4437f3e tempest-VolumesNegativeTest-1335498923 tempest-VolumesNegativeTest-1335498923-project] [instance: a584c766-9a09-4ae0-af66-50f92ab01886] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:09:05.916984 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9a173edb-ffb7-482e-8b91-8182e4437f3e tempest-VolumesNegativeTest-1335498923 tempest-VolumesNegativeTest-1335498923-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:05.917430 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9a173edb-ffb7-482e-8b91-8182e4437f3e tempest-VolumesNegativeTest-1335498923 tempest-VolumesNegativeTest-1335498923-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:05.918209 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9a173edb-ffb7-482e-8b91-8182e4437f3e tempest-VolumesNegativeTest-1335498923 tempest-VolumesNegativeTest-1335498923-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:05.918635 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9a173edb-ffb7-482e-8b91-8182e4437f3e tempest-VolumesNegativeTest-1335498923 tempest-VolumesNegativeTest-1335498923-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:05.946379 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-e272c688-0d92-4171-9623-5612f94600ed tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:09:05.953508 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-e272c688-0d92-4171-9623-5612f94600ed tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:09:05.963758 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e272c688-0d92-4171-9623-5612f94600ed tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:05.965011 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e272c688-0d92-4171-9623-5612f94600ed tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:05.966038 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e272c688-0d92-4171-9623-5612f94600ed tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:05.966691 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e272c688-0d92-4171-9623-5612f94600ed tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:06.064355 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-e272c688-0d92-4171-9623-5612f94600ed tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "POST /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/action" status: 200 len: 28672 microversion: 2.1 time: 0.122356 Nov 09 20:09:06.065303 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 127/263] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Nov 9 20:09:05 2021] POST /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/action => generated 28672 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 09 20:09:06.078836 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-9a173edb-ffb7-482e-8b91-8182e4437f3e tempest-VolumesNegativeTest-1335498923 tempest-VolumesNegativeTest-1335498923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a524589370ee4a99af09d9d55613b940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13362a810cb04a01ad455f9e12d7c09c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:09:06.087052 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-9a173edb-ffb7-482e-8b91-8182e4437f3e tempest-VolumesNegativeTest-1335498923 tempest-VolumesNegativeTest-1335498923-project] 10.222.0.25 "GET /compute/v2.1/servers/a584c766-9a09-4ae0-af66-50f92ab01886" status: 200 len: 1315 microversion: 2.1 time: 0.182245 Nov 09 20:09:06.088000 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 137/264] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:09:05 2021] GET /compute/v2.1/servers/a584c766-9a09-4ae0-af66-50f92ab01886 => generated 1315 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:09:06.228936 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-2d44c96c-b7d9-4c7e-8e94-42193b176128 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:09:06.231195 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-2d44c96c-b7d9-4c7e-8e94-42193b176128 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:09:06.238201 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-2d44c96c-b7d9-4c7e-8e94-42193b176128 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:06.238651 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-2d44c96c-b7d9-4c7e-8e94-42193b176128 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:06.239497 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-2d44c96c-b7d9-4c7e-8e94-42193b176128 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:06.240172 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-2d44c96c-b7d9-4c7e-8e94-42193b176128 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:06.374629 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-2d44c96c-b7d9-4c7e-8e94-42193b176128 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "POST /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e/action" status: 200 len: 28687 microversion: 2.20 time: 0.150788 Nov 09 20:09:06.375403 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 128/265] 10.222.0.25 () {62 vars in 1318 bytes} [Tue Nov 9 20:09:06 2021] POST /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e/action => generated 28687 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 09 20:09:06.685837 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-14c8876d-d7aa-4da5-a0c9-7bcbb4c47a8b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:09:06.687893 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-14c8876d-d7aa-4da5-a0c9-7bcbb4c47a8b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:09:06.704074 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-14c8876d-d7aa-4da5-a0c9-7bcbb4c47a8b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:06.704582 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-14c8876d-d7aa-4da5-a0c9-7bcbb4c47a8b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:06.707129 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-14c8876d-d7aa-4da5-a0c9-7bcbb4c47a8b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:06.709364 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-14c8876d-d7aa-4da5-a0c9-7bcbb4c47a8b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:06.738074 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-24e8f0f6-1b18-4e01-94a2-e4e8cb7456b7 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:09:06.739032 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-24e8f0f6-1b18-4e01-94a2-e4e8cb7456b7 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] [instance: 7af83497-777d-41ec-9439-e90a042880c7] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:09:06.756294 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-24e8f0f6-1b18-4e01-94a2-e4e8cb7456b7 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:06.756866 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-24e8f0f6-1b18-4e01-94a2-e4e8cb7456b7 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:06.759419 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-24e8f0f6-1b18-4e01-94a2-e4e8cb7456b7 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:06.759875 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-24e8f0f6-1b18-4e01-94a2-e4e8cb7456b7 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:06.866093 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-24e8f0f6-1b18-4e01-94a2-e4e8cb7456b7 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0fa5fbfbbac4395b0dfd39bdfd9dd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2beabde9f6094ba98b488166018f1748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:09:06.873510 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-24e8f0f6-1b18-4e01-94a2-e4e8cb7456b7 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] 10.222.0.25 "GET /compute/v2.1/servers/7af83497-777d-41ec-9439-e90a042880c7" status: 200 len: 1298 microversion: 2.1 time: 0.139605 Nov 09 20:09:06.889269 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 129/266] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:09:06 2021] GET /compute/v2.1/servers/7af83497-777d-41ec-9439-e90a042880c7 => generated 1298 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:09:06.893778 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-869128dd-8202-406a-bfd2-2982b1f02f1c tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:09:06.894390 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-869128dd-8202-406a-bfd2-2982b1f02f1c tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:09:06.900601 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-869128dd-8202-406a-bfd2-2982b1f02f1c tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:06.901047 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-869128dd-8202-406a-bfd2-2982b1f02f1c tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:06.901824 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-869128dd-8202-406a-bfd2-2982b1f02f1c tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:06.902248 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-869128dd-8202-406a-bfd2-2982b1f02f1c tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:06.987004 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-14c8876d-d7aa-4da5-a0c9-7bcbb4c47a8b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:09:06.996031 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-14c8876d-d7aa-4da5-a0c9-7bcbb4c47a8b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1521 microversion: 2.1 time: 0.316030 Nov 09 20:09:06.996687 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 138/267] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:09:06 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1521 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:09:07.077688 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-bb19aa00-523b-4a8a-ad5a-f6dbd5959992 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:09:07.079270 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-bb19aa00-523b-4a8a-ad5a-f6dbd5959992 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:09:07.086774 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bb19aa00-523b-4a8a-ad5a-f6dbd5959992 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:07.087880 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bb19aa00-523b-4a8a-ad5a-f6dbd5959992 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:07.089018 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bb19aa00-523b-4a8a-ad5a-f6dbd5959992 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:07.089628 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bb19aa00-523b-4a8a-ad5a-f6dbd5959992 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:07.107977 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-869128dd-8202-406a-bfd2-2982b1f02f1c tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:09:07.121925 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-869128dd-8202-406a-bfd2-2982b1f02f1c tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1318 microversion: 2.1 time: 0.230515 Nov 09 20:09:07.122712 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 130/268] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:09:06 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1318 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:09:07.133049 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-843d5cb4-6bdb-4e71-9af6-f12019237fd0 tempest-VolumesNegativeTest-1335498923 tempest-VolumesNegativeTest-1335498923-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:09:07.133721 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-843d5cb4-6bdb-4e71-9af6-f12019237fd0 tempest-VolumesNegativeTest-1335498923 tempest-VolumesNegativeTest-1335498923-project] [instance: a584c766-9a09-4ae0-af66-50f92ab01886] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:09:07.139693 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-843d5cb4-6bdb-4e71-9af6-f12019237fd0 tempest-VolumesNegativeTest-1335498923 tempest-VolumesNegativeTest-1335498923-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:07.140304 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-843d5cb4-6bdb-4e71-9af6-f12019237fd0 tempest-VolumesNegativeTest-1335498923 tempest-VolumesNegativeTest-1335498923-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:07.141133 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-843d5cb4-6bdb-4e71-9af6-f12019237fd0 tempest-VolumesNegativeTest-1335498923 tempest-VolumesNegativeTest-1335498923-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:07.141578 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-843d5cb4-6bdb-4e71-9af6-f12019237fd0 tempest-VolumesNegativeTest-1335498923 tempest-VolumesNegativeTest-1335498923-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:07.211343 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-bb19aa00-523b-4a8a-ad5a-f6dbd5959992 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "POST /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/action" status: 200 len: 28672 microversion: 2.1 time: 0.137087 Nov 09 20:09:07.212433 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 139/269] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Nov 9 20:09:07 2021] POST /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/action => generated 28672 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 09 20:09:07.352983 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-843d5cb4-6bdb-4e71-9af6-f12019237fd0 tempest-VolumesNegativeTest-1335498923 tempest-VolumesNegativeTest-1335498923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a524589370ee4a99af09d9d55613b940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13362a810cb04a01ad455f9e12d7c09c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:09:07.363249 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-843d5cb4-6bdb-4e71-9af6-f12019237fd0 tempest-VolumesNegativeTest-1335498923 tempest-VolumesNegativeTest-1335498923-project] 10.222.0.25 "GET /compute/v2.1/servers/a584c766-9a09-4ae0-af66-50f92ab01886" status: 200 len: 1315 microversion: 2.1 time: 0.238797 Nov 09 20:09:07.363828 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 131/270] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:09:07 2021] GET /compute/v2.1/servers/a584c766-9a09-4ae0-af66-50f92ab01886 => generated 1315 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:09:07.387564 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-b35f7945-56b9-4a03-8535-3ee4fb55a402 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:09:07.388648 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-b35f7945-56b9-4a03-8535-3ee4fb55a402 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:09:07.397026 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b35f7945-56b9-4a03-8535-3ee4fb55a402 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:07.397477 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b35f7945-56b9-4a03-8535-3ee4fb55a402 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:07.398254 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b35f7945-56b9-4a03-8535-3ee4fb55a402 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:07.398686 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b35f7945-56b9-4a03-8535-3ee4fb55a402 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:07.470023 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-b35f7945-56b9-4a03-8535-3ee4fb55a402 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "POST /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e/action" status: 200 len: 28687 microversion: 2.20 time: 0.086720 Nov 09 20:09:07.470612 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 140/271] 10.222.0.25 () {62 vars in 1318 bytes} [Tue Nov 9 20:09:07 2021] POST /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e/action => generated 28687 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 20:09:07.796929 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [req-9f0b7a32-763a-44ff-a983-f3dd1561564b req-f28758ef-0a6b-47b0-9aaf-89ccf619270a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7af83497-777d-41ec-9439-e90a042880c7", "name": "network-vif-deleted", "tag": "d36653fe-01e1-435f-91c7-09318aa30f49"}]} {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:09:07.798422 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 20:09:07.798422 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: warnings.warn(msg) Nov 09 20:09:07.805476 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [req-9f0b7a32-763a-44ff-a983-f3dd1561564b req-f28758ef-0a6b-47b0-9aaf-89ccf619270a service nova] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:07.805921 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [req-9f0b7a32-763a-44ff-a983-f3dd1561564b req-f28758ef-0a6b-47b0-9aaf-89ccf619270a service nova] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:07.816555 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.compute.server_external_events [req-9f0b7a32-763a-44ff-a983-f3dd1561564b req-f28758ef-0a6b-47b0-9aaf-89ccf619270a service nova] Creating event network-vif-deleted:d36653fe-01e1-435f-91c7-09318aa30f49 for instance 7af83497-777d-41ec-9439-e90a042880c7 on hv-cinder-80135 Nov 09 20:09:07.821861 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [req-9f0b7a32-763a-44ff-a983-f3dd1561564b req-f28758ef-0a6b-47b0-9aaf-89ccf619270a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028410 Nov 09 20:09:07.822308 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 132/272] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Nov 9 20:09:07 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:09:07.891387 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-e11c8fda-5479-4528-9b06-58e32f7f11a8 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:09:07.892250 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-e11c8fda-5479-4528-9b06-58e32f7f11a8 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] [instance: 7af83497-777d-41ec-9439-e90a042880c7] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:09:07.899983 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e11c8fda-5479-4528-9b06-58e32f7f11a8 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:07.900438 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e11c8fda-5479-4528-9b06-58e32f7f11a8 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:07.901209 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e11c8fda-5479-4528-9b06-58e32f7f11a8 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:07.901805 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e11c8fda-5479-4528-9b06-58e32f7f11a8 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:07.915948 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.wsgi [None req-e11c8fda-5479-4528-9b06-58e32f7f11a8 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] HTTP exception thrown: Instance 7af83497-777d-41ec-9439-e90a042880c7 could not be found. Nov 09 20:09:07.916567 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-e11c8fda-5479-4528-9b06-58e32f7f11a8 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] Returning 404 to user: Instance 7af83497-777d-41ec-9439-e90a042880c7 could not be found. {{(pid=116103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 09 20:09:07.917503 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-e11c8fda-5479-4528-9b06-58e32f7f11a8 tempest-VolumesActionsTest-651133595 tempest-VolumesActionsTest-651133595-project] 10.222.0.25 "GET /compute/v2.1/servers/7af83497-777d-41ec-9439-e90a042880c7" status: 404 len: 111 microversion: 2.1 time: 0.030144 Nov 09 20:09:07.918386 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 141/273] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:09:07 2021] GET /compute/v2.1/servers/7af83497-777d-41ec-9439-e90a042880c7 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 09 20:09:08.017336 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-b38bffa2-cf6a-4479-af8b-4e3278932281 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:09:08.018296 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-b38bffa2-cf6a-4479-af8b-4e3278932281 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:09:08.024488 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b38bffa2-cf6a-4479-af8b-4e3278932281 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:08.025102 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b38bffa2-cf6a-4479-af8b-4e3278932281 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:08.026238 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b38bffa2-cf6a-4479-af8b-4e3278932281 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:08.026833 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b38bffa2-cf6a-4479-af8b-4e3278932281 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:08.140393 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-bcea5b6a-bcec-4b3b-bf65-4c3e05ab0e16 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:09:08.142358 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-bcea5b6a-bcec-4b3b-bf65-4c3e05ab0e16 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:09:08.149575 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bcea5b6a-bcec-4b3b-bf65-4c3e05ab0e16 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:08.150604 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bcea5b6a-bcec-4b3b-bf65-4c3e05ab0e16 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:08.151979 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bcea5b6a-bcec-4b3b-bf65-4c3e05ab0e16 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:08.152908 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bcea5b6a-bcec-4b3b-bf65-4c3e05ab0e16 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:08.333899 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-b38bffa2-cf6a-4479-af8b-4e3278932281 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:09:08.353265 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-b38bffa2-cf6a-4479-af8b-4e3278932281 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1521 microversion: 2.1 time: 0.343646 Nov 09 20:09:08.363603 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 133/274] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:09:08 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1521 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:09:08.375375 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-0f33e0a6-58a6-4d8d-8901-6a9d2bf6d0e1 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:09:08.377148 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-0f33e0a6-58a6-4d8d-8901-6a9d2bf6d0e1 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:09:08.386170 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-0f33e0a6-58a6-4d8d-8901-6a9d2bf6d0e1 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:08.387028 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-0f33e0a6-58a6-4d8d-8901-6a9d2bf6d0e1 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:08.388450 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-0f33e0a6-58a6-4d8d-8901-6a9d2bf6d0e1 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:08.389691 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-0f33e0a6-58a6-4d8d-8901-6a9d2bf6d0e1 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:08.438170 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-bcea5b6a-bcec-4b3b-bf65-4c3e05ab0e16 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:09:08.450198 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-bcea5b6a-bcec-4b3b-bf65-4c3e05ab0e16 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1318 microversion: 2.1 time: 0.311313 Nov 09 20:09:08.453279 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 142/275] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:09:08 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1318 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 20:09:08.466376 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-f466bb77-777e-4125-8155-b7459d2c0f98 tempest-VolumesNegativeTest-1335498923 tempest-VolumesNegativeTest-1335498923-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:09:08.467118 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-f466bb77-777e-4125-8155-b7459d2c0f98 tempest-VolumesNegativeTest-1335498923 tempest-VolumesNegativeTest-1335498923-project] [instance: a584c766-9a09-4ae0-af66-50f92ab01886] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:09:08.474218 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f466bb77-777e-4125-8155-b7459d2c0f98 tempest-VolumesNegativeTest-1335498923 tempest-VolumesNegativeTest-1335498923-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:08.474663 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f466bb77-777e-4125-8155-b7459d2c0f98 tempest-VolumesNegativeTest-1335498923 tempest-VolumesNegativeTest-1335498923-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:08.475510 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f466bb77-777e-4125-8155-b7459d2c0f98 tempest-VolumesNegativeTest-1335498923 tempest-VolumesNegativeTest-1335498923-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:08.475942 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f466bb77-777e-4125-8155-b7459d2c0f98 tempest-VolumesNegativeTest-1335498923 tempest-VolumesNegativeTest-1335498923-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:08.519190 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-0f33e0a6-58a6-4d8d-8901-6a9d2bf6d0e1 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "POST /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/action" status: 200 len: 28672 microversion: 2.1 time: 0.153140 Nov 09 20:09:08.519855 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 134/276] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Nov 9 20:09:08 2021] POST /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/action => generated 28672 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 20:09:08.528197 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [req-b07cbd95-b6c7-432b-8147-763f4da9811d req-63c582c0-1609-4fcc-8604-e645cc97f088 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a584c766-9a09-4ae0-af66-50f92ab01886", "name": "network-vif-plugged", "status": "completed", "tag": "3fd3fcd5-ca67-4fea-b422-278c129e1d72"}]} {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:09:08.529739 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 20:09:08.529739 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: warnings.warn(msg) Nov 09 20:09:08.544529 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [req-b07cbd95-b6c7-432b-8147-763f4da9811d req-63c582c0-1609-4fcc-8604-e645cc97f088 service nova] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:08.545260 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [req-b07cbd95-b6c7-432b-8147-763f4da9811d req-63c582c0-1609-4fcc-8604-e645cc97f088 service nova] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:08.557497 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.compute.server_external_events [req-b07cbd95-b6c7-432b-8147-763f4da9811d req-63c582c0-1609-4fcc-8604-e645cc97f088 service nova] Creating event network-vif-plugged:3fd3fcd5-ca67-4fea-b422-278c129e1d72 for instance a584c766-9a09-4ae0-af66-50f92ab01886 on hv-cinder-80135 Nov 09 20:09:08.562317 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [req-b07cbd95-b6c7-432b-8147-763f4da9811d req-63c582c0-1609-4fcc-8604-e645cc97f088 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037863 Nov 09 20:09:08.563390 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 135/277] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Nov 9 20:09:08 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:09:08.572059 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-b05f08f2-7a9c-46a4-b6d0-ec45925e8b49 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:09:08.573407 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-b05f08f2-7a9c-46a4-b6d0-ec45925e8b49 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:09:08.580277 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b05f08f2-7a9c-46a4-b6d0-ec45925e8b49 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:08.586973 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b05f08f2-7a9c-46a4-b6d0-ec45925e8b49 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:08.588049 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b05f08f2-7a9c-46a4-b6d0-ec45925e8b49 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:08.588661 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b05f08f2-7a9c-46a4-b6d0-ec45925e8b49 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:08.681973 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-b05f08f2-7a9c-46a4-b6d0-ec45925e8b49 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "POST /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e/action" status: 200 len: 28687 microversion: 2.20 time: 0.115658 Nov 09 20:09:08.683118 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 136/278] 10.222.0.25 () {62 vars in 1318 bytes} [Tue Nov 9 20:09:08 2021] POST /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e/action => generated 28687 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 20:09:08.762623 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-f466bb77-777e-4125-8155-b7459d2c0f98 tempest-VolumesNegativeTest-1335498923 tempest-VolumesNegativeTest-1335498923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a524589370ee4a99af09d9d55613b940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13362a810cb04a01ad455f9e12d7c09c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:09:08.771429 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-f466bb77-777e-4125-8155-b7459d2c0f98 tempest-VolumesNegativeTest-1335498923 tempest-VolumesNegativeTest-1335498923-project] 10.222.0.25 "GET /compute/v2.1/servers/a584c766-9a09-4ae0-af66-50f92ab01886" status: 200 len: 1315 microversion: 2.1 time: 0.316285 Nov 09 20:09:08.781082 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 143/279] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:09:08 2021] GET /compute/v2.1/servers/a584c766-9a09-4ae0-af66-50f92ab01886 => generated 1315 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:09:09.375212 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-def99cb0-6188-4767-b397-f88262686b2d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:09:09.376371 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-def99cb0-6188-4767-b397-f88262686b2d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:09:09.385088 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-def99cb0-6188-4767-b397-f88262686b2d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:09.385088 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-def99cb0-6188-4767-b397-f88262686b2d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:09.386492 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-def99cb0-6188-4767-b397-f88262686b2d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:09.387244 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-def99cb0-6188-4767-b397-f88262686b2d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:09.468904 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-b6a6ab66-596e-4589-89ff-b27631967ff0 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:09:09.470237 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-b6a6ab66-596e-4589-89ff-b27631967ff0 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:09:09.482957 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b6a6ab66-596e-4589-89ff-b27631967ff0 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:09.483392 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b6a6ab66-596e-4589-89ff-b27631967ff0 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:09.485217 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b6a6ab66-596e-4589-89ff-b27631967ff0 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:09.485649 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b6a6ab66-596e-4589-89ff-b27631967ff0 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:09.641032 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-def99cb0-6188-4767-b397-f88262686b2d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:09:09.655031 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-def99cb0-6188-4767-b397-f88262686b2d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1521 microversion: 2.1 time: 0.287613 Nov 09 20:09:09.666415 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 137/280] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:09:09 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1521 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:09:09.671223 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-1d486688-9b76-4a19-ab3a-955721dc9549 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:09:09.676433 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-1d486688-9b76-4a19-ab3a-955721dc9549 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:09:09.690398 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-1d486688-9b76-4a19-ab3a-955721dc9549 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:09.692060 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-1d486688-9b76-4a19-ab3a-955721dc9549 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:09.693498 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-b6a6ab66-596e-4589-89ff-b27631967ff0 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:09:09.695025 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-1d486688-9b76-4a19-ab3a-955721dc9549 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:09.695595 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-1d486688-9b76-4a19-ab3a-955721dc9549 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:09.703437 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-b6a6ab66-596e-4589-89ff-b27631967ff0 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1318 microversion: 2.1 time: 0.236736 Nov 09 20:09:09.704541 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 144/281] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:09:09 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1318 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:09:09.709965 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-8122e53f-ed66-44f8-a280-157039ba9e8c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:09:09.710942 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-8122e53f-ed66-44f8-a280-157039ba9e8c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:09:09.717159 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8122e53f-ed66-44f8-a280-157039ba9e8c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:09.717706 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8122e53f-ed66-44f8-a280-157039ba9e8c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:09.718681 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8122e53f-ed66-44f8-a280-157039ba9e8c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:09.719256 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8122e53f-ed66-44f8-a280-157039ba9e8c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:12.166649 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-1d486688-9b76-4a19-ab3a-955721dc9549 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "POST /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/action" status: 200 len: 28672 microversion: 2.1 time: 2.498230 Nov 09 20:09:12.170196 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-8122e53f-ed66-44f8-a280-157039ba9e8c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "POST /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e/action" status: 200 len: 28687 microversion: 2.20 time: 2.462812 Nov 09 20:09:12.173642 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 145/282] 10.222.0.25 () {62 vars in 1318 bytes} [Tue Nov 9 20:09:09 2021] POST /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e/action => generated 28687 bytes in 2468 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 20:09:12.175088 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 138/283] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Nov 9 20:09:09 2021] POST /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/action => generated 28672 bytes in 2508 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 20:09:12.179343 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-6de4648a-2acd-41a5-95d7-0961946ed9ab tempest-VolumesNegativeTest-1335498923 tempest-VolumesNegativeTest-1335498923-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:09:12.180040 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-6de4648a-2acd-41a5-95d7-0961946ed9ab tempest-VolumesNegativeTest-1335498923 tempest-VolumesNegativeTest-1335498923-project] [instance: a584c766-9a09-4ae0-af66-50f92ab01886] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:09:12.181515 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-27184dac-1e00-420d-9230-a0ab7c75259d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:09:12.182360 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-27184dac-1e00-420d-9230-a0ab7c75259d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:09:12.188761 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6de4648a-2acd-41a5-95d7-0961946ed9ab tempest-VolumesNegativeTest-1335498923 tempest-VolumesNegativeTest-1335498923-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:12.189217 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6de4648a-2acd-41a5-95d7-0961946ed9ab tempest-VolumesNegativeTest-1335498923 tempest-VolumesNegativeTest-1335498923-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:12.190016 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6de4648a-2acd-41a5-95d7-0961946ed9ab tempest-VolumesNegativeTest-1335498923 tempest-VolumesNegativeTest-1335498923-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:12.190454 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6de4648a-2acd-41a5-95d7-0961946ed9ab tempest-VolumesNegativeTest-1335498923 tempest-VolumesNegativeTest-1335498923-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:12.191003 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-27184dac-1e00-420d-9230-a0ab7c75259d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:12.191611 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-27184dac-1e00-420d-9230-a0ab7c75259d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:12.193152 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-27184dac-1e00-420d-9230-a0ab7c75259d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:12.193997 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-27184dac-1e00-420d-9230-a0ab7c75259d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:12.529535 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-6de4648a-2acd-41a5-95d7-0961946ed9ab tempest-VolumesNegativeTest-1335498923 tempest-VolumesNegativeTest-1335498923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a524589370ee4a99af09d9d55613b940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13362a810cb04a01ad455f9e12d7c09c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:09:12.537850 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-6de4648a-2acd-41a5-95d7-0961946ed9ab tempest-VolumesNegativeTest-1335498923 tempest-VolumesNegativeTest-1335498923-project] 10.222.0.25 "GET /compute/v2.1/servers/a584c766-9a09-4ae0-af66-50f92ab01886" status: 200 len: 1315 microversion: 2.1 time: 0.362704 Nov 09 20:09:12.539196 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 146/284] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:09:12 2021] GET /compute/v2.1/servers/a584c766-9a09-4ae0-af66-50f92ab01886 => generated 1315 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:09:12.543827 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-31dbbf25-b0f1-4337-9192-47439a57202e tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:09:12.553559 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-31dbbf25-b0f1-4337-9192-47439a57202e tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:09:12.562415 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-31dbbf25-b0f1-4337-9192-47439a57202e tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:12.563118 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-31dbbf25-b0f1-4337-9192-47439a57202e tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:12.564316 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-31dbbf25-b0f1-4337-9192-47439a57202e tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:12.565041 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-31dbbf25-b0f1-4337-9192-47439a57202e tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:12.586637 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-27184dac-1e00-420d-9230-a0ab7c75259d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:09:12.595354 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-27184dac-1e00-420d-9230-a0ab7c75259d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1521 microversion: 2.1 time: 0.418836 Nov 09 20:09:12.597177 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 139/285] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:09:12 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1521 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:09:12.798072 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-31dbbf25-b0f1-4337-9192-47439a57202e tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:09:12.813820 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-31dbbf25-b0f1-4337-9192-47439a57202e tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1318 microversion: 2.1 time: 0.273332 Nov 09 20:09:12.814592 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 147/286] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:09:12 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1318 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:09:13.181330 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-abe90de2-3ba8-4417-a8a5-4beb184bb9b8 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:09:13.183483 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-abe90de2-3ba8-4417-a8a5-4beb184bb9b8 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:09:13.185844 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-a088ae9d-ffe4-4d44-a771-d81fac9ed616 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:09:13.189547 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-a088ae9d-ffe4-4d44-a771-d81fac9ed616 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:09:13.190095 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-abe90de2-3ba8-4417-a8a5-4beb184bb9b8 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:13.190710 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-abe90de2-3ba8-4417-a8a5-4beb184bb9b8 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:13.192185 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-abe90de2-3ba8-4417-a8a5-4beb184bb9b8 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:13.193178 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-abe90de2-3ba8-4417-a8a5-4beb184bb9b8 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:13.203743 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a088ae9d-ffe4-4d44-a771-d81fac9ed616 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:13.204539 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a088ae9d-ffe4-4d44-a771-d81fac9ed616 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:13.205613 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a088ae9d-ffe4-4d44-a771-d81fac9ed616 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:13.206371 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a088ae9d-ffe4-4d44-a771-d81fac9ed616 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:13.310519 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-abe90de2-3ba8-4417-a8a5-4beb184bb9b8 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "POST /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e/action" status: 200 len: 28687 microversion: 2.20 time: 0.133660 Nov 09 20:09:13.311330 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 140/287] 10.222.0.25 () {62 vars in 1318 bytes} [Tue Nov 9 20:09:13 2021] POST /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e/action => generated 28687 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 20:09:13.318867 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-a088ae9d-ffe4-4d44-a771-d81fac9ed616 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "POST /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/action" status: 200 len: 28672 microversion: 2.1 time: 0.139584 Nov 09 20:09:13.319764 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 148/288] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Nov 9 20:09:13 2021] POST /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/action => generated 28672 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 09 20:09:13.557069 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-583eea5d-1149-40dd-8a67-71a8cfa6c80e tempest-VolumesNegativeTest-1335498923 tempest-VolumesNegativeTest-1335498923-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:09:13.558618 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-583eea5d-1149-40dd-8a67-71a8cfa6c80e tempest-VolumesNegativeTest-1335498923 tempest-VolumesNegativeTest-1335498923-project] [instance: a584c766-9a09-4ae0-af66-50f92ab01886] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:09:13.594817 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-583eea5d-1149-40dd-8a67-71a8cfa6c80e tempest-VolumesNegativeTest-1335498923 tempest-VolumesNegativeTest-1335498923-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:13.596286 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-583eea5d-1149-40dd-8a67-71a8cfa6c80e tempest-VolumesNegativeTest-1335498923 tempest-VolumesNegativeTest-1335498923-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:13.600770 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-583eea5d-1149-40dd-8a67-71a8cfa6c80e tempest-VolumesNegativeTest-1335498923 tempest-VolumesNegativeTest-1335498923-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:13.601229 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-583eea5d-1149-40dd-8a67-71a8cfa6c80e tempest-VolumesNegativeTest-1335498923 tempest-VolumesNegativeTest-1335498923-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:13.616728 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-1ab89f81-ae6c-4c8d-b513-dc88b29e3c7e tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:09:13.617422 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-1ab89f81-ae6c-4c8d-b513-dc88b29e3c7e tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:09:13.643733 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1ab89f81-ae6c-4c8d-b513-dc88b29e3c7e tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:13.644183 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1ab89f81-ae6c-4c8d-b513-dc88b29e3c7e tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:13.644996 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1ab89f81-ae6c-4c8d-b513-dc88b29e3c7e tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:13.647063 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1ab89f81-ae6c-4c8d-b513-dc88b29e3c7e tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:13.984577 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-583eea5d-1149-40dd-8a67-71a8cfa6c80e tempest-VolumesNegativeTest-1335498923 tempest-VolumesNegativeTest-1335498923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a524589370ee4a99af09d9d55613b940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13362a810cb04a01ad455f9e12d7c09c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:09:14.006471 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-583eea5d-1149-40dd-8a67-71a8cfa6c80e tempest-VolumesNegativeTest-1335498923 tempest-VolumesNegativeTest-1335498923-project] 10.222.0.25 "GET /compute/v2.1/servers/a584c766-9a09-4ae0-af66-50f92ab01886" status: 200 len: 1465 microversion: 2.1 time: 0.454761 Nov 09 20:09:14.024748 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 141/289] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:09:13 2021] GET /compute/v2.1/servers/a584c766-9a09-4ae0-af66-50f92ab01886 => generated 1465 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:09:14.035075 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-31089999-1879-4e91-82ef-bd1fc4e437be tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:09:14.035914 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-31089999-1879-4e91-82ef-bd1fc4e437be tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:09:14.060691 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-31089999-1879-4e91-82ef-bd1fc4e437be tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:14.061660 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-31089999-1879-4e91-82ef-bd1fc4e437be tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:14.062963 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-31089999-1879-4e91-82ef-bd1fc4e437be tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:14.063727 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-31089999-1879-4e91-82ef-bd1fc4e437be tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:14.078348 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-1ab89f81-ae6c-4c8d-b513-dc88b29e3c7e tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:09:14.100928 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-1ab89f81-ae6c-4c8d-b513-dc88b29e3c7e tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1521 microversion: 2.1 time: 0.489678 Nov 09 20:09:14.102068 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 149/290] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:09:13 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1521 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:09:14.117242 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-ccba7c1e-accf-46da-9477-3ad3b402b567 tempest-VolumesNegativeTest-1335498923 tempest-VolumesNegativeTest-1335498923-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:09:14.118284 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-ccba7c1e-accf-46da-9477-3ad3b402b567 tempest-VolumesNegativeTest-1335498923 tempest-VolumesNegativeTest-1335498923-project] [instance: a584c766-9a09-4ae0-af66-50f92ab01886] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:09:14.128027 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ccba7c1e-accf-46da-9477-3ad3b402b567 tempest-VolumesNegativeTest-1335498923 tempest-VolumesNegativeTest-1335498923-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:14.128926 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ccba7c1e-accf-46da-9477-3ad3b402b567 tempest-VolumesNegativeTest-1335498923 tempest-VolumesNegativeTest-1335498923-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:14.133626 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ccba7c1e-accf-46da-9477-3ad3b402b567 tempest-VolumesNegativeTest-1335498923 tempest-VolumesNegativeTest-1335498923-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:14.134296 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ccba7c1e-accf-46da-9477-3ad3b402b567 tempest-VolumesNegativeTest-1335498923 tempest-VolumesNegativeTest-1335498923-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:14.175078 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-ccba7c1e-accf-46da-9477-3ad3b402b567 tempest-VolumesNegativeTest-1335498923 tempest-VolumesNegativeTest-1335498923-project] [instance: a584c766-9a09-4ae0-af66-50f92ab01886] Going to try to terminate instance {{(pid=116103) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 09 20:09:14.336224 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-ccba7c1e-accf-46da-9477-3ad3b402b567 tempest-VolumesNegativeTest-1335498923 tempest-VolumesNegativeTest-1335498923-project] 10.222.0.25 "DELETE /compute/v2.1/servers/a584c766-9a09-4ae0-af66-50f92ab01886" status: 204 len: 0 microversion: 2.1 time: 0.222375 Nov 09 20:09:14.340852 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 150/291] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Nov 9 20:09:14 2021] DELETE /compute/v2.1/servers/a584c766-9a09-4ae0-af66-50f92ab01886 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 09 20:09:14.347109 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-b8d7728c-ca55-45ae-9473-7ef0de388249 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:09:14.348164 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-b8d7728c-ca55-45ae-9473-7ef0de388249 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:09:14.362720 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b8d7728c-ca55-45ae-9473-7ef0de388249 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:14.363455 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b8d7728c-ca55-45ae-9473-7ef0de388249 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:14.365501 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b8d7728c-ca55-45ae-9473-7ef0de388249 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:14.366109 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b8d7728c-ca55-45ae-9473-7ef0de388249 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:14.401439 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-31089999-1879-4e91-82ef-bd1fc4e437be tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:09:14.413469 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-31089999-1879-4e91-82ef-bd1fc4e437be tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1318 microversion: 2.1 time: 0.387124 Nov 09 20:09:14.414060 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 142/292] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:09:14 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1318 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:09:14.418854 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-289463d2-b13b-4e62-b57a-40f07c277ad3 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:09:14.420014 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-289463d2-b13b-4e62-b57a-40f07c277ad3 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:09:14.426922 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-289463d2-b13b-4e62-b57a-40f07c277ad3 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:14.427377 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-289463d2-b13b-4e62-b57a-40f07c277ad3 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:14.428469 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-289463d2-b13b-4e62-b57a-40f07c277ad3 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:14.429257 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-289463d2-b13b-4e62-b57a-40f07c277ad3 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:14.464882 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-b8d7728c-ca55-45ae-9473-7ef0de388249 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "POST /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e/action" status: 200 len: 28687 microversion: 2.20 time: 0.122453 Nov 09 20:09:14.466357 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 151/293] 10.222.0.25 () {62 vars in 1318 bytes} [Tue Nov 9 20:09:14 2021] POST /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e/action => generated 28687 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 20:09:14.482346 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-84bcea75-58dc-4d05-8bcf-4606446160e1 tempest-VolumesNegativeTest-1335498923 tempest-VolumesNegativeTest-1335498923-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:09:14.483450 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-84bcea75-58dc-4d05-8bcf-4606446160e1 tempest-VolumesNegativeTest-1335498923 tempest-VolumesNegativeTest-1335498923-project] [instance: a584c766-9a09-4ae0-af66-50f92ab01886] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:09:14.496620 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-84bcea75-58dc-4d05-8bcf-4606446160e1 tempest-VolumesNegativeTest-1335498923 tempest-VolumesNegativeTest-1335498923-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:14.497603 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-84bcea75-58dc-4d05-8bcf-4606446160e1 tempest-VolumesNegativeTest-1335498923 tempest-VolumesNegativeTest-1335498923-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:14.498508 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-84bcea75-58dc-4d05-8bcf-4606446160e1 tempest-VolumesNegativeTest-1335498923 tempest-VolumesNegativeTest-1335498923-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:14.499376 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-84bcea75-58dc-4d05-8bcf-4606446160e1 tempest-VolumesNegativeTest-1335498923 tempest-VolumesNegativeTest-1335498923-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:14.533542 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-289463d2-b13b-4e62-b57a-40f07c277ad3 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "POST /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/action" status: 200 len: 28672 microversion: 2.1 time: 0.118194 Nov 09 20:09:14.534429 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 143/294] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Nov 9 20:09:14 2021] POST /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/action => generated 28672 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 20:09:14.684450 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-84bcea75-58dc-4d05-8bcf-4606446160e1 tempest-VolumesNegativeTest-1335498923 tempest-VolumesNegativeTest-1335498923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a524589370ee4a99af09d9d55613b940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13362a810cb04a01ad455f9e12d7c09c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:09:14.692098 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-84bcea75-58dc-4d05-8bcf-4606446160e1 tempest-VolumesNegativeTest-1335498923 tempest-VolumesNegativeTest-1335498923-project] 10.222.0.25 "GET /compute/v2.1/servers/a584c766-9a09-4ae0-af66-50f92ab01886" status: 200 len: 1471 microversion: 2.1 time: 0.224418 Nov 09 20:09:14.693836 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 152/295] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:09:14 2021] GET /compute/v2.1/servers/a584c766-9a09-4ae0-af66-50f92ab01886 => generated 1471 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:09:14.872380 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [req-6b50e34b-d538-4ea7-a894-b86542bb9d66 req-c3fb18ef-ba5c-46b9-80c4-e6a2cd63e756 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75e5847b-18ff-4332-be8a-f77ffae72997", "name": "network-vif-plugged", "status": "completed", "tag": "444d6d36-0a3d-4e0d-8c9a-cf6c03c32d1f"}]} {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:09:14.876314 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 20:09:14.876314 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: warnings.warn(msg) Nov 09 20:09:14.886543 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [req-6b50e34b-d538-4ea7-a894-b86542bb9d66 req-c3fb18ef-ba5c-46b9-80c4-e6a2cd63e756 service nova] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:14.886950 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [req-6b50e34b-d538-4ea7-a894-b86542bb9d66 req-c3fb18ef-ba5c-46b9-80c4-e6a2cd63e756 service nova] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:14.900813 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.compute.server_external_events [req-6b50e34b-d538-4ea7-a894-b86542bb9d66 req-c3fb18ef-ba5c-46b9-80c4-e6a2cd63e756 service nova] Creating event network-vif-plugged:444d6d36-0a3d-4e0d-8c9a-cf6c03c32d1f for instance 75e5847b-18ff-4332-be8a-f77ffae72997 on hv-cinder-80135 Nov 09 20:09:14.908805 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [req-6b50e34b-d538-4ea7-a894-b86542bb9d66 req-c3fb18ef-ba5c-46b9-80c4-e6a2cd63e756 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040733 Nov 09 20:09:14.909626 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 144/296] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Nov 9 20:09:14 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:09:15.122719 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-31d71f2b-9c6d-40e5-b335-8261f9b30d77 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:09:15.125167 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-31d71f2b-9c6d-40e5-b335-8261f9b30d77 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:09:15.154462 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-31d71f2b-9c6d-40e5-b335-8261f9b30d77 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:15.160174 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-31d71f2b-9c6d-40e5-b335-8261f9b30d77 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:15.167061 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-31d71f2b-9c6d-40e5-b335-8261f9b30d77 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:15.171771 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-31d71f2b-9c6d-40e5-b335-8261f9b30d77 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:15.431487 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-581b7333-802f-4485-9ec3-b340a496200e tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:09:15.432165 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-581b7333-802f-4485-9ec3-b340a496200e tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:09:15.446133 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-581b7333-802f-4485-9ec3-b340a496200e tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:15.446851 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-581b7333-802f-4485-9ec3-b340a496200e tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:15.453674 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-581b7333-802f-4485-9ec3-b340a496200e tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:15.454283 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-581b7333-802f-4485-9ec3-b340a496200e tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:15.467675 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-31d71f2b-9c6d-40e5-b335-8261f9b30d77 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:09:15.479633 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-31d71f2b-9c6d-40e5-b335-8261f9b30d77 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1521 microversion: 2.1 time: 0.363960 Nov 09 20:09:15.480722 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 153/297] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:09:15 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1521 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:09:15.486248 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-c48f1f1b-1854-4cdd-9830-99d795b820d4 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:09:15.489995 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-c48f1f1b-1854-4cdd-9830-99d795b820d4 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:09:15.499146 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c48f1f1b-1854-4cdd-9830-99d795b820d4 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:15.500539 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c48f1f1b-1854-4cdd-9830-99d795b820d4 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:15.508835 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c48f1f1b-1854-4cdd-9830-99d795b820d4 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:15.509615 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c48f1f1b-1854-4cdd-9830-99d795b820d4 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:15.587245 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-c48f1f1b-1854-4cdd-9830-99d795b820d4 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "POST /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e/action" status: 200 len: 28687 microversion: 2.20 time: 0.105202 Nov 09 20:09:15.588462 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 154/298] 10.222.0.25 () {62 vars in 1318 bytes} [Tue Nov 9 20:09:15 2021] POST /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e/action => generated 28687 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 20:09:15.594060 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-e495091f-8f9b-4d09-bf70-e5746d5db5d4 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:09:15.599325 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-e495091f-8f9b-4d09-bf70-e5746d5db5d4 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:09:15.610603 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e495091f-8f9b-4d09-bf70-e5746d5db5d4 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:15.611038 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e495091f-8f9b-4d09-bf70-e5746d5db5d4 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:15.621615 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e495091f-8f9b-4d09-bf70-e5746d5db5d4 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:15.623983 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e495091f-8f9b-4d09-bf70-e5746d5db5d4 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:15.723206 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-581b7333-802f-4485-9ec3-b340a496200e tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:09:15.734311 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-581b7333-802f-4485-9ec3-b340a496200e tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1318 microversion: 2.1 time: 0.305871 Nov 09 20:09:15.740219 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 145/299] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:09:15 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1318 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 20:09:15.752800 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-0b50db2a-c4de-406c-9953-ec9a839d7d85 tempest-VolumesNegativeTest-1335498923 tempest-VolumesNegativeTest-1335498923-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:09:15.753606 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-0b50db2a-c4de-406c-9953-ec9a839d7d85 tempest-VolumesNegativeTest-1335498923 tempest-VolumesNegativeTest-1335498923-project] [instance: a584c766-9a09-4ae0-af66-50f92ab01886] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:09:15.765052 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-0b50db2a-c4de-406c-9953-ec9a839d7d85 tempest-VolumesNegativeTest-1335498923 tempest-VolumesNegativeTest-1335498923-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:15.766599 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-0b50db2a-c4de-406c-9953-ec9a839d7d85 tempest-VolumesNegativeTest-1335498923 tempest-VolumesNegativeTest-1335498923-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:15.767568 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-0b50db2a-c4de-406c-9953-ec9a839d7d85 tempest-VolumesNegativeTest-1335498923 tempest-VolumesNegativeTest-1335498923-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:15.768163 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-0b50db2a-c4de-406c-9953-ec9a839d7d85 tempest-VolumesNegativeTest-1335498923 tempest-VolumesNegativeTest-1335498923-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:15.936381 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-e495091f-8f9b-4d09-bf70-e5746d5db5d4 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "POST /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/action" status: 200 len: 28672 microversion: 2.1 time: 0.346228 Nov 09 20:09:15.938524 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 155/300] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Nov 9 20:09:15 2021] POST /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/action => generated 28672 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 20:09:16.008936 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-0b50db2a-c4de-406c-9953-ec9a839d7d85 tempest-VolumesNegativeTest-1335498923 tempest-VolumesNegativeTest-1335498923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a524589370ee4a99af09d9d55613b940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13362a810cb04a01ad455f9e12d7c09c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:09:16.033283 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-0b50db2a-c4de-406c-9953-ec9a839d7d85 tempest-VolumesNegativeTest-1335498923 tempest-VolumesNegativeTest-1335498923-project] 10.222.0.25 "GET /compute/v2.1/servers/a584c766-9a09-4ae0-af66-50f92ab01886" status: 200 len: 1471 microversion: 2.1 time: 0.278450 Nov 09 20:09:16.047363 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 146/301] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:09:15 2021] GET /compute/v2.1/servers/a584c766-9a09-4ae0-af66-50f92ab01886 => generated 1471 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:09:16.499477 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-f5a227b7-16b7-4bc2-bc64-8718d46cffd4 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:09:16.500287 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-f5a227b7-16b7-4bc2-bc64-8718d46cffd4 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:09:16.509765 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f5a227b7-16b7-4bc2-bc64-8718d46cffd4 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:16.510486 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f5a227b7-16b7-4bc2-bc64-8718d46cffd4 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:16.511595 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f5a227b7-16b7-4bc2-bc64-8718d46cffd4 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:16.512207 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f5a227b7-16b7-4bc2-bc64-8718d46cffd4 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:16.599687 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-ac150805-7f22-48db-8b1a-9ab9788d5907 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:09:16.601492 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-ac150805-7f22-48db-8b1a-9ab9788d5907 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:09:16.616604 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ac150805-7f22-48db-8b1a-9ab9788d5907 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:16.617336 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ac150805-7f22-48db-8b1a-9ab9788d5907 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:16.618329 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ac150805-7f22-48db-8b1a-9ab9788d5907 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:16.618919 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ac150805-7f22-48db-8b1a-9ab9788d5907 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:16.761656 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-ac150805-7f22-48db-8b1a-9ab9788d5907 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "POST /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e/action" status: 200 len: 28687 microversion: 2.20 time: 0.165603 Nov 09 20:09:16.762956 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 147/302] 10.222.0.25 () {62 vars in 1318 bytes} [Tue Nov 9 20:09:16 2021] POST /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e/action => generated 28687 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 20:09:16.779837 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-7cf2a375-3176-4da1-9fae-52bb3b165bc5 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:09:16.781138 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-7cf2a375-3176-4da1-9fae-52bb3b165bc5 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:09:16.795845 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-f5a227b7-16b7-4bc2-bc64-8718d46cffd4 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:09:16.800830 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-7cf2a375-3176-4da1-9fae-52bb3b165bc5 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:16.802730 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-7cf2a375-3176-4da1-9fae-52bb3b165bc5 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:16.804587 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-f5a227b7-16b7-4bc2-bc64-8718d46cffd4 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1521 microversion: 2.1 time: 0.312036 Nov 09 20:09:16.806133 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 156/303] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:09:16 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1521 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:09:16.815633 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-7cf2a375-3176-4da1-9fae-52bb3b165bc5 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:16.815633 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-7cf2a375-3176-4da1-9fae-52bb3b165bc5 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:16.949798 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-a07bff0b-fa2d-4751-8198-93a8eaae332b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:09:16.951662 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-a07bff0b-fa2d-4751-8198-93a8eaae332b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:09:16.964931 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a07bff0b-fa2d-4751-8198-93a8eaae332b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:16.965666 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a07bff0b-fa2d-4751-8198-93a8eaae332b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:16.966635 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a07bff0b-fa2d-4751-8198-93a8eaae332b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:16.967322 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a07bff0b-fa2d-4751-8198-93a8eaae332b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:17.015402 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-7cf2a375-3176-4da1-9fae-52bb3b165bc5 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:09:17.024298 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-7cf2a375-3176-4da1-9fae-52bb3b165bc5 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1318 microversion: 2.1 time: 0.259968 Nov 09 20:09:17.024922 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 148/304] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:09:16 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1318 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:09:17.052847 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-fbda246f-4d50-4616-b6f4-f75220d7704f tempest-VolumesNegativeTest-1335498923 tempest-VolumesNegativeTest-1335498923-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:09:17.053447 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-fbda246f-4d50-4616-b6f4-f75220d7704f tempest-VolumesNegativeTest-1335498923 tempest-VolumesNegativeTest-1335498923-project] [instance: a584c766-9a09-4ae0-af66-50f92ab01886] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:09:17.066753 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-fbda246f-4d50-4616-b6f4-f75220d7704f tempest-VolumesNegativeTest-1335498923 tempest-VolumesNegativeTest-1335498923-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:17.067244 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-fbda246f-4d50-4616-b6f4-f75220d7704f tempest-VolumesNegativeTest-1335498923 tempest-VolumesNegativeTest-1335498923-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:17.068659 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-fbda246f-4d50-4616-b6f4-f75220d7704f tempest-VolumesNegativeTest-1335498923 tempest-VolumesNegativeTest-1335498923-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:17.069107 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-fbda246f-4d50-4616-b6f4-f75220d7704f tempest-VolumesNegativeTest-1335498923 tempest-VolumesNegativeTest-1335498923-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:17.152691 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-a07bff0b-fa2d-4751-8198-93a8eaae332b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "POST /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/action" status: 200 len: 28672 microversion: 2.1 time: 0.204100 Nov 09 20:09:17.154027 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 157/305] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Nov 9 20:09:16 2021] POST /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/action => generated 28672 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 09 20:09:17.775978 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-a9fed210-8723-4a80-a06f-3be9b7026af5 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:09:17.778080 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-a9fed210-8723-4a80-a06f-3be9b7026af5 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:09:17.811806 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a9fed210-8723-4a80-a06f-3be9b7026af5 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:17.815209 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a9fed210-8723-4a80-a06f-3be9b7026af5 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:17.816178 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a9fed210-8723-4a80-a06f-3be9b7026af5 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:17.829313 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a9fed210-8723-4a80-a06f-3be9b7026af5 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:17.843810 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-fbda246f-4d50-4616-b6f4-f75220d7704f tempest-VolumesNegativeTest-1335498923 tempest-VolumesNegativeTest-1335498923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a524589370ee4a99af09d9d55613b940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13362a810cb04a01ad455f9e12d7c09c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:09:17.858436 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-fbda246f-4d50-4616-b6f4-f75220d7704f tempest-VolumesNegativeTest-1335498923 tempest-VolumesNegativeTest-1335498923-project] 10.222.0.25 "GET /compute/v2.1/servers/a584c766-9a09-4ae0-af66-50f92ab01886" status: 200 len: 1471 microversion: 2.1 time: 0.807990 Nov 09 20:09:17.859045 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 149/306] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:09:17 2021] GET /compute/v2.1/servers/a584c766-9a09-4ae0-af66-50f92ab01886 => generated 1471 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:09:17.867096 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-c60714fc-116e-48e2-85de-668a0ee13655 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:09:17.881443 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-c60714fc-116e-48e2-85de-668a0ee13655 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:09:17.892279 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c60714fc-116e-48e2-85de-668a0ee13655 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:17.893030 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c60714fc-116e-48e2-85de-668a0ee13655 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:17.893827 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c60714fc-116e-48e2-85de-668a0ee13655 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:17.894262 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c60714fc-116e-48e2-85de-668a0ee13655 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:17.954850 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-a9fed210-8723-4a80-a06f-3be9b7026af5 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "POST /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e/action" status: 200 len: 28687 microversion: 2.20 time: 0.184419 Nov 09 20:09:17.961328 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 158/307] 10.222.0.25 () {62 vars in 1318 bytes} [Tue Nov 9 20:09:17 2021] POST /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e/action => generated 28687 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 20:09:18.049318 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-d6c2f738-828c-4915-94b1-a52cadb9daed tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:09:18.050377 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-d6c2f738-828c-4915-94b1-a52cadb9daed tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:09:18.071507 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d6c2f738-828c-4915-94b1-a52cadb9daed tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:18.072320 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d6c2f738-828c-4915-94b1-a52cadb9daed tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:18.076308 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d6c2f738-828c-4915-94b1-a52cadb9daed tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:18.078394 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d6c2f738-828c-4915-94b1-a52cadb9daed tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:18.221944 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-c60714fc-116e-48e2-85de-668a0ee13655 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:09:18.236338 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-c60714fc-116e-48e2-85de-668a0ee13655 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1521 microversion: 2.1 time: 0.375315 Nov 09 20:09:18.237320 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 150/308] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:09:17 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1521 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:09:18.251608 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-e5836438-b7a3-4f3a-9719-2b170abf68cf tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:09:18.254546 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-e5836438-b7a3-4f3a-9719-2b170abf68cf tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:09:18.266259 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e5836438-b7a3-4f3a-9719-2b170abf68cf tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:18.270365 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e5836438-b7a3-4f3a-9719-2b170abf68cf tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:18.272519 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e5836438-b7a3-4f3a-9719-2b170abf68cf tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:18.273178 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e5836438-b7a3-4f3a-9719-2b170abf68cf tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:18.409334 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-e5836438-b7a3-4f3a-9719-2b170abf68cf tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "POST /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/action" status: 200 len: 28672 microversion: 2.1 time: 0.170369 Nov 09 20:09:18.412237 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 151/309] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Nov 9 20:09:18 2021] POST /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/action => generated 28672 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 20:09:18.483923 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-d6c2f738-828c-4915-94b1-a52cadb9daed tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:09:18.496279 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-d6c2f738-828c-4915-94b1-a52cadb9daed tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1508 microversion: 2.1 time: 0.454356 Nov 09 20:09:18.504572 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 159/310] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:09:18 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1508 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:09:18.888848 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-8d638b42-0cce-49c2-9b82-fea38aba7ef0 tempest-VolumesNegativeTest-1335498923 tempest-VolumesNegativeTest-1335498923-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:09:18.890091 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-8d638b42-0cce-49c2-9b82-fea38aba7ef0 tempest-VolumesNegativeTest-1335498923 tempest-VolumesNegativeTest-1335498923-project] [instance: a584c766-9a09-4ae0-af66-50f92ab01886] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:09:18.909696 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-8d638b42-0cce-49c2-9b82-fea38aba7ef0 tempest-VolumesNegativeTest-1335498923 tempest-VolumesNegativeTest-1335498923-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:18.910145 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-8d638b42-0cce-49c2-9b82-fea38aba7ef0 tempest-VolumesNegativeTest-1335498923 tempest-VolumesNegativeTest-1335498923-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:18.912547 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-8d638b42-0cce-49c2-9b82-fea38aba7ef0 tempest-VolumesNegativeTest-1335498923 tempest-VolumesNegativeTest-1335498923-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:18.913151 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-8d638b42-0cce-49c2-9b82-fea38aba7ef0 tempest-VolumesNegativeTest-1335498923 tempest-VolumesNegativeTest-1335498923-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:18.967577 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-079e87af-3eaf-4220-849c-85c581754794 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:09:18.969375 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-079e87af-3eaf-4220-849c-85c581754794 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:09:19.002208 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-079e87af-3eaf-4220-849c-85c581754794 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:19.002704 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-079e87af-3eaf-4220-849c-85c581754794 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:19.003611 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-079e87af-3eaf-4220-849c-85c581754794 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:19.008384 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-079e87af-3eaf-4220-849c-85c581754794 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:19.041511 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-8d638b42-0cce-49c2-9b82-fea38aba7ef0 tempest-VolumesNegativeTest-1335498923 tempest-VolumesNegativeTest-1335498923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a524589370ee4a99af09d9d55613b940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13362a810cb04a01ad455f9e12d7c09c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:09:19.059304 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-8d638b42-0cce-49c2-9b82-fea38aba7ef0 tempest-VolumesNegativeTest-1335498923 tempest-VolumesNegativeTest-1335498923-project] 10.222.0.25 "GET /compute/v2.1/servers/a584c766-9a09-4ae0-af66-50f92ab01886" status: 200 len: 1429 microversion: 2.1 time: 0.184433 Nov 09 20:09:19.059862 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 152/311] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:09:18 2021] GET /compute/v2.1/servers/a584c766-9a09-4ae0-af66-50f92ab01886 => generated 1429 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:09:19.191050 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-079e87af-3eaf-4220-849c-85c581754794 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "POST /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e/action" status: 200 len: 29104 microversion: 2.20 time: 0.226211 Nov 09 20:09:19.191727 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 160/312] 10.222.0.25 () {62 vars in 1318 bytes} [Tue Nov 9 20:09:18 2021] POST /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e/action => generated 29104 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 20:09:19.208531 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [req-7849ca63-48e5-4d30-b0c8-f96aa532dd00 req-46a56ef4-9b0f-46d1-8a4f-851a4920905a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a584c766-9a09-4ae0-af66-50f92ab01886", "name": "network-vif-deleted", "tag": "3fd3fcd5-ca67-4fea-b422-278c129e1d72"}]} {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:09:19.210773 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 20:09:19.210773 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: warnings.warn(msg) Nov 09 20:09:19.257157 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-22fc19cd-2ffc-4b03-a9a8-11c0238cd3a3 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:09:19.261986 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-22fc19cd-2ffc-4b03-a9a8-11c0238cd3a3 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:09:19.268213 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [req-7849ca63-48e5-4d30-b0c8-f96aa532dd00 req-46a56ef4-9b0f-46d1-8a4f-851a4920905a service nova] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:19.269576 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [req-7849ca63-48e5-4d30-b0c8-f96aa532dd00 req-46a56ef4-9b0f-46d1-8a4f-851a4920905a service nova] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:19.296817 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-22fc19cd-2ffc-4b03-a9a8-11c0238cd3a3 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:19.297325 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-22fc19cd-2ffc-4b03-a9a8-11c0238cd3a3 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:19.298175 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-22fc19cd-2ffc-4b03-a9a8-11c0238cd3a3 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:19.298612 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-22fc19cd-2ffc-4b03-a9a8-11c0238cd3a3 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:19.339377 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.compute.server_external_events [req-7849ca63-48e5-4d30-b0c8-f96aa532dd00 req-46a56ef4-9b0f-46d1-8a4f-851a4920905a service nova] Creating event network-vif-deleted:3fd3fcd5-ca67-4fea-b422-278c129e1d72 for instance a584c766-9a09-4ae0-af66-50f92ab01886 on hv-cinder-80135 Nov 09 20:09:19.366417 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [req-7849ca63-48e5-4d30-b0c8-f96aa532dd00 req-46a56ef4-9b0f-46d1-8a4f-851a4920905a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.165654 Nov 09 20:09:19.381245 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 153/313] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Nov 9 20:09:19 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 20:09:19.428152 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-57a30d23-1e27-4925-ab06-a35b9a95db76 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:09:19.432061 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-57a30d23-1e27-4925-ab06-a35b9a95db76 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:09:19.453098 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-57a30d23-1e27-4925-ab06-a35b9a95db76 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:19.454460 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-57a30d23-1e27-4925-ab06-a35b9a95db76 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:19.455432 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-57a30d23-1e27-4925-ab06-a35b9a95db76 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:19.458293 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-57a30d23-1e27-4925-ab06-a35b9a95db76 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:19.665694 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-57a30d23-1e27-4925-ab06-a35b9a95db76 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "POST /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/action" status: 200 len: 29361 microversion: 2.1 time: 0.245438 Nov 09 20:09:19.667934 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 154/314] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Nov 9 20:09:19 2021] POST /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/action => generated 29361 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 20:09:19.827472 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-22fc19cd-2ffc-4b03-a9a8-11c0238cd3a3 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:09:19.845896 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-22fc19cd-2ffc-4b03-a9a8-11c0238cd3a3 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1521 microversion: 2.1 time: 0.589639 Nov 09 20:09:19.846596 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 161/315] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:09:19 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1521 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:09:20.078122 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-cd83f57d-bc49-4586-a5d3-2c051dd26126 tempest-VolumesNegativeTest-1335498923 tempest-VolumesNegativeTest-1335498923-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:09:20.080126 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-cd83f57d-bc49-4586-a5d3-2c051dd26126 tempest-VolumesNegativeTest-1335498923 tempest-VolumesNegativeTest-1335498923-project] [instance: a584c766-9a09-4ae0-af66-50f92ab01886] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:09:20.095255 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-cd83f57d-bc49-4586-a5d3-2c051dd26126 tempest-VolumesNegativeTest-1335498923 tempest-VolumesNegativeTest-1335498923-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:20.100212 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-cd83f57d-bc49-4586-a5d3-2c051dd26126 tempest-VolumesNegativeTest-1335498923 tempest-VolumesNegativeTest-1335498923-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:20.101330 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-cd83f57d-bc49-4586-a5d3-2c051dd26126 tempest-VolumesNegativeTest-1335498923 tempest-VolumesNegativeTest-1335498923-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:20.105576 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-cd83f57d-bc49-4586-a5d3-2c051dd26126 tempest-VolumesNegativeTest-1335498923 tempest-VolumesNegativeTest-1335498923-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:20.204366 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-9dfb95b6-dbb2-4a4d-8bb8-7fb60cdbab29 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:09:20.206369 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-9dfb95b6-dbb2-4a4d-8bb8-7fb60cdbab29 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:09:20.221308 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9dfb95b6-dbb2-4a4d-8bb8-7fb60cdbab29 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:20.230315 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9dfb95b6-dbb2-4a4d-8bb8-7fb60cdbab29 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:20.231421 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9dfb95b6-dbb2-4a4d-8bb8-7fb60cdbab29 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:20.243723 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9dfb95b6-dbb2-4a4d-8bb8-7fb60cdbab29 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:20.263124 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-cd83f57d-bc49-4586-a5d3-2c051dd26126 tempest-VolumesNegativeTest-1335498923 tempest-VolumesNegativeTest-1335498923-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:20.263584 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-cd83f57d-bc49-4586-a5d3-2c051dd26126 tempest-VolumesNegativeTest-1335498923 tempest-VolumesNegativeTest-1335498923-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:20.264060 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.objects.instance [None req-cd83f57d-bc49-4586-a5d3-2c051dd26126 tempest-VolumesNegativeTest-1335498923 tempest-VolumesNegativeTest-1335498923-project] Lazy-loading 'fault' on Instance uuid a584c766-9a09-4ae0-af66-50f92ab01886 {{(pid=116102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 09 20:09:20.422715 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-9dfb95b6-dbb2-4a4d-8bb8-7fb60cdbab29 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "POST /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e/action" status: 200 len: 30055 microversion: 2.20 time: 0.222081 Nov 09 20:09:20.428531 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 162/316] 10.222.0.25 () {62 vars in 1318 bytes} [Tue Nov 9 20:09:20 2021] POST /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e/action => generated 30055 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 09 20:09:20.437954 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-cd83f57d-bc49-4586-a5d3-2c051dd26126 tempest-VolumesNegativeTest-1335498923 tempest-VolumesNegativeTest-1335498923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a524589370ee4a99af09d9d55613b940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13362a810cb04a01ad455f9e12d7c09c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:09:20.446915 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-cd83f57d-bc49-4586-a5d3-2c051dd26126 tempest-VolumesNegativeTest-1335498923 tempest-VolumesNegativeTest-1335498923-project] 10.222.0.25 "GET /compute/v2.1/servers/a584c766-9a09-4ae0-af66-50f92ab01886" status: 200 len: 1305 microversion: 2.1 time: 0.373506 Nov 09 20:09:20.449297 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 155/317] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:09:20 2021] GET /compute/v2.1/servers/a584c766-9a09-4ae0-af66-50f92ab01886 => generated 1305 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:09:20.679901 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-e2790cd2-e77c-4c6d-9ecf-08bc36ef8f37 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:09:20.681237 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-e2790cd2-e77c-4c6d-9ecf-08bc36ef8f37 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:09:20.713607 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e2790cd2-e77c-4c6d-9ecf-08bc36ef8f37 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:20.714075 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e2790cd2-e77c-4c6d-9ecf-08bc36ef8f37 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:20.717985 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e2790cd2-e77c-4c6d-9ecf-08bc36ef8f37 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:20.718461 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e2790cd2-e77c-4c6d-9ecf-08bc36ef8f37 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:20.871483 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-df9abeaf-47c5-48ab-ade0-59c46b5501da tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:09:20.872726 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-df9abeaf-47c5-48ab-ade0-59c46b5501da tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:09:20.881861 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-df9abeaf-47c5-48ab-ade0-59c46b5501da tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:20.883513 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-df9abeaf-47c5-48ab-ade0-59c46b5501da tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:20.887549 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-df9abeaf-47c5-48ab-ade0-59c46b5501da tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:20.888270 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-df9abeaf-47c5-48ab-ade0-59c46b5501da tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:20.891766 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-e2790cd2-e77c-4c6d-9ecf-08bc36ef8f37 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "POST /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/action" status: 200 len: 30430 microversion: 2.1 time: 0.216562 Nov 09 20:09:20.892428 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 163/318] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Nov 9 20:09:20 2021] POST /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/action => generated 30430 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 20:09:21.319732 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-df9abeaf-47c5-48ab-ade0-59c46b5501da tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:09:21.331103 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-df9abeaf-47c5-48ab-ade0-59c46b5501da tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1521 microversion: 2.1 time: 0.468573 Nov 09 20:09:21.343555 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 156/319] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:09:20 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1521 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:09:21.439837 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-dc483d47-d489-424a-a116-51befa9a9c5a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:09:21.444011 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-dc483d47-d489-424a-a116-51befa9a9c5a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:09:21.463162 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-dc483d47-d489-424a-a116-51befa9a9c5a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:21.463859 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-dc483d47-d489-424a-a116-51befa9a9c5a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:21.465715 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-0e8f45c9-a78c-4310-9395-2f63f5bc2680 tempest-VolumesNegativeTest-1335498923 tempest-VolumesNegativeTest-1335498923-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:09:21.466516 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-0e8f45c9-a78c-4310-9395-2f63f5bc2680 tempest-VolumesNegativeTest-1335498923 tempest-VolumesNegativeTest-1335498923-project] [instance: a584c766-9a09-4ae0-af66-50f92ab01886] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:09:21.468647 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-dc483d47-d489-424a-a116-51befa9a9c5a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:21.469314 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-dc483d47-d489-424a-a116-51befa9a9c5a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:21.477716 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-0e8f45c9-a78c-4310-9395-2f63f5bc2680 tempest-VolumesNegativeTest-1335498923 tempest-VolumesNegativeTest-1335498923-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:21.478434 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-0e8f45c9-a78c-4310-9395-2f63f5bc2680 tempest-VolumesNegativeTest-1335498923 tempest-VolumesNegativeTest-1335498923-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:21.483113 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-0e8f45c9-a78c-4310-9395-2f63f5bc2680 tempest-VolumesNegativeTest-1335498923 tempest-VolumesNegativeTest-1335498923-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:21.483781 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-0e8f45c9-a78c-4310-9395-2f63f5bc2680 tempest-VolumesNegativeTest-1335498923 tempest-VolumesNegativeTest-1335498923-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:21.501342 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.wsgi [None req-0e8f45c9-a78c-4310-9395-2f63f5bc2680 tempest-VolumesNegativeTest-1335498923 tempest-VolumesNegativeTest-1335498923-project] HTTP exception thrown: Instance a584c766-9a09-4ae0-af66-50f92ab01886 could not be found. Nov 09 20:09:21.502211 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-0e8f45c9-a78c-4310-9395-2f63f5bc2680 tempest-VolumesNegativeTest-1335498923 tempest-VolumesNegativeTest-1335498923-project] Returning 404 to user: Instance a584c766-9a09-4ae0-af66-50f92ab01886 could not be found. {{(pid=116102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 09 20:09:21.503196 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-0e8f45c9-a78c-4310-9395-2f63f5bc2680 tempest-VolumesNegativeTest-1335498923 tempest-VolumesNegativeTest-1335498923-project] 10.222.0.25 "GET /compute/v2.1/servers/a584c766-9a09-4ae0-af66-50f92ab01886" status: 404 len: 111 microversion: 2.1 time: 0.041353 Nov 09 20:09:21.504552 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 157/320] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:09:21 2021] GET /compute/v2.1/servers/a584c766-9a09-4ae0-af66-50f92ab01886 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 09 20:09:21.633408 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-dc483d47-d489-424a-a116-51befa9a9c5a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "POST /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e/action" status: 200 len: 30987 microversion: 2.20 time: 0.199625 Nov 09 20:09:21.638866 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 164/321] 10.222.0.25 () {62 vars in 1318 bytes} [Tue Nov 9 20:09:21 2021] POST /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e/action => generated 30987 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 20:09:21.907309 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-51e1df7c-1b55-4e92-8666-f5f2fdcc5c17 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:09:21.908284 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-51e1df7c-1b55-4e92-8666-f5f2fdcc5c17 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:09:21.919301 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-51e1df7c-1b55-4e92-8666-f5f2fdcc5c17 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:21.919749 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-51e1df7c-1b55-4e92-8666-f5f2fdcc5c17 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:21.920570 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-51e1df7c-1b55-4e92-8666-f5f2fdcc5c17 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:21.921002 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-51e1df7c-1b55-4e92-8666-f5f2fdcc5c17 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:22.135566 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-51e1df7c-1b55-4e92-8666-f5f2fdcc5c17 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "POST /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/action" status: 200 len: 31371 microversion: 2.1 time: 0.232615 Nov 09 20:09:22.138186 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 158/322] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Nov 9 20:09:21 2021] POST /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/action => generated 31371 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 20:09:22.358448 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-e3d757fd-f45a-47d9-8920-9df7537851ed tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:09:22.359465 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-e3d757fd-f45a-47d9-8920-9df7537851ed tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:09:22.376622 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e3d757fd-f45a-47d9-8920-9df7537851ed tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:22.377074 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e3d757fd-f45a-47d9-8920-9df7537851ed tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:22.377855 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e3d757fd-f45a-47d9-8920-9df7537851ed tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:22.378281 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e3d757fd-f45a-47d9-8920-9df7537851ed tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:22.710876 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-e3d757fd-f45a-47d9-8920-9df7537851ed tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:09:22.730418 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-e3d757fd-f45a-47d9-8920-9df7537851ed tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1521 microversion: 2.1 time: 0.384427 Nov 09 20:09:22.731275 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 165/323] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:09:22 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1521 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:09:22.736766 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-c7d9d655-1455-456d-8788-a6dee070f302 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:09:22.737851 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-c7d9d655-1455-456d-8788-a6dee070f302 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:09:22.748816 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c7d9d655-1455-456d-8788-a6dee070f302 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:22.749321 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c7d9d655-1455-456d-8788-a6dee070f302 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:22.750148 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c7d9d655-1455-456d-8788-a6dee070f302 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:22.750722 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c7d9d655-1455-456d-8788-a6dee070f302 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:22.896721 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-c7d9d655-1455-456d-8788-a6dee070f302 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "POST /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e/action" status: 200 len: 32111 microversion: 2.20 time: 0.163174 Nov 09 20:09:22.898569 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 166/324] 10.222.0.25 () {62 vars in 1318 bytes} [Tue Nov 9 20:09:22 2021] POST /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e/action => generated 32111 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 20:09:23.117117 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-40946ab1-c7f0-4346-a952-59a3136735c7 tempest-TestShelveInstance-1171628010 tempest-TestShelveInstance-1171628010-project] Action: 'create', calling method: .version_select at 0x7fab36e11ee0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1405938832"}} {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:09:23.132993 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.quota [None req-40946ab1-c7f0-4346-a952-59a3136735c7 tempest-TestShelveInstance-1171628010 tempest-TestShelveInstance-1171628010-project] Getting quotas for project dc0643391d7d48d9a52c3a9da9ce349b. Resources: {'key_pairs'} {{(pid=116102) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 09 20:09:23.137394 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.quota [None req-40946ab1-c7f0-4346-a952-59a3136735c7 tempest-TestShelveInstance-1171628010 tempest-TestShelveInstance-1171628010-project] Getting quotas for user de047726d18e4938b5ba15fb08b3d93c and project dc0643391d7d48d9a52c3a9da9ce349b. Resources: {'key_pairs'} {{(pid=116102) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 09 20:09:23.147510 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-0671c8a8-1d40-4906-b02f-317279cfbfae tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:09:23.148699 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-0671c8a8-1d40-4906-b02f-317279cfbfae tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:09:23.158491 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0671c8a8-1d40-4906-b02f-317279cfbfae tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:23.158942 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0671c8a8-1d40-4906-b02f-317279cfbfae tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:23.159905 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0671c8a8-1d40-4906-b02f-317279cfbfae tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:23.160506 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0671c8a8-1d40-4906-b02f-317279cfbfae tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:23.292759 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-0671c8a8-1d40-4906-b02f-317279cfbfae tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "POST /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/action" status: 200 len: 32250 microversion: 2.1 time: 0.148961 Nov 09 20:09:23.297033 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 167/325] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Nov 9 20:09:23 2021] POST /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/action => generated 32250 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 09 20:09:23.493924 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.quota [None req-40946ab1-c7f0-4346-a952-59a3136735c7 tempest-TestShelveInstance-1171628010 tempest-TestShelveInstance-1171628010-project] Getting quotas for project dc0643391d7d48d9a52c3a9da9ce349b. Resources: {'key_pairs'} {{(pid=116102) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 09 20:09:23.498459 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.quota [None req-40946ab1-c7f0-4346-a952-59a3136735c7 tempest-TestShelveInstance-1171628010 tempest-TestShelveInstance-1171628010-project] Getting quotas for user de047726d18e4938b5ba15fb08b3d93c and project dc0643391d7d48d9a52c3a9da9ce349b. Resources: {'key_pairs'} {{(pid=116102) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 09 20:09:23.515669 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-40946ab1-c7f0-4346-a952-59a3136735c7 tempest-TestShelveInstance-1171628010 tempest-TestShelveInstance-1171628010-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 2316 microversion: 2.1 time: 0.912197 Nov 09 20:09:23.516849 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 159/326] 10.222.0.25 () {60 vars in 1157 bytes} [Tue Nov 9 20:09:22 2021] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:09:23.749413 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-12c713c0-b985-4409-8107-a41d249da93c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:09:23.752155 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-12c713c0-b985-4409-8107-a41d249da93c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:09:23.775818 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-12c713c0-b985-4409-8107-a41d249da93c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:23.777606 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-12c713c0-b985-4409-8107-a41d249da93c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:23.779616 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-12c713c0-b985-4409-8107-a41d249da93c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:23.780460 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-12c713c0-b985-4409-8107-a41d249da93c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:23.911629 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-3cbf86c3-d075-4114-acc8-99a5fd12801a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:09:23.913019 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-3cbf86c3-d075-4114-acc8-99a5fd12801a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:09:23.929374 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-3cbf86c3-d075-4114-acc8-99a5fd12801a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:23.930052 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-3cbf86c3-d075-4114-acc8-99a5fd12801a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:23.931177 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-3cbf86c3-d075-4114-acc8-99a5fd12801a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:23.931754 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-3cbf86c3-d075-4114-acc8-99a5fd12801a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:24.055450 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-3cbf86c3-d075-4114-acc8-99a5fd12801a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "POST /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e/action" status: 200 len: 33104 microversion: 2.20 time: 0.146179 Nov 09 20:09:24.058263 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 160/327] 10.222.0.25 () {62 vars in 1318 bytes} [Tue Nov 9 20:09:23 2021] POST /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e/action => generated 33104 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 20:09:24.138941 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-12c713c0-b985-4409-8107-a41d249da93c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:09:24.147923 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-12c713c0-b985-4409-8107-a41d249da93c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1521 microversion: 2.1 time: 0.403323 Nov 09 20:09:24.161863 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 168/328] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:09:23 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1521 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:09:24.305398 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-efecdbcd-107f-43a6-ad4a-1e5561d402aa tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:09:24.310375 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-efecdbcd-107f-43a6-ad4a-1e5561d402aa tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:09:24.324295 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-efecdbcd-107f-43a6-ad4a-1e5561d402aa tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:24.328095 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-efecdbcd-107f-43a6-ad4a-1e5561d402aa tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:24.329937 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-efecdbcd-107f-43a6-ad4a-1e5561d402aa tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:24.330374 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-efecdbcd-107f-43a6-ad4a-1e5561d402aa tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:24.445591 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-efecdbcd-107f-43a6-ad4a-1e5561d402aa tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "POST /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/action" status: 200 len: 32933 microversion: 2.1 time: 0.144896 Nov 09 20:09:24.447140 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 161/329] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Nov 9 20:09:24 2021] POST /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/action => generated 32933 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 20:09:25.071096 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-dd21560a-72fa-4a76-aab8-03eca484d8e9 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:09:25.072014 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-dd21560a-72fa-4a76-aab8-03eca484d8e9 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:09:25.080297 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-dd21560a-72fa-4a76-aab8-03eca484d8e9 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:25.080982 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-dd21560a-72fa-4a76-aab8-03eca484d8e9 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:25.081963 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-dd21560a-72fa-4a76-aab8-03eca484d8e9 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:25.082563 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-dd21560a-72fa-4a76-aab8-03eca484d8e9 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:25.174423 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-a00fe521-1267-4d80-8d6e-f422cbae863d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:09:25.178121 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-a00fe521-1267-4d80-8d6e-f422cbae863d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:09:25.193216 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a00fe521-1267-4d80-8d6e-f422cbae863d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:25.193881 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a00fe521-1267-4d80-8d6e-f422cbae863d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:25.195543 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a00fe521-1267-4d80-8d6e-f422cbae863d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:25.196538 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a00fe521-1267-4d80-8d6e-f422cbae863d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:25.206549 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-dd21560a-72fa-4a76-aab8-03eca484d8e9 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "POST /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e/action" status: 200 len: 33507 microversion: 2.20 time: 0.139913 Nov 09 20:09:25.207570 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 169/330] 10.222.0.25 () {62 vars in 1318 bytes} [Tue Nov 9 20:09:25 2021] POST /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e/action => generated 33507 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 09 20:09:25.448592 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-a00fe521-1267-4d80-8d6e-f422cbae863d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:09:25.455929 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-a00fe521-1267-4d80-8d6e-f422cbae863d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1521 microversion: 2.1 time: 0.289543 Nov 09 20:09:25.465503 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 162/331] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:09:25 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1521 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:09:25.465702 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-31c4a92b-242d-4b2f-b5df-9c925178ca3c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:09:25.465702 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-31c4a92b-242d-4b2f-b5df-9c925178ca3c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:09:25.467197 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-31c4a92b-242d-4b2f-b5df-9c925178ca3c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:25.467639 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-31c4a92b-242d-4b2f-b5df-9c925178ca3c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:25.468444 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-31c4a92b-242d-4b2f-b5df-9c925178ca3c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:25.469003 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-31c4a92b-242d-4b2f-b5df-9c925178ca3c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:25.569091 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-31c4a92b-242d-4b2f-b5df-9c925178ca3c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "POST /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/action" status: 200 len: 33395 microversion: 2.1 time: 0.114790 Nov 09 20:09:25.570770 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 170/332] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Nov 9 20:09:25 2021] POST /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/action => generated 33395 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 09 20:09:26.219162 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-41a6de61-bb76-439d-8ebf-436cd4930ef8 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:09:26.220229 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-41a6de61-bb76-439d-8ebf-436cd4930ef8 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:09:26.231665 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-41a6de61-bb76-439d-8ebf-436cd4930ef8 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:26.232120 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-41a6de61-bb76-439d-8ebf-436cd4930ef8 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:26.250060 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-41a6de61-bb76-439d-8ebf-436cd4930ef8 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:26.250913 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-41a6de61-bb76-439d-8ebf-436cd4930ef8 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:26.370910 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-41a6de61-bb76-439d-8ebf-436cd4930ef8 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "POST /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e/action" status: 200 len: 33987 microversion: 2.20 time: 0.155360 Nov 09 20:09:26.372732 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 163/333] 10.222.0.25 () {62 vars in 1318 bytes} [Tue Nov 9 20:09:26 2021] POST /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e/action => generated 33987 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 09 20:09:26.473898 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-7722a394-ef74-48a1-9297-c679c1d8eaad tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:09:26.475323 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-7722a394-ef74-48a1-9297-c679c1d8eaad tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:09:26.488100 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7722a394-ef74-48a1-9297-c679c1d8eaad tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:26.488835 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7722a394-ef74-48a1-9297-c679c1d8eaad tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:26.490338 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7722a394-ef74-48a1-9297-c679c1d8eaad tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:26.491902 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7722a394-ef74-48a1-9297-c679c1d8eaad tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:26.582531 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-deb4c13f-18e6-41c9-a58c-2e746295048c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:09:26.584367 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-deb4c13f-18e6-41c9-a58c-2e746295048c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:09:26.596802 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-deb4c13f-18e6-41c9-a58c-2e746295048c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:26.597305 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-deb4c13f-18e6-41c9-a58c-2e746295048c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:26.598106 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-deb4c13f-18e6-41c9-a58c-2e746295048c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:26.598730 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-deb4c13f-18e6-41c9-a58c-2e746295048c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:26.702324 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-deb4c13f-18e6-41c9-a58c-2e746295048c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "POST /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/action" status: 200 len: 33949 microversion: 2.1 time: 0.124373 Nov 09 20:09:26.703645 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 164/334] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Nov 9 20:09:26 2021] POST /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/action => generated 33949 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 20:09:26.735484 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-7722a394-ef74-48a1-9297-c679c1d8eaad tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:09:26.745390 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-7722a394-ef74-48a1-9297-c679c1d8eaad tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1521 microversion: 2.1 time: 0.275607 Nov 09 20:09:26.756663 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 171/335] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:09:26 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1521 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:09:27.386067 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-307a133a-06b1-48d1-a733-6f19295ebfdc tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:09:27.387673 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-307a133a-06b1-48d1-a733-6f19295ebfdc tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:09:27.396190 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-307a133a-06b1-48d1-a733-6f19295ebfdc tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:27.396701 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-307a133a-06b1-48d1-a733-6f19295ebfdc tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:27.397495 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-307a133a-06b1-48d1-a733-6f19295ebfdc tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:27.397973 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-307a133a-06b1-48d1-a733-6f19295ebfdc tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:27.484430 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-307a133a-06b1-48d1-a733-6f19295ebfdc tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "POST /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e/action" status: 200 len: 34672 microversion: 2.20 time: 0.103061 Nov 09 20:09:27.485497 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 165/336] 10.222.0.25 () {62 vars in 1318 bytes} [Tue Nov 9 20:09:27 2021] POST /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e/action => generated 34672 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 20:09:27.720089 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-1df859dc-7a87-44b9-a974-899e41127558 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:09:27.721716 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-1df859dc-7a87-44b9-a974-899e41127558 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:09:27.728354 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1df859dc-7a87-44b9-a974-899e41127558 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:27.729026 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1df859dc-7a87-44b9-a974-899e41127558 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:27.729988 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1df859dc-7a87-44b9-a974-899e41127558 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:27.730552 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1df859dc-7a87-44b9-a974-899e41127558 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:27.763664 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-58d9cf44-d130-4fa5-bedc-d59184035bb1 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:09:27.765040 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-58d9cf44-d130-4fa5-bedc-d59184035bb1 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:09:27.780131 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-58d9cf44-d130-4fa5-bedc-d59184035bb1 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:27.787676 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-58d9cf44-d130-4fa5-bedc-d59184035bb1 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:27.788850 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-58d9cf44-d130-4fa5-bedc-d59184035bb1 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:27.789471 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-58d9cf44-d130-4fa5-bedc-d59184035bb1 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:27.851001 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-1df859dc-7a87-44b9-a974-899e41127558 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "POST /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/action" status: 200 len: 34892 microversion: 2.1 time: 0.140027 Nov 09 20:09:27.856383 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 172/337] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Nov 9 20:09:27 2021] POST /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/action => generated 34892 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 20:09:28.025934 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-58d9cf44-d130-4fa5-bedc-d59184035bb1 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:09:28.033912 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-58d9cf44-d130-4fa5-bedc-d59184035bb1 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1521 microversion: 2.1 time: 0.274512 Nov 09 20:09:28.034484 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 166/338] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:09:27 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1521 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 20:09:28.497985 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-38f074ab-dafe-4a57-a9ea-cd14bafb05fe tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:09:28.499159 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-38f074ab-dafe-4a57-a9ea-cd14bafb05fe tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:09:28.507778 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-38f074ab-dafe-4a57-a9ea-cd14bafb05fe tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:28.508535 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-38f074ab-dafe-4a57-a9ea-cd14bafb05fe tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:28.509525 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-38f074ab-dafe-4a57-a9ea-cd14bafb05fe tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:28.509947 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-38f074ab-dafe-4a57-a9ea-cd14bafb05fe tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:28.600394 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-38f074ab-dafe-4a57-a9ea-cd14bafb05fe tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "POST /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e/action" status: 200 len: 35330 microversion: 2.20 time: 0.106465 Nov 09 20:09:28.602443 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 173/339] 10.222.0.25 () {62 vars in 1318 bytes} [Tue Nov 9 20:09:28 2021] POST /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e/action => generated 35330 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 09 20:09:28.863495 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-824efc30-c350-47c6-b974-66e5c72c5f84 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:09:28.865361 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-824efc30-c350-47c6-b974-66e5c72c5f84 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:09:28.872126 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-824efc30-c350-47c6-b974-66e5c72c5f84 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:28.872885 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-824efc30-c350-47c6-b974-66e5c72c5f84 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:28.873980 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-824efc30-c350-47c6-b974-66e5c72c5f84 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:28.874631 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-824efc30-c350-47c6-b974-66e5c72c5f84 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:28.962293 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-824efc30-c350-47c6-b974-66e5c72c5f84 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "POST /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/action" status: 200 len: 35690 microversion: 2.1 time: 0.101025 Nov 09 20:09:28.965646 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 167/340] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Nov 9 20:09:28 2021] POST /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/action => generated 35690 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 20:09:29.058629 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-55884e0d-3093-4649-bfd8-f37934d702f4 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:09:29.060816 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-55884e0d-3093-4649-bfd8-f37934d702f4 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:09:29.094694 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-55884e0d-3093-4649-bfd8-f37934d702f4 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:29.102171 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-55884e0d-3093-4649-bfd8-f37934d702f4 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:29.103503 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-55884e0d-3093-4649-bfd8-f37934d702f4 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:29.104161 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-55884e0d-3093-4649-bfd8-f37934d702f4 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:29.372421 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-55884e0d-3093-4649-bfd8-f37934d702f4 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:09:29.382153 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-55884e0d-3093-4649-bfd8-f37934d702f4 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1521 microversion: 2.1 time: 0.331632 Nov 09 20:09:29.383428 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 174/341] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:09:29 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1521 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:09:29.614497 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-4fa58ab6-31ba-48e7-8577-8c9d9eab11a6 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:09:29.615675 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-4fa58ab6-31ba-48e7-8577-8c9d9eab11a6 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:09:29.624111 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-4fa58ab6-31ba-48e7-8577-8c9d9eab11a6 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:29.625444 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-4fa58ab6-31ba-48e7-8577-8c9d9eab11a6 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:29.626758 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-4fa58ab6-31ba-48e7-8577-8c9d9eab11a6 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:29.627590 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-4fa58ab6-31ba-48e7-8577-8c9d9eab11a6 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:29.712496 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-4fa58ab6-31ba-48e7-8577-8c9d9eab11a6 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "POST /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e/action" status: 200 len: 36105 microversion: 2.20 time: 0.102074 Nov 09 20:09:29.717050 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 168/342] 10.222.0.25 () {62 vars in 1318 bytes} [Tue Nov 9 20:09:29 2021] POST /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e/action => generated 36105 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 20:09:29.978160 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-6e1f90eb-19aa-47c9-8696-c6e18710e2e6 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:09:29.979761 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-6e1f90eb-19aa-47c9-8696-c6e18710e2e6 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:09:29.988062 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6e1f90eb-19aa-47c9-8696-c6e18710e2e6 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:29.990173 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6e1f90eb-19aa-47c9-8696-c6e18710e2e6 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:29.991671 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6e1f90eb-19aa-47c9-8696-c6e18710e2e6 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:29.992374 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6e1f90eb-19aa-47c9-8696-c6e18710e2e6 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:30.090395 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-6e1f90eb-19aa-47c9-8696-c6e18710e2e6 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "POST /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/action" status: 200 len: 36712 microversion: 2.1 time: 0.117046 Nov 09 20:09:30.092022 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 175/343] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Nov 9 20:09:29 2021] POST /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/action => generated 36712 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 20:09:30.399869 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-8eee0fa7-bb41-4fda-9161-3ffaef3521ad tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:09:30.401363 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-8eee0fa7-bb41-4fda-9161-3ffaef3521ad tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:09:30.408814 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-8eee0fa7-bb41-4fda-9161-3ffaef3521ad tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:30.409589 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-8eee0fa7-bb41-4fda-9161-3ffaef3521ad tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:30.411404 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-8eee0fa7-bb41-4fda-9161-3ffaef3521ad tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:30.412054 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-8eee0fa7-bb41-4fda-9161-3ffaef3521ad tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:30.591287 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-8eee0fa7-bb41-4fda-9161-3ffaef3521ad tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:09:30.599357 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-8eee0fa7-bb41-4fda-9161-3ffaef3521ad tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1521 microversion: 2.1 time: 0.203104 Nov 09 20:09:30.599921 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 169/344] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:09:30 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1521 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:09:30.726076 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-8c0006be-d09f-4cd2-88e0-8f6fa51570dc tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:09:30.727418 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-8c0006be-d09f-4cd2-88e0-8f6fa51570dc tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:09:30.735626 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8c0006be-d09f-4cd2-88e0-8f6fa51570dc tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:30.736375 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8c0006be-d09f-4cd2-88e0-8f6fa51570dc tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:30.737479 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8c0006be-d09f-4cd2-88e0-8f6fa51570dc tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:30.738156 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8c0006be-d09f-4cd2-88e0-8f6fa51570dc tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:30.835613 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-8c0006be-d09f-4cd2-88e0-8f6fa51570dc tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "POST /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e/action" status: 200 len: 37078 microversion: 2.20 time: 0.114604 Nov 09 20:09:30.836255 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 176/345] 10.222.0.25 () {62 vars in 1318 bytes} [Tue Nov 9 20:09:30 2021] POST /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e/action => generated 37078 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 20:09:31.102852 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-ef09ef16-5a98-4330-b0fc-7f69f83cdcef tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:09:31.103865 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-ef09ef16-5a98-4330-b0fc-7f69f83cdcef tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:09:31.110296 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ef09ef16-5a98-4330-b0fc-7f69f83cdcef tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:31.110688 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ef09ef16-5a98-4330-b0fc-7f69f83cdcef tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:31.111456 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ef09ef16-5a98-4330-b0fc-7f69f83cdcef tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:31.111889 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ef09ef16-5a98-4330-b0fc-7f69f83cdcef tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:31.198098 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-ef09ef16-5a98-4330-b0fc-7f69f83cdcef tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "POST /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/action" status: 200 len: 37586 microversion: 2.1 time: 0.099336 Nov 09 20:09:31.198786 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 170/346] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Nov 9 20:09:31 2021] POST /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/action => generated 37586 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 20:09:31.618015 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-2967e1e7-5387-4fc2-bc96-c7ba2717c68f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:09:31.618951 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-2967e1e7-5387-4fc2-bc96-c7ba2717c68f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:09:31.626306 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2967e1e7-5387-4fc2-bc96-c7ba2717c68f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:31.626918 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2967e1e7-5387-4fc2-bc96-c7ba2717c68f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:31.627962 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2967e1e7-5387-4fc2-bc96-c7ba2717c68f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:31.628560 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2967e1e7-5387-4fc2-bc96-c7ba2717c68f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:31.807079 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-2967e1e7-5387-4fc2-bc96-c7ba2717c68f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:09:31.814509 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-2967e1e7-5387-4fc2-bc96-c7ba2717c68f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1521 microversion: 2.1 time: 0.201406 Nov 09 20:09:31.815113 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 177/347] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:09:31 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1521 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:09:31.848762 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-97bbe506-5296-4277-a55f-a8122c7cf7ad tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:09:31.850265 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-97bbe506-5296-4277-a55f-a8122c7cf7ad tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:09:31.857974 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-97bbe506-5296-4277-a55f-a8122c7cf7ad tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:31.858422 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-97bbe506-5296-4277-a55f-a8122c7cf7ad tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:31.859435 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-97bbe506-5296-4277-a55f-a8122c7cf7ad tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:31.859869 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-97bbe506-5296-4277-a55f-a8122c7cf7ad tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:31.970989 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-97bbe506-5296-4277-a55f-a8122c7cf7ad tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "POST /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e/action" status: 200 len: 37885 microversion: 2.20 time: 0.126144 Nov 09 20:09:31.975438 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 171/348] 10.222.0.25 () {62 vars in 1318 bytes} [Tue Nov 9 20:09:31 2021] POST /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e/action => generated 37885 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 20:09:32.210800 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-6e0e15ce-104d-43ff-8268-dd609ba36dcd tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:09:32.211759 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-6e0e15ce-104d-43ff-8268-dd609ba36dcd tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:09:32.218146 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6e0e15ce-104d-43ff-8268-dd609ba36dcd tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:32.218595 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6e0e15ce-104d-43ff-8268-dd609ba36dcd tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:32.219374 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6e0e15ce-104d-43ff-8268-dd609ba36dcd tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:32.219807 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6e0e15ce-104d-43ff-8268-dd609ba36dcd tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:32.876089 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-349cb0c8-165e-4454-b6bc-0f202c144bb7 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:09:32.876870 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-349cb0c8-165e-4454-b6bc-0f202c144bb7 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:09:32.884920 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-349cb0c8-165e-4454-b6bc-0f202c144bb7 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:32.885716 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-349cb0c8-165e-4454-b6bc-0f202c144bb7 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:32.886587 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-349cb0c8-165e-4454-b6bc-0f202c144bb7 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:32.887089 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-349cb0c8-165e-4454-b6bc-0f202c144bb7 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:33.063167 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-349cb0c8-165e-4454-b6bc-0f202c144bb7 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:09:33.071918 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-349cb0c8-165e-4454-b6bc-0f202c144bb7 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1521 microversion: 2.1 time: 0.200046 Nov 09 20:09:33.072577 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 172/349] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:09:32 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1521 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 20:09:33.077767 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-e6cefbf2-86d6-412e-a86e-4cf4ee6b8b3a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:09:33.079107 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-e6cefbf2-86d6-412e-a86e-4cf4ee6b8b3a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:09:33.086230 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e6cefbf2-86d6-412e-a86e-4cf4ee6b8b3a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:33.086805 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e6cefbf2-86d6-412e-a86e-4cf4ee6b8b3a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:33.087892 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e6cefbf2-86d6-412e-a86e-4cf4ee6b8b3a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:33.088801 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e6cefbf2-86d6-412e-a86e-4cf4ee6b8b3a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:35.642109 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-6e0e15ce-104d-43ff-8268-dd609ba36dcd tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "POST /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/action" status: 200 len: 38170 microversion: 2.1 time: 3.435204 Nov 09 20:09:35.642861 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 178/350] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Nov 9 20:09:32 2021] POST /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/action => generated 38170 bytes in 3437 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 09 20:09:35.650954 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-589a3c8c-e814-42ef-bb3a-050d4a11c766 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:09:35.651872 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-589a3c8c-e814-42ef-bb3a-050d4a11c766 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:09:35.659668 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-589a3c8c-e814-42ef-bb3a-050d4a11c766 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:35.660115 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-589a3c8c-e814-42ef-bb3a-050d4a11c766 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:35.661124 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-589a3c8c-e814-42ef-bb3a-050d4a11c766 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:35.662452 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-589a3c8c-e814-42ef-bb3a-050d4a11c766 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:35.669181 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-e6cefbf2-86d6-412e-a86e-4cf4ee6b8b3a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "POST /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e/action" status: 200 len: 38201 microversion: 2.20 time: 2.595214 Nov 09 20:09:35.670517 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 173/351] 10.222.0.25 () {62 vars in 1318 bytes} [Tue Nov 9 20:09:33 2021] POST /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e/action => generated 38201 bytes in 2597 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 20:09:35.806294 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-589a3c8c-e814-42ef-bb3a-050d4a11c766 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:09:35.813858 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-589a3c8c-e814-42ef-bb3a-050d4a11c766 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1521 microversion: 2.1 time: 0.169949 Nov 09 20:09:35.814421 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 179/352] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:09:35 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:09:36.655011 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-e2122509-7afa-4ad9-b545-1823c2042b8b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:09:36.656035 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-e2122509-7afa-4ad9-b545-1823c2042b8b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:09:36.663318 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e2122509-7afa-4ad9-b545-1823c2042b8b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:36.663995 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e2122509-7afa-4ad9-b545-1823c2042b8b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:36.664808 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e2122509-7afa-4ad9-b545-1823c2042b8b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:36.665386 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e2122509-7afa-4ad9-b545-1823c2042b8b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:36.682827 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-4d764285-4f1b-4b76-bf1c-ced583a0108a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:09:36.684134 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-4d764285-4f1b-4b76-bf1c-ced583a0108a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:09:36.692377 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4d764285-4f1b-4b76-bf1c-ced583a0108a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:36.693628 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4d764285-4f1b-4b76-bf1c-ced583a0108a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:36.694996 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4d764285-4f1b-4b76-bf1c-ced583a0108a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:36.695806 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4d764285-4f1b-4b76-bf1c-ced583a0108a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:36.759455 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-e2122509-7afa-4ad9-b545-1823c2042b8b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "POST /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/action" status: 200 len: 38173 microversion: 2.1 time: 0.108264 Nov 09 20:09:36.760131 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 174/353] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Nov 9 20:09:36 2021] POST /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/action => generated 38173 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 20:09:36.789995 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-4d764285-4f1b-4b76-bf1c-ced583a0108a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "POST /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e/action" status: 200 len: 38207 microversion: 2.20 time: 0.111335 Nov 09 20:09:36.790904 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 180/354] 10.222.0.25 () {62 vars in 1318 bytes} [Tue Nov 9 20:09:36 2021] POST /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e/action => generated 38207 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 09 20:09:36.832768 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-00c2a5d0-52be-4909-8921-efbb8e4500eb tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:09:36.833626 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-00c2a5d0-52be-4909-8921-efbb8e4500eb tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:09:36.840591 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-00c2a5d0-52be-4909-8921-efbb8e4500eb tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:36.841010 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-00c2a5d0-52be-4909-8921-efbb8e4500eb tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:36.841774 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-00c2a5d0-52be-4909-8921-efbb8e4500eb tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:36.842195 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-00c2a5d0-52be-4909-8921-efbb8e4500eb tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:36.978629 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-00c2a5d0-52be-4909-8921-efbb8e4500eb tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:09:36.985863 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-00c2a5d0-52be-4909-8921-efbb8e4500eb tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1521 microversion: 2.1 time: 0.157101 Nov 09 20:09:36.986618 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 175/355] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:09:36 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 20:09:37.771624 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-4490fd33-fc65-4164-b5bf-daa4da1e4b40 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:09:37.772653 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-4490fd33-fc65-4164-b5bf-daa4da1e4b40 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:09:37.779616 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4490fd33-fc65-4164-b5bf-daa4da1e4b40 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:37.780125 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4490fd33-fc65-4164-b5bf-daa4da1e4b40 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:37.780891 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4490fd33-fc65-4164-b5bf-daa4da1e4b40 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:37.781321 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4490fd33-fc65-4164-b5bf-daa4da1e4b40 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:37.803021 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-78d7b8dd-b370-4094-931b-1912fc8222ed tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:09:37.805144 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-78d7b8dd-b370-4094-931b-1912fc8222ed tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:09:37.811494 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-78d7b8dd-b370-4094-931b-1912fc8222ed tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:37.812049 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-78d7b8dd-b370-4094-931b-1912fc8222ed tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:37.813067 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-78d7b8dd-b370-4094-931b-1912fc8222ed tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:37.813560 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-78d7b8dd-b370-4094-931b-1912fc8222ed tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:37.866696 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-4490fd33-fc65-4164-b5bf-daa4da1e4b40 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "POST /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/action" status: 200 len: 38301 microversion: 2.1 time: 0.098875 Nov 09 20:09:37.867348 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 181/356] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Nov 9 20:09:37 2021] POST /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/action => generated 38301 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 20:09:37.878472 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-012c7c74-789f-4a32-a990-a80ba8e2d8f6 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:09:37.879125 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-012c7c74-789f-4a32-a990-a80ba8e2d8f6 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:09:37.888744 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-012c7c74-789f-4a32-a990-a80ba8e2d8f6 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:37.889741 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-012c7c74-789f-4a32-a990-a80ba8e2d8f6 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:37.890665 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-012c7c74-789f-4a32-a990-a80ba8e2d8f6 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:37.891191 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-012c7c74-789f-4a32-a990-a80ba8e2d8f6 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:37.917758 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-78d7b8dd-b370-4094-931b-1912fc8222ed tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "POST /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e/action" status: 200 len: 38342 microversion: 2.20 time: 0.118881 Nov 09 20:09:37.918395 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 176/357] 10.222.0.25 () {62 vars in 1318 bytes} [Tue Nov 9 20:09:37 2021] POST /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e/action => generated 38342 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 09 20:09:37.923463 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-012c7c74-789f-4a32-a990-a80ba8e2d8f6 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/ips" status: 200 len: 145 microversion: 2.1 time: 0.045619 Nov 09 20:09:37.923463 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 182/358] 10.222.0.25 () {58 vars in 1247 bytes} [Tue Nov 9 20:09:37 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/ips => generated 145 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:09:37.930005 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-35892bf4-37e0-4526-a10c-bd02e0cbef95 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:09:37.931007 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-35892bf4-37e0-4526-a10c-bd02e0cbef95 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:09:37.938129 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-35892bf4-37e0-4526-a10c-bd02e0cbef95 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:37.938855 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-35892bf4-37e0-4526-a10c-bd02e0cbef95 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:37.939829 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-35892bf4-37e0-4526-a10c-bd02e0cbef95 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:37.941644 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-35892bf4-37e0-4526-a10c-bd02e0cbef95 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:37.968684 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-35892bf4-37e0-4526-a10c-bd02e0cbef95 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e/ips" status: 200 len: 152 microversion: 2.20 time: 0.043640 Nov 09 20:09:37.969266 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 177/359] 10.222.0.25 () {60 vars in 1288 bytes} [Tue Nov 9 20:09:37 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e/ips => generated 152 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 20:09:38.007238 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-a44edb7e-d060-43dd-a904-f362795f78a5 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:09:38.008240 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-a44edb7e-d060-43dd-a904-f362795f78a5 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:09:38.015518 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a44edb7e-d060-43dd-a904-f362795f78a5 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:38.015518 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a44edb7e-d060-43dd-a904-f362795f78a5 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:38.016871 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a44edb7e-d060-43dd-a904-f362795f78a5 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:38.017717 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a44edb7e-d060-43dd-a904-f362795f78a5 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:38.184267 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-a44edb7e-d060-43dd-a904-f362795f78a5 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:09:38.191687 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-a44edb7e-d060-43dd-a904-f362795f78a5 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1521 microversion: 2.1 time: 0.190383 Nov 09 20:09:38.192365 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 183/360] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:09:37 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1521 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:09:39.209808 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-2684d609-f534-4ee4-b445-2e9bae4fed12 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:09:39.211152 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-2684d609-f534-4ee4-b445-2e9bae4fed12 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:09:39.219510 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-2684d609-f534-4ee4-b445-2e9bae4fed12 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:39.220135 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-2684d609-f534-4ee4-b445-2e9bae4fed12 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:39.221175 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-2684d609-f534-4ee4-b445-2e9bae4fed12 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:39.221751 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-2684d609-f534-4ee4-b445-2e9bae4fed12 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:39.503735 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-2684d609-f534-4ee4-b445-2e9bae4fed12 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:09:39.530063 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-2684d609-f534-4ee4-b445-2e9bae4fed12 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1521 microversion: 2.1 time: 0.324435 Nov 09 20:09:39.537007 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 178/361] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:09:39 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1521 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:09:40.280571 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-4dff94c7-c241-435f-911b-124fe4d16a55 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:09:40.281851 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-4dff94c7-c241-435f-911b-124fe4d16a55 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:09:40.292006 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4dff94c7-c241-435f-911b-124fe4d16a55 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:40.292831 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4dff94c7-c241-435f-911b-124fe4d16a55 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:40.293689 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4dff94c7-c241-435f-911b-124fe4d16a55 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:40.294191 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4dff94c7-c241-435f-911b-124fe4d16a55 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:40.320170 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.objects.instance [None req-4dff94c7-c241-435f-911b-124fe4d16a55 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lazy-loading 'flavor' on Instance uuid ae338c69-d22d-41c2-89b0-b0cec236521e {{(pid=116103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 09 20:09:40.413064 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-7ea1fdb5-71ea-4e66-9622-41fd1e038131 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "398131fd-877b-46b8-aaf1-a4b1796b761d"}} {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:09:40.414768 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-7ea1fdb5-71ea-4e66-9622-41fd1e038131 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:09:40.421574 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-7ea1fdb5-71ea-4e66-9622-41fd1e038131 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:40.422242 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-7ea1fdb5-71ea-4e66-9622-41fd1e038131 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:40.423186 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-7ea1fdb5-71ea-4e66-9622-41fd1e038131 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:40.423761 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-7ea1fdb5-71ea-4e66-9622-41fd1e038131 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:40.793051 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-7ea1fdb5-71ea-4e66-9622-41fd1e038131 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "POST /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.384912 Nov 09 20:09:40.794478 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 179/362] 10.222.0.25 () {60 vars in 1322 bytes} [Tue Nov 9 20:09:40 2021] POST /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 194 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 20:09:40.815432 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-153fb8a9-a875-46ec-8410-3f72e6c55ca4 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:09:40.819345 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-153fb8a9-a875-46ec-8410-3f72e6c55ca4 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:09:40.830392 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-153fb8a9-a875-46ec-8410-3f72e6c55ca4 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:40.830852 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-153fb8a9-a875-46ec-8410-3f72e6c55ca4 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:40.836284 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-153fb8a9-a875-46ec-8410-3f72e6c55ca4 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:40.836773 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-153fb8a9-a875-46ec-8410-3f72e6c55ca4 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:41.040475 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-4dff94c7-c241-435f-911b-124fe4d16a55 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "POST /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e/action" status: 202 len: 0 microversion: 2.20 time: 0.759364 Nov 09 20:09:41.040475 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 184/363] 10.222.0.25 () {62 vars in 1318 bytes} [Tue Nov 9 20:09:40 2021] POST /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e/action => generated 0 bytes in 764 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 09 20:09:41.048081 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-153fb8a9-a875-46ec-8410-3f72e6c55ca4 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:09:41.056124 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-f1203650-76fe-4553-a412-fd69990be261 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:09:41.057506 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-153fb8a9-a875-46ec-8410-3f72e6c55ca4 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1521 microversion: 2.1 time: 0.261247 Nov 09 20:09:41.058289 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-f1203650-76fe-4553-a412-fd69990be261 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:09:41.059489 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 180/364] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:09:40 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1521 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:09:41.078213 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f1203650-76fe-4553-a412-fd69990be261 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:41.078655 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f1203650-76fe-4553-a412-fd69990be261 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:41.084643 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f1203650-76fe-4553-a412-fd69990be261 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:41.085328 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f1203650-76fe-4553-a412-fd69990be261 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:41.266648 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-f1203650-76fe-4553-a412-fd69990be261 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:09:41.275546 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-f1203650-76fe-4553-a412-fd69990be261 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:09:41.278124 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-f1203650-76fe-4553-a412-fd69990be261 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:09:41.279277 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-f1203650-76fe-4553-a412-fd69990be261 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1724 microversion: 2.20 time: 0.234997 Nov 09 20:09:41.280003 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 185/365] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:09:41 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1724 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:09:42.080840 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-b126654b-35f4-4f58-a723-f3c2f7da9af8 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:09:42.080840 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-b126654b-35f4-4f58-a723-f3c2f7da9af8 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:09:42.087938 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b126654b-35f4-4f58-a723-f3c2f7da9af8 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:42.088435 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b126654b-35f4-4f58-a723-f3c2f7da9af8 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:42.091814 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b126654b-35f4-4f58-a723-f3c2f7da9af8 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:42.093422 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b126654b-35f4-4f58-a723-f3c2f7da9af8 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:42.259344 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-b126654b-35f4-4f58-a723-f3c2f7da9af8 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:09:42.274592 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-b126654b-35f4-4f58-a723-f3c2f7da9af8 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1521 microversion: 2.1 time: 0.198336 Nov 09 20:09:42.276956 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 181/366] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:09:42 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1521 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:09:42.303434 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-0a292afb-2746-4962-8e33-ee8baf8a9694 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:09:42.304060 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-0a292afb-2746-4962-8e33-ee8baf8a9694 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:09:42.310864 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0a292afb-2746-4962-8e33-ee8baf8a9694 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:42.311260 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0a292afb-2746-4962-8e33-ee8baf8a9694 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:42.312241 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0a292afb-2746-4962-8e33-ee8baf8a9694 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:42.312861 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0a292afb-2746-4962-8e33-ee8baf8a9694 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:42.466025 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-0a292afb-2746-4962-8e33-ee8baf8a9694 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:09:42.477578 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-0a292afb-2746-4962-8e33-ee8baf8a9694 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:09:42.479470 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-0a292afb-2746-4962-8e33-ee8baf8a9694 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:09:42.480954 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-0a292afb-2746-4962-8e33-ee8baf8a9694 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1724 microversion: 2.20 time: 0.181594 Nov 09 20:09:42.481891 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 186/367] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:09:42 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1724 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:09:43.294823 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-419217b5-4363-4c2d-9be8-fbaf4194c8db tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:09:43.296353 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-419217b5-4363-4c2d-9be8-fbaf4194c8db tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:09:43.302617 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-419217b5-4363-4c2d-9be8-fbaf4194c8db tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:43.303060 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-419217b5-4363-4c2d-9be8-fbaf4194c8db tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:43.303834 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-419217b5-4363-4c2d-9be8-fbaf4194c8db tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:43.304261 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-419217b5-4363-4c2d-9be8-fbaf4194c8db tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:43.531349 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-963ded8b-20e4-4114-927d-693fe76c3a87 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:09:43.532781 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-963ded8b-20e4-4114-927d-693fe76c3a87 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:09:43.540834 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-963ded8b-20e4-4114-927d-693fe76c3a87 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:43.541189 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-963ded8b-20e4-4114-927d-693fe76c3a87 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:43.541976 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-963ded8b-20e4-4114-927d-693fe76c3a87 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:43.542589 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-963ded8b-20e4-4114-927d-693fe76c3a87 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:43.575972 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-419217b5-4363-4c2d-9be8-fbaf4194c8db tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:09:43.604020 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-419217b5-4363-4c2d-9be8-fbaf4194c8db tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1521 microversion: 2.1 time: 0.313376 Nov 09 20:09:43.604904 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 182/368] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:09:43 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1521 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:09:43.748533 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-963ded8b-20e4-4114-927d-693fe76c3a87 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:09:43.760041 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-963ded8b-20e4-4114-927d-693fe76c3a87 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:09:43.761723 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-963ded8b-20e4-4114-927d-693fe76c3a87 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:09:43.763457 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-963ded8b-20e4-4114-927d-693fe76c3a87 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1724 microversion: 2.20 time: 0.253293 Nov 09 20:09:43.764391 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 187/369] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:09:43 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1724 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:09:44.624955 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-6041220a-0c02-4625-8b91-e46f7866b8e5 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:09:44.627012 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-6041220a-0c02-4625-8b91-e46f7866b8e5 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:09:44.639119 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6041220a-0c02-4625-8b91-e46f7866b8e5 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:44.640456 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6041220a-0c02-4625-8b91-e46f7866b8e5 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:44.642080 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6041220a-0c02-4625-8b91-e46f7866b8e5 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:44.643095 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6041220a-0c02-4625-8b91-e46f7866b8e5 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:44.791458 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-1c1c91d7-bdfc-4003-bd3e-2f39d16c4884 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:09:44.792846 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-1c1c91d7-bdfc-4003-bd3e-2f39d16c4884 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:09:44.799703 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1c1c91d7-bdfc-4003-bd3e-2f39d16c4884 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:44.800984 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1c1c91d7-bdfc-4003-bd3e-2f39d16c4884 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:44.802280 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1c1c91d7-bdfc-4003-bd3e-2f39d16c4884 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:44.803212 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1c1c91d7-bdfc-4003-bd3e-2f39d16c4884 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:44.810902 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-6041220a-0c02-4625-8b91-e46f7866b8e5 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:09:44.819701 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-6041220a-0c02-4625-8b91-e46f7866b8e5 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1501 microversion: 2.1 time: 0.200823 Nov 09 20:09:44.820295 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 183/370] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:09:44 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1501 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:09:44.842785 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-2d23e975-baa4-4802-80c0-1c153cc51394 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "09524236-b2d0-4d16-9af2-c92f5a0732b7"}} {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:09:44.844265 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-2d23e975-baa4-4802-80c0-1c153cc51394 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:09:44.854086 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-2d23e975-baa4-4802-80c0-1c153cc51394 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:44.854811 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-2d23e975-baa4-4802-80c0-1c153cc51394 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:44.855798 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-2d23e975-baa4-4802-80c0-1c153cc51394 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:44.856416 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-2d23e975-baa4-4802-80c0-1c153cc51394 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:44.885335 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.wsgi [None req-2d23e975-baa4-4802-80c0-1c153cc51394 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] HTTP exception thrown: Cannot 'attach_volume' instance 80ce5722-8f51-457b-9f9b-ff4b63b103df while it is in vm_state rescued Nov 09 20:09:44.886192 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-2d23e975-baa4-4802-80c0-1c153cc51394 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Returning 409 to user: Cannot 'attach_volume' instance 80ce5722-8f51-457b-9f9b-ff4b63b103df while it is in vm_state rescued {{(pid=116102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 09 20:09:44.887256 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-2d23e975-baa4-4802-80c0-1c153cc51394 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "POST /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.054086 Nov 09 20:09:44.888379 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 184/371] 10.222.0.25 () {60 vars in 1322 bytes} [Tue Nov 9 20:09:44 2021] POST /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 152 bytes in 56 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 09 20:09:44.897872 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-f146cdc0-1b13-4ff8-9320-4b9ad020b76d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:09:44.898716 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-f146cdc0-1b13-4ff8-9320-4b9ad020b76d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:09:44.906254 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f146cdc0-1b13-4ff8-9320-4b9ad020b76d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:44.907163 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f146cdc0-1b13-4ff8-9320-4b9ad020b76d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:44.914446 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f146cdc0-1b13-4ff8-9320-4b9ad020b76d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:44.915373 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f146cdc0-1b13-4ff8-9320-4b9ad020b76d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:45.022592 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-1c1c91d7-bdfc-4003-bd3e-2f39d16c4884 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:09:45.032475 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-1c1c91d7-bdfc-4003-bd3e-2f39d16c4884 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:09:45.034396 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-1c1c91d7-bdfc-4003-bd3e-2f39d16c4884 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:09:45.035762 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-1c1c91d7-bdfc-4003-bd3e-2f39d16c4884 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1724 microversion: 2.20 time: 0.248496 Nov 09 20:09:45.036757 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 188/372] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:09:44 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1724 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:09:45.066542 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-f146cdc0-1b13-4ff8-9320-4b9ad020b76d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "POST /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/action" status: 202 len: 0 microversion: 2.1 time: 0.173598 Nov 09 20:09:45.068246 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 185/373] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Nov 9 20:09:44 2021] POST /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/action => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 09 20:09:45.076637 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-c1ac3102-1118-470a-870a-aa8e2747d42f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:09:45.077430 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-c1ac3102-1118-470a-870a-aa8e2747d42f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:09:45.088176 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c1ac3102-1118-470a-870a-aa8e2747d42f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:45.092484 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c1ac3102-1118-470a-870a-aa8e2747d42f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:45.100827 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c1ac3102-1118-470a-870a-aa8e2747d42f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:45.102287 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c1ac3102-1118-470a-870a-aa8e2747d42f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:45.283370 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-c1ac3102-1118-470a-870a-aa8e2747d42f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:09:45.290921 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-c1ac3102-1118-470a-870a-aa8e2747d42f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1509 microversion: 2.1 time: 0.218493 Nov 09 20:09:45.292595 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 189/374] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:09:45 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1509 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:09:46.056194 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-aa29a81d-d3b7-428c-950f-97fc8de6bc4b tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:09:46.056922 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-aa29a81d-d3b7-428c-950f-97fc8de6bc4b tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:09:46.063544 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-aa29a81d-d3b7-428c-950f-97fc8de6bc4b tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:46.063993 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-aa29a81d-d3b7-428c-950f-97fc8de6bc4b tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:46.064795 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-aa29a81d-d3b7-428c-950f-97fc8de6bc4b tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:46.065227 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-aa29a81d-d3b7-428c-950f-97fc8de6bc4b tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:46.203921 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-aa29a81d-d3b7-428c-950f-97fc8de6bc4b tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:09:46.212885 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-aa29a81d-d3b7-428c-950f-97fc8de6bc4b tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:09:46.214530 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-aa29a81d-d3b7-428c-950f-97fc8de6bc4b tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:09:46.215992 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-aa29a81d-d3b7-428c-950f-97fc8de6bc4b tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1724 microversion: 2.20 time: 0.164474 Nov 09 20:09:46.216761 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 186/375] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:09:46 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:09:46.307312 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-a794d5a3-47ed-4af5-b26f-55c14eff240d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:09:46.307943 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-a794d5a3-47ed-4af5-b26f-55c14eff240d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:09:46.314153 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a794d5a3-47ed-4af5-b26f-55c14eff240d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:46.314595 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a794d5a3-47ed-4af5-b26f-55c14eff240d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:46.315489 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a794d5a3-47ed-4af5-b26f-55c14eff240d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:46.315969 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a794d5a3-47ed-4af5-b26f-55c14eff240d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:46.497779 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-a794d5a3-47ed-4af5-b26f-55c14eff240d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:09:46.506358 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-a794d5a3-47ed-4af5-b26f-55c14eff240d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1509 microversion: 2.1 time: 0.203227 Nov 09 20:09:46.507262 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 190/376] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:09:46 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1509 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:09:47.115550 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-68e8c5a4-d829-45db-a1d4-62d68ccd00d5 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "81c8d2da-f7bf-443f-ba0a-b88dc5a6147e", "device": "/dev/sdb"}} {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:09:47.117226 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-68e8c5a4-d829-45db-a1d4-62d68ccd00d5 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:09:47.123473 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-68e8c5a4-d829-45db-a1d4-62d68ccd00d5 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:47.123935 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-68e8c5a4-d829-45db-a1d4-62d68ccd00d5 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:47.124757 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-68e8c5a4-d829-45db-a1d4-62d68ccd00d5 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:47.125171 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-68e8c5a4-d829-45db-a1d4-62d68ccd00d5 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:47.237454 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-3c40aed0-d459-4543-a329-2d03a6fe78f5 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:09:47.238105 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-3c40aed0-d459-4543-a329-2d03a6fe78f5 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:09:47.245403 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3c40aed0-d459-4543-a329-2d03a6fe78f5 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:47.245899 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3c40aed0-d459-4543-a329-2d03a6fe78f5 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:47.246721 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3c40aed0-d459-4543-a329-2d03a6fe78f5 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:47.247160 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3c40aed0-d459-4543-a329-2d03a6fe78f5 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:47.386719 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-3c40aed0-d459-4543-a329-2d03a6fe78f5 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:09:47.388328 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-68e8c5a4-d829-45db-a1d4-62d68ccd00d5 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "POST /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.276472 Nov 09 20:09:47.389345 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 187/377] 10.222.0.25 () {60 vars in 1322 bytes} [Tue Nov 9 20:09:47 2021] POST /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997/os-volume_attachments => generated 194 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:09:47.394851 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-3c40aed0-d459-4543-a329-2d03a6fe78f5 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:09:47.397321 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-3c40aed0-d459-4543-a329-2d03a6fe78f5 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:09:47.398669 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-3c40aed0-d459-4543-a329-2d03a6fe78f5 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1724 microversion: 2.20 time: 0.165539 Nov 09 20:09:47.400343 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 191/378] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:09:47 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 09 20:09:47.523280 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-45f14c24-0291-4ced-a765-c0637c7aac2c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:09:47.523964 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-45f14c24-0291-4ced-a765-c0637c7aac2c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:09:47.530264 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-45f14c24-0291-4ced-a765-c0637c7aac2c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:47.530706 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-45f14c24-0291-4ced-a765-c0637c7aac2c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:47.531459 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-45f14c24-0291-4ced-a765-c0637c7aac2c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:47.531884 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-45f14c24-0291-4ced-a765-c0637c7aac2c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:47.675038 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-45f14c24-0291-4ced-a765-c0637c7aac2c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:09:47.682457 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-45f14c24-0291-4ced-a765-c0637c7aac2c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1509 microversion: 2.1 time: 0.163210 Nov 09 20:09:47.683013 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 188/379] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:09:47 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1509 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:09:48.386291 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-a1b2cd2d-5c2b-49c1-b3a6-eeecc7f75428 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:09:48.393354 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a1b2cd2d-5c2b-49c1-b3a6-eeecc7f75428 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:48.394034 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a1b2cd2d-5c2b-49c1-b3a6-eeecc7f75428 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:48.421003 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-1f218ec2-bb0a-4812-a5ba-da96f143ed76 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:09:48.422436 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-1f218ec2-bb0a-4812-a5ba-da96f143ed76 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:09:48.433006 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-1f218ec2-bb0a-4812-a5ba-da96f143ed76 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:48.434038 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-1f218ec2-bb0a-4812-a5ba-da96f143ed76 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:48.437099 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-1f218ec2-bb0a-4812-a5ba-da96f143ed76 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:48.437959 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-1f218ec2-bb0a-4812-a5ba-da96f143ed76 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:48.481488 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-a1b2cd2d-5c2b-49c1-b3a6-eeecc7f75428 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Going to try to stop instance {{(pid=116103) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Nov 09 20:09:48.590620 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-a1b2cd2d-5c2b-49c1-b3a6-eeecc7f75428 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "POST /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/action" status: 202 len: 0 microversion: 2.1 time: 0.207872 Nov 09 20:09:48.591576 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 192/380] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Nov 9 20:09:48 2021] POST /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/action => generated 0 bytes in 210 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 09 20:09:48.604000 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-fe56cb91-547a-4bb9-831b-1e7471b40fb3 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:09:48.604939 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-fe56cb91-547a-4bb9-831b-1e7471b40fb3 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:09:48.618521 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fe56cb91-547a-4bb9-831b-1e7471b40fb3 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:48.619345 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fe56cb91-547a-4bb9-831b-1e7471b40fb3 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:48.620351 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fe56cb91-547a-4bb9-831b-1e7471b40fb3 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:48.621019 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fe56cb91-547a-4bb9-831b-1e7471b40fb3 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:48.673254 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-1f218ec2-bb0a-4812-a5ba-da96f143ed76 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:09:48.690547 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-1f218ec2-bb0a-4812-a5ba-da96f143ed76 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:09:48.692040 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-1f218ec2-bb0a-4812-a5ba-da96f143ed76 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:09:48.694164 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-1f218ec2-bb0a-4812-a5ba-da96f143ed76 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1724 microversion: 2.20 time: 0.279410 Nov 09 20:09:48.694909 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 189/381] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:09:48 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1724 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:09:48.699405 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-05b4dd6e-4401-4a91-89b8-0151a2dbe4a4 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:09:48.700183 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-05b4dd6e-4401-4a91-89b8-0151a2dbe4a4 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:09:48.711961 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-05b4dd6e-4401-4a91-89b8-0151a2dbe4a4 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:48.712708 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-05b4dd6e-4401-4a91-89b8-0151a2dbe4a4 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:48.713676 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-05b4dd6e-4401-4a91-89b8-0151a2dbe4a4 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:48.714331 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-05b4dd6e-4401-4a91-89b8-0151a2dbe4a4 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:48.827502 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-fe56cb91-547a-4bb9-831b-1e7471b40fb3 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:09:48.836659 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-fe56cb91-547a-4bb9-831b-1e7471b40fb3 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1722 microversion: 2.1 time: 0.240508 Nov 09 20:09:48.837309 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 193/382] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:09:48 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1722 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:09:48.885167 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-05b4dd6e-4401-4a91-89b8-0151a2dbe4a4 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:09:48.892460 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-05b4dd6e-4401-4a91-89b8-0151a2dbe4a4 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1515 microversion: 2.1 time: 0.196412 Nov 09 20:09:48.893175 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 190/383] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:09:48 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1515 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:09:49.712775 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-fcf46828-a029-496b-9cfd-e9746241d18f tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:09:49.713279 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-fcf46828-a029-496b-9cfd-e9746241d18f tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:09:49.719347 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fcf46828-a029-496b-9cfd-e9746241d18f tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:49.720582 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fcf46828-a029-496b-9cfd-e9746241d18f tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:49.721489 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fcf46828-a029-496b-9cfd-e9746241d18f tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:49.721996 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fcf46828-a029-496b-9cfd-e9746241d18f tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:49.855668 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-09e41d88-efca-4218-b69d-a9f921bfe3f3 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:09:49.856420 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-09e41d88-efca-4218-b69d-a9f921bfe3f3 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:09:49.862797 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-09e41d88-efca-4218-b69d-a9f921bfe3f3 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:49.863069 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-fcf46828-a029-496b-9cfd-e9746241d18f tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:09:49.863895 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-09e41d88-efca-4218-b69d-a9f921bfe3f3 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:49.865662 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-09e41d88-efca-4218-b69d-a9f921bfe3f3 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:49.866168 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-09e41d88-efca-4218-b69d-a9f921bfe3f3 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:49.872031 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-fcf46828-a029-496b-9cfd-e9746241d18f tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:09:49.873564 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-fcf46828-a029-496b-9cfd-e9746241d18f tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:09:49.874710 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-fcf46828-a029-496b-9cfd-e9746241d18f tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1724 microversion: 2.20 time: 0.165679 Nov 09 20:09:49.885057 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 194/384] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:09:49 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1724 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:09:50.002404 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-09e41d88-efca-4218-b69d-a9f921bfe3f3 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:09:50.010866 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-09e41d88-efca-4218-b69d-a9f921bfe3f3 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1722 microversion: 2.1 time: 0.159240 Nov 09 20:09:50.011492 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 191/385] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:09:49 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:09:50.253810 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-0ae37f09-82c3-47de-970e-a6c0533a458d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:09:50.254328 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-0ae37f09-82c3-47de-970e-a6c0533a458d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:09:50.265919 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0ae37f09-82c3-47de-970e-a6c0533a458d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:50.266376 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0ae37f09-82c3-47de-970e-a6c0533a458d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:50.267200 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0ae37f09-82c3-47de-970e-a6c0533a458d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:50.267629 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0ae37f09-82c3-47de-970e-a6c0533a458d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:50.402151 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-0ae37f09-82c3-47de-970e-a6c0533a458d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:09:50.409459 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-0ae37f09-82c3-47de-970e-a6c0533a458d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1515 microversion: 2.1 time: 0.159550 Nov 09 20:09:50.410019 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 195/386] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:09:50 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1515 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:09:50.425175 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-d1f0ccbe-4660-421b-b750-a0f974aeca60 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b4067724-e196-4d20-a86b-ca56ba60cf02"}} {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:09:50.426352 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-d1f0ccbe-4660-421b-b750-a0f974aeca60 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:09:50.432560 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d1f0ccbe-4660-421b-b750-a0f974aeca60 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:50.433002 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d1f0ccbe-4660-421b-b750-a0f974aeca60 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:50.433768 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d1f0ccbe-4660-421b-b750-a0f974aeca60 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:50.434194 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d1f0ccbe-4660-421b-b750-a0f974aeca60 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:50.680424 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-d1f0ccbe-4660-421b-b750-a0f974aeca60 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "POST /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.258756 Nov 09 20:09:50.685364 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 192/387] 10.222.0.25 () {60 vars in 1322 bytes} [Tue Nov 9 20:09:50 2021] POST /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 194 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:09:50.892498 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-562650a2-8583-444b-85b5-00041807bc79 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:09:50.893097 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-562650a2-8583-444b-85b5-00041807bc79 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:09:50.899373 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-562650a2-8583-444b-85b5-00041807bc79 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:50.899817 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-562650a2-8583-444b-85b5-00041807bc79 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:50.900624 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-562650a2-8583-444b-85b5-00041807bc79 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:50.901054 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-562650a2-8583-444b-85b5-00041807bc79 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:51.028997 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-8457b821-b746-4bf4-a5bf-5ccaf74bbd3f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:09:51.029699 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-8457b821-b746-4bf4-a5bf-5ccaf74bbd3f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:09:51.031603 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-562650a2-8583-444b-85b5-00041807bc79 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:09:51.035794 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-8457b821-b746-4bf4-a5bf-5ccaf74bbd3f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:51.036932 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-8457b821-b746-4bf4-a5bf-5ccaf74bbd3f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:51.037914 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-8457b821-b746-4bf4-a5bf-5ccaf74bbd3f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:51.038347 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-8457b821-b746-4bf4-a5bf-5ccaf74bbd3f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:51.039996 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-562650a2-8583-444b-85b5-00041807bc79 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:09:51.041505 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-562650a2-8583-444b-85b5-00041807bc79 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:09:51.042636 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-562650a2-8583-444b-85b5-00041807bc79 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1724 microversion: 2.20 time: 0.153773 Nov 09 20:09:51.043189 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 196/388] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:09:50 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 09 20:09:51.167014 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-8457b821-b746-4bf4-a5bf-5ccaf74bbd3f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:09:51.174793 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-8457b821-b746-4bf4-a5bf-5ccaf74bbd3f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1722 microversion: 2.1 time: 0.150374 Nov 09 20:09:51.175353 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 193/389] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:09:51 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 20:09:52.061607 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-01527e00-a098-4954-a33f-ca16e1b9905d tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:09:52.062123 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-01527e00-a098-4954-a33f-ca16e1b9905d tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:09:52.068328 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-01527e00-a098-4954-a33f-ca16e1b9905d tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:52.068809 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-01527e00-a098-4954-a33f-ca16e1b9905d tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:52.069576 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-01527e00-a098-4954-a33f-ca16e1b9905d tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:52.070011 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-01527e00-a098-4954-a33f-ca16e1b9905d tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:52.192060 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-2199b8ee-0a4d-41a6-af27-53d9e6cce26b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:09:52.192882 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-2199b8ee-0a4d-41a6-af27-53d9e6cce26b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:09:52.199192 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-2199b8ee-0a4d-41a6-af27-53d9e6cce26b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:52.199711 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-2199b8ee-0a4d-41a6-af27-53d9e6cce26b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:52.200506 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-2199b8ee-0a4d-41a6-af27-53d9e6cce26b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:52.200938 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-2199b8ee-0a4d-41a6-af27-53d9e6cce26b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:52.207380 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-01527e00-a098-4954-a33f-ca16e1b9905d tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:09:52.215581 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-01527e00-a098-4954-a33f-ca16e1b9905d tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:09:52.220744 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-01527e00-a098-4954-a33f-ca16e1b9905d tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:09:52.222080 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-01527e00-a098-4954-a33f-ca16e1b9905d tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1724 microversion: 2.20 time: 0.164254 Nov 09 20:09:52.222792 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 197/390] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:09:52 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:09:52.333819 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-2199b8ee-0a4d-41a6-af27-53d9e6cce26b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:09:52.341534 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-2199b8ee-0a4d-41a6-af27-53d9e6cce26b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1722 microversion: 2.1 time: 0.153059 Nov 09 20:09:52.342086 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 194/391] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:09:52 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 20:09:53.243156 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-b9c3ade3-37bb-4103-a964-6630669d905c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:09:53.243742 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-b9c3ade3-37bb-4103-a964-6630669d905c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:09:53.249811 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b9c3ade3-37bb-4103-a964-6630669d905c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:53.250249 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b9c3ade3-37bb-4103-a964-6630669d905c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:53.251005 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b9c3ade3-37bb-4103-a964-6630669d905c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:53.251425 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b9c3ade3-37bb-4103-a964-6630669d905c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:53.358862 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-00d03e11-2381-42ab-b561-6df84f3d3a52 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:09:53.359607 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-00d03e11-2381-42ab-b561-6df84f3d3a52 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:09:53.366889 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-00d03e11-2381-42ab-b561-6df84f3d3a52 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:53.367430 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-00d03e11-2381-42ab-b561-6df84f3d3a52 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:53.368325 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-00d03e11-2381-42ab-b561-6df84f3d3a52 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:53.369011 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-00d03e11-2381-42ab-b561-6df84f3d3a52 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:53.393801 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-b9c3ade3-37bb-4103-a964-6630669d905c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:09:53.403057 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-b9c3ade3-37bb-4103-a964-6630669d905c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:09:53.404576 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-b9c3ade3-37bb-4103-a964-6630669d905c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:09:53.405889 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-b9c3ade3-37bb-4103-a964-6630669d905c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1724 microversion: 2.20 time: 0.166938 Nov 09 20:09:53.406443 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 198/392] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:09:53 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 09 20:09:53.503600 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-00d03e11-2381-42ab-b561-6df84f3d3a52 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:09:53.512636 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-00d03e11-2381-42ab-b561-6df84f3d3a52 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1722 microversion: 2.1 time: 0.157646 Nov 09 20:09:53.513204 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 195/393] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:09:53 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 20:09:54.424197 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-b3671533-d630-4b4d-bd4b-939069be0b0a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:09:54.424824 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-b3671533-d630-4b4d-bd4b-939069be0b0a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:09:54.431527 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b3671533-d630-4b4d-bd4b-939069be0b0a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:54.431969 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b3671533-d630-4b4d-bd4b-939069be0b0a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:54.432760 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b3671533-d630-4b4d-bd4b-939069be0b0a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:54.433193 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b3671533-d630-4b4d-bd4b-939069be0b0a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:54.531884 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-1b5bfcfd-d79a-466e-88bd-8fceaa73e763 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:09:54.532682 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-1b5bfcfd-d79a-466e-88bd-8fceaa73e763 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:09:54.540729 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-1b5bfcfd-d79a-466e-88bd-8fceaa73e763 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:54.541357 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-1b5bfcfd-d79a-466e-88bd-8fceaa73e763 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:54.542466 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-1b5bfcfd-d79a-466e-88bd-8fceaa73e763 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:54.546679 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-1b5bfcfd-d79a-466e-88bd-8fceaa73e763 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:54.580446 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-b3671533-d630-4b4d-bd4b-939069be0b0a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:09:54.588876 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-b3671533-d630-4b4d-bd4b-939069be0b0a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:09:54.590667 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-b3671533-d630-4b4d-bd4b-939069be0b0a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:09:54.591848 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-b3671533-d630-4b4d-bd4b-939069be0b0a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1724 microversion: 2.20 time: 0.171306 Nov 09 20:09:54.592571 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 199/394] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:09:54 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:09:54.702328 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-1b5bfcfd-d79a-466e-88bd-8fceaa73e763 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:09:54.712196 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-1b5bfcfd-d79a-466e-88bd-8fceaa73e763 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1722 microversion: 2.1 time: 0.184793 Nov 09 20:09:54.712886 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 196/395] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:09:54 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1722 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 20:09:55.614009 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-22404cae-1d39-44bc-9c28-7831df6444aa tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:09:55.614904 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-22404cae-1d39-44bc-9c28-7831df6444aa tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:09:55.622170 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-22404cae-1d39-44bc-9c28-7831df6444aa tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:55.622785 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-22404cae-1d39-44bc-9c28-7831df6444aa tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:55.623786 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-22404cae-1d39-44bc-9c28-7831df6444aa tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:55.624441 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-22404cae-1d39-44bc-9c28-7831df6444aa tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:55.730981 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-6624d165-ce51-40d8-8bf0-4a3b3e6802a1 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:09:55.731844 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-6624d165-ce51-40d8-8bf0-4a3b3e6802a1 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:09:55.738055 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6624d165-ce51-40d8-8bf0-4a3b3e6802a1 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:55.738496 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6624d165-ce51-40d8-8bf0-4a3b3e6802a1 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:55.739361 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6624d165-ce51-40d8-8bf0-4a3b3e6802a1 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:55.740224 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6624d165-ce51-40d8-8bf0-4a3b3e6802a1 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:55.789318 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-22404cae-1d39-44bc-9c28-7831df6444aa tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:09:55.797257 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-22404cae-1d39-44bc-9c28-7831df6444aa tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:09:55.798846 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-22404cae-1d39-44bc-9c28-7831df6444aa tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:09:55.800102 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-22404cae-1d39-44bc-9c28-7831df6444aa tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1724 microversion: 2.20 time: 0.190310 Nov 09 20:09:55.800703 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 200/396] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:09:55 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1724 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:09:55.877784 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-6624d165-ce51-40d8-8bf0-4a3b3e6802a1 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:09:55.885999 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-6624d165-ce51-40d8-8bf0-4a3b3e6802a1 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1722 microversion: 2.1 time: 0.159718 Nov 09 20:09:55.886564 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 197/397] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:09:55 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 20:09:56.819068 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-3a44dd31-67b5-4882-9528-906341bdfa38 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:09:56.819586 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-3a44dd31-67b5-4882-9528-906341bdfa38 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:09:56.825741 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3a44dd31-67b5-4882-9528-906341bdfa38 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:56.826192 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3a44dd31-67b5-4882-9528-906341bdfa38 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:56.826955 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3a44dd31-67b5-4882-9528-906341bdfa38 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:56.827384 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3a44dd31-67b5-4882-9528-906341bdfa38 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:56.903123 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-ad07eb96-a8f0-4fdc-b918-28d5c0fbfdb9 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:09:56.903720 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-ad07eb96-a8f0-4fdc-b918-28d5c0fbfdb9 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:09:56.909832 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ad07eb96-a8f0-4fdc-b918-28d5c0fbfdb9 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:56.910274 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ad07eb96-a8f0-4fdc-b918-28d5c0fbfdb9 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:56.911717 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ad07eb96-a8f0-4fdc-b918-28d5c0fbfdb9 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:56.912293 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ad07eb96-a8f0-4fdc-b918-28d5c0fbfdb9 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:56.985009 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-3a44dd31-67b5-4882-9528-906341bdfa38 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:09:56.993572 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-3a44dd31-67b5-4882-9528-906341bdfa38 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:09:56.995068 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-3a44dd31-67b5-4882-9528-906341bdfa38 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:09:56.996217 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-3a44dd31-67b5-4882-9528-906341bdfa38 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1724 microversion: 2.20 time: 0.181060 Nov 09 20:09:56.996823 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 201/398] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:09:56 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1724 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:09:57.054310 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-ad07eb96-a8f0-4fdc-b918-28d5c0fbfdb9 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:09:57.062455 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-ad07eb96-a8f0-4fdc-b918-28d5c0fbfdb9 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1722 microversion: 2.1 time: 0.162971 Nov 09 20:09:57.063156 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 198/399] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:09:56 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 20:09:58.014579 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-5a290df4-e33f-4c25-a358-f3f9f09caeee tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:09:58.015158 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-5a290df4-e33f-4c25-a358-f3f9f09caeee tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:09:58.022692 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5a290df4-e33f-4c25-a358-f3f9f09caeee tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:58.023139 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5a290df4-e33f-4c25-a358-f3f9f09caeee tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:58.024026 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5a290df4-e33f-4c25-a358-f3f9f09caeee tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:58.024621 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5a290df4-e33f-4c25-a358-f3f9f09caeee tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:58.079268 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-477910bc-426b-459e-a6e2-0ff277dfda70 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:09:58.080762 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-477910bc-426b-459e-a6e2-0ff277dfda70 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:09:58.089045 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-477910bc-426b-459e-a6e2-0ff277dfda70 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:58.089493 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-477910bc-426b-459e-a6e2-0ff277dfda70 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:58.090900 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-477910bc-426b-459e-a6e2-0ff277dfda70 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:58.091501 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-477910bc-426b-459e-a6e2-0ff277dfda70 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:58.210988 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-5a290df4-e33f-4c25-a358-f3f9f09caeee tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:09:58.219335 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-5a290df4-e33f-4c25-a358-f3f9f09caeee tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:09:58.221069 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-5a290df4-e33f-4c25-a358-f3f9f09caeee tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:09:58.222430 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-5a290df4-e33f-4c25-a358-f3f9f09caeee tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1724 microversion: 2.20 time: 0.211587 Nov 09 20:09:58.222984 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 202/400] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:09:58 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1724 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:09:58.257220 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-477910bc-426b-459e-a6e2-0ff277dfda70 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:09:58.265029 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-477910bc-426b-459e-a6e2-0ff277dfda70 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1722 microversion: 2.1 time: 0.189506 Nov 09 20:09:58.265527 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 199/401] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:09:58 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1722 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 20:09:59.241005 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-f881b5d8-89f8-49dd-8cee-fe9ea3aca477 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:09:59.241637 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-f881b5d8-89f8-49dd-8cee-fe9ea3aca477 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:09:59.247732 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f881b5d8-89f8-49dd-8cee-fe9ea3aca477 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:59.248176 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f881b5d8-89f8-49dd-8cee-fe9ea3aca477 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:59.251662 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f881b5d8-89f8-49dd-8cee-fe9ea3aca477 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:59.251662 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f881b5d8-89f8-49dd-8cee-fe9ea3aca477 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:59.281666 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-fee36002-c317-4442-99b8-03e104752c11 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:09:59.282373 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-fee36002-c317-4442-99b8-03e104752c11 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:09:59.289855 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-fee36002-c317-4442-99b8-03e104752c11 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:59.290302 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-fee36002-c317-4442-99b8-03e104752c11 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:59.291076 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-fee36002-c317-4442-99b8-03e104752c11 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:09:59.291505 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-fee36002-c317-4442-99b8-03e104752c11 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:09:59.430352 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-f881b5d8-89f8-49dd-8cee-fe9ea3aca477 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:09:59.438347 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-f881b5d8-89f8-49dd-8cee-fe9ea3aca477 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:09:59.439862 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-f881b5d8-89f8-49dd-8cee-fe9ea3aca477 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:09:59.441077 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-f881b5d8-89f8-49dd-8cee-fe9ea3aca477 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1724 microversion: 2.20 time: 0.204010 Nov 09 20:09:59.441668 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 203/402] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:09:59 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1724 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:09:59.466114 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-fee36002-c317-4442-99b8-03e104752c11 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:09:59.473916 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-fee36002-c317-4442-99b8-03e104752c11 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1722 microversion: 2.1 time: 0.196225 Nov 09 20:09:59.474464 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 200/403] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:09:59 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1722 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:10:00.459820 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-cd4dfaa7-8ce6-4e10-8e94-2557090031aa tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:10:00.460342 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-cd4dfaa7-8ce6-4e10-8e94-2557090031aa tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:10:00.466458 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cd4dfaa7-8ce6-4e10-8e94-2557090031aa tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:10:00.466896 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cd4dfaa7-8ce6-4e10-8e94-2557090031aa tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:10:00.467653 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cd4dfaa7-8ce6-4e10-8e94-2557090031aa tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:10:00.468076 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cd4dfaa7-8ce6-4e10-8e94-2557090031aa tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:10:00.491429 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-ae6cc5d8-cf3d-4498-838c-8a2540482631 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:10:00.492031 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-ae6cc5d8-cf3d-4498-838c-8a2540482631 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:10:00.498289 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ae6cc5d8-cf3d-4498-838c-8a2540482631 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:10:00.498732 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ae6cc5d8-cf3d-4498-838c-8a2540482631 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:10:00.499505 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ae6cc5d8-cf3d-4498-838c-8a2540482631 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:10:00.499934 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ae6cc5d8-cf3d-4498-838c-8a2540482631 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:10:00.646733 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-cd4dfaa7-8ce6-4e10-8e94-2557090031aa tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:10:00.654783 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-cd4dfaa7-8ce6-4e10-8e94-2557090031aa tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:10:00.656212 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-cd4dfaa7-8ce6-4e10-8e94-2557090031aa tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:10:00.657399 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-cd4dfaa7-8ce6-4e10-8e94-2557090031aa tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1724 microversion: 2.20 time: 0.201325 Nov 09 20:10:00.658145 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 204/404] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:10:00 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1724 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:10:00.673699 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-ae6cc5d8-cf3d-4498-838c-8a2540482631 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:10:00.682012 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-ae6cc5d8-cf3d-4498-838c-8a2540482631 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1722 microversion: 2.1 time: 0.194818 Nov 09 20:10:00.682711 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 201/405] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:10:00 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1722 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 20:10:01.674988 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-df88e0d5-266c-49f1-b3aa-b0dbe0d0fec5 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:10:01.675585 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-df88e0d5-266c-49f1-b3aa-b0dbe0d0fec5 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:10:01.682574 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-df88e0d5-266c-49f1-b3aa-b0dbe0d0fec5 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:10:01.683017 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-df88e0d5-266c-49f1-b3aa-b0dbe0d0fec5 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:10:01.683780 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-df88e0d5-266c-49f1-b3aa-b0dbe0d0fec5 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:10:01.684203 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-df88e0d5-266c-49f1-b3aa-b0dbe0d0fec5 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:10:01.698146 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-9efbac87-7866-4f16-913c-9f260a7f2e91 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:10:01.698663 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-9efbac87-7866-4f16-913c-9f260a7f2e91 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:10:01.705336 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-9efbac87-7866-4f16-913c-9f260a7f2e91 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:10:01.705783 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-9efbac87-7866-4f16-913c-9f260a7f2e91 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:10:01.706565 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-9efbac87-7866-4f16-913c-9f260a7f2e91 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:10:01.706997 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-9efbac87-7866-4f16-913c-9f260a7f2e91 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:10:01.878451 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-df88e0d5-266c-49f1-b3aa-b0dbe0d0fec5 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:10:01.886368 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-9efbac87-7866-4f16-913c-9f260a7f2e91 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:10:01.886745 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-df88e0d5-266c-49f1-b3aa-b0dbe0d0fec5 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:10:01.888271 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-df88e0d5-266c-49f1-b3aa-b0dbe0d0fec5 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:10:01.889975 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-df88e0d5-266c-49f1-b3aa-b0dbe0d0fec5 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1745 microversion: 2.20 time: 0.218220 Nov 09 20:10:01.892272 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 205/406] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:10:01 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1745 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:10:01.894743 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-9efbac87-7866-4f16-913c-9f260a7f2e91 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1722 microversion: 2.1 time: 0.200277 Nov 09 20:10:01.896453 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 202/407] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:10:01 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1722 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:10:02.910068 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-2220bd3e-996d-4300-afc2-aebc7a200e45 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:10:02.910783 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-2220bd3e-996d-4300-afc2-aebc7a200e45 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:10:02.911881 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-8e2454f9-2fc4-4c3a-89ae-1d499d68b8c1 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:10:02.912515 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-8e2454f9-2fc4-4c3a-89ae-1d499d68b8c1 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:10:02.917071 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2220bd3e-996d-4300-afc2-aebc7a200e45 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:10:02.917513 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2220bd3e-996d-4300-afc2-aebc7a200e45 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:10:02.918271 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2220bd3e-996d-4300-afc2-aebc7a200e45 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:10:02.918586 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-8e2454f9-2fc4-4c3a-89ae-1d499d68b8c1 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:10:02.918686 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2220bd3e-996d-4300-afc2-aebc7a200e45 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:10:02.919035 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-8e2454f9-2fc4-4c3a-89ae-1d499d68b8c1 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:10:02.919823 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-8e2454f9-2fc4-4c3a-89ae-1d499d68b8c1 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:10:02.920256 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-8e2454f9-2fc4-4c3a-89ae-1d499d68b8c1 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:10:03.105722 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-2220bd3e-996d-4300-afc2-aebc7a200e45 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:10:03.109757 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-8e2454f9-2fc4-4c3a-89ae-1d499d68b8c1 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:10:03.113510 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-2220bd3e-996d-4300-afc2-aebc7a200e45 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:10:03.115877 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-2220bd3e-996d-4300-afc2-aebc7a200e45 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:10:03.117067 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-2220bd3e-996d-4300-afc2-aebc7a200e45 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1745 microversion: 2.20 time: 0.210666 Nov 09 20:10:03.117628 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 206/408] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:10:02 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1745 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:10:03.118021 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-8e2454f9-2fc4-4c3a-89ae-1d499d68b8c1 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1722 microversion: 2.1 time: 0.209779 Nov 09 20:10:03.118697 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 203/409] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:10:02 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1722 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 20:10:04.134771 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-51ff6e09-0d8a-44ea-b13f-3a28d1e99b43 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:10:04.135217 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-fd2d529b-7478-4d35-8859-b910306fffb1 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:10:04.135671 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-51ff6e09-0d8a-44ea-b13f-3a28d1e99b43 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:10:04.135783 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-fd2d529b-7478-4d35-8859-b910306fffb1 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:10:04.141679 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-51ff6e09-0d8a-44ea-b13f-3a28d1e99b43 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:10:04.142027 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-fd2d529b-7478-4d35-8859-b910306fffb1 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:10:04.142196 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-51ff6e09-0d8a-44ea-b13f-3a28d1e99b43 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:10:04.142866 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-51ff6e09-0d8a-44ea-b13f-3a28d1e99b43 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:10:04.142996 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-fd2d529b-7478-4d35-8859-b910306fffb1 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:10:04.143581 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-51ff6e09-0d8a-44ea-b13f-3a28d1e99b43 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:10:04.143806 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-fd2d529b-7478-4d35-8859-b910306fffb1 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:10:04.144211 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-fd2d529b-7478-4d35-8859-b910306fffb1 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:10:04.329742 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-51ff6e09-0d8a-44ea-b13f-3a28d1e99b43 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:10:04.339588 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-51ff6e09-0d8a-44ea-b13f-3a28d1e99b43 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1699 microversion: 2.1 time: 0.208079 Nov 09 20:10:04.340171 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 207/410] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:10:04 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1699 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:10:04.358727 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-fd2d529b-7478-4d35-8859-b910306fffb1 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:10:04.369553 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-3a01689f-ca8a-4155-815d-5b918c4da659 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:10:04.373960 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-fd2d529b-7478-4d35-8859-b910306fffb1 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:10:04.375457 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-fd2d529b-7478-4d35-8859-b910306fffb1 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:10:04.376659 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-fd2d529b-7478-4d35-8859-b910306fffb1 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1740 microversion: 2.20 time: 0.245398 Nov 09 20:10:04.377220 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 204/411] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:10:04 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1740 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:10:04.384192 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3a01689f-ca8a-4155-815d-5b918c4da659 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:10:04.384654 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3a01689f-ca8a-4155-815d-5b918c4da659 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:10:04.411250 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-3a01689f-ca8a-4155-815d-5b918c4da659 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Going to try to start instance {{(pid=116103) start /opt/stack/nova/nova/compute/api.py:2677}} Nov 09 20:10:04.463031 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-3a01689f-ca8a-4155-815d-5b918c4da659 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "POST /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/action" status: 202 len: 0 microversion: 2.1 time: 0.109168 Nov 09 20:10:04.464152 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 208/412] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Nov 9 20:10:04 2021] POST /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/action => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 09 20:10:04.471595 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-e02ab962-7c9b-4e41-810a-f7c0e1452d2b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:10:04.472631 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-e02ab962-7c9b-4e41-810a-f7c0e1452d2b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:10:04.479995 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e02ab962-7c9b-4e41-810a-f7c0e1452d2b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:10:04.480765 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e02ab962-7c9b-4e41-810a-f7c0e1452d2b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:10:04.481519 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e02ab962-7c9b-4e41-810a-f7c0e1452d2b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:10:04.482108 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e02ab962-7c9b-4e41-810a-f7c0e1452d2b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:10:04.639626 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-e02ab962-7c9b-4e41-810a-f7c0e1452d2b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:10:04.648009 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-e02ab962-7c9b-4e41-810a-f7c0e1452d2b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1708 microversion: 2.1 time: 0.180010 Nov 09 20:10:04.648624 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 205/413] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:10:04 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1708 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:10:05.397286 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-ae89a206-f520-4e0b-8df8-06ba4ee84973 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:10:05.398220 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-ae89a206-f520-4e0b-8df8-06ba4ee84973 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:10:05.414443 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ae89a206-f520-4e0b-8df8-06ba4ee84973 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:10:05.415092 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ae89a206-f520-4e0b-8df8-06ba4ee84973 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:10:05.416128 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ae89a206-f520-4e0b-8df8-06ba4ee84973 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:10:05.416772 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ae89a206-f520-4e0b-8df8-06ba4ee84973 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:10:05.576182 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-ae89a206-f520-4e0b-8df8-06ba4ee84973 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:10:05.587176 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-ae89a206-f520-4e0b-8df8-06ba4ee84973 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:10:05.588784 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-ae89a206-f520-4e0b-8df8-06ba4ee84973 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:10:05.592683 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-ae89a206-f520-4e0b-8df8-06ba4ee84973 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1740 microversion: 2.20 time: 0.200181 Nov 09 20:10:05.593713 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 209/414] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:10:05 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1740 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:10:05.665488 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-43cfda94-9e79-4b0a-b419-b0043ccb1b75 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:10:05.666815 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-43cfda94-9e79-4b0a-b419-b0043ccb1b75 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:10:05.673518 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-43cfda94-9e79-4b0a-b419-b0043ccb1b75 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:10:05.674157 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-43cfda94-9e79-4b0a-b419-b0043ccb1b75 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:10:05.675116 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-43cfda94-9e79-4b0a-b419-b0043ccb1b75 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:10:05.675694 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-43cfda94-9e79-4b0a-b419-b0043ccb1b75 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:10:05.826623 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-43cfda94-9e79-4b0a-b419-b0043ccb1b75 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:10:05.837885 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-43cfda94-9e79-4b0a-b419-b0043ccb1b75 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1708 microversion: 2.1 time: 0.176375 Nov 09 20:10:05.838459 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 206/415] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:10:05 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1708 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:10:06.590080 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [req-12dbd165-4b97-4864-908c-f71f7feae2b9 req-7f9d6f15-fba7-494b-b0f3-8922efe61db7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae338c69-d22d-41c2-89b0-b0cec236521e", "name": "network-vif-plugged", "status": "completed", "tag": "8caa7fa5-9183-46fa-9387-e9fbebafe302"}]} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:10:06.592816 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 20:10:06.592816 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: warnings.warn(msg) Nov 09 20:10:06.603020 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-12dbd165-4b97-4864-908c-f71f7feae2b9 req-7f9d6f15-fba7-494b-b0f3-8922efe61db7 service nova] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:10:06.603576 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-12dbd165-4b97-4864-908c-f71f7feae2b9 req-7f9d6f15-fba7-494b-b0f3-8922efe61db7 service nova] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:10:06.611398 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-fb6f1999-8720-4db2-aed8-faea560a4558 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:10:06.612470 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-fb6f1999-8720-4db2-aed8-faea560a4558 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:10:06.619114 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-fb6f1999-8720-4db2-aed8-faea560a4558 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:10:06.620628 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-fb6f1999-8720-4db2-aed8-faea560a4558 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:10:06.626506 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-fb6f1999-8720-4db2-aed8-faea560a4558 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:10:06.627192 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-fb6f1999-8720-4db2-aed8-faea560a4558 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:10:06.633127 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.compute.server_external_events [req-12dbd165-4b97-4864-908c-f71f7feae2b9 req-7f9d6f15-fba7-494b-b0f3-8922efe61db7 service nova] Creating event network-vif-plugged:8caa7fa5-9183-46fa-9387-e9fbebafe302 for instance ae338c69-d22d-41c2-89b0-b0cec236521e on hv-cinder-80135 Nov 09 20:10:06.638109 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [req-12dbd165-4b97-4864-908c-f71f7feae2b9 req-7f9d6f15-fba7-494b-b0f3-8922efe61db7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052755 Nov 09 20:10:06.639005 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 210/416] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Nov 9 20:10:06 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:10:06.778678 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-fb6f1999-8720-4db2-aed8-faea560a4558 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:10:06.787113 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-fb6f1999-8720-4db2-aed8-faea560a4558 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:10:06.788877 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-fb6f1999-8720-4db2-aed8-faea560a4558 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:10:06.790030 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-fb6f1999-8720-4db2-aed8-faea560a4558 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1740 microversion: 2.20 time: 0.182285 Nov 09 20:10:06.790583 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 207/417] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:10:06 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1740 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 09 20:10:06.856642 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-d436bd5f-25f1-41d4-aa92-210f734c3c61 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:10:06.857317 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-d436bd5f-25f1-41d4-aa92-210f734c3c61 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:10:06.863589 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d436bd5f-25f1-41d4-aa92-210f734c3c61 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:10:06.864205 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d436bd5f-25f1-41d4-aa92-210f734c3c61 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:10:06.865785 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d436bd5f-25f1-41d4-aa92-210f734c3c61 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:10:06.866219 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d436bd5f-25f1-41d4-aa92-210f734c3c61 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:10:07.025527 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-d436bd5f-25f1-41d4-aa92-210f734c3c61 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:10:07.034005 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-d436bd5f-25f1-41d4-aa92-210f734c3c61 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1712 microversion: 2.1 time: 0.181506 Nov 09 20:10:07.035104 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 211/418] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:10:06 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1712 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:10:07.808851 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-c69d5bc6-b652-46f6-a84f-cdeed95099f0 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:10:07.809581 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-c69d5bc6-b652-46f6-a84f-cdeed95099f0 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:10:07.820472 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c69d5bc6-b652-46f6-a84f-cdeed95099f0 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:10:07.821607 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c69d5bc6-b652-46f6-a84f-cdeed95099f0 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:10:07.823114 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c69d5bc6-b652-46f6-a84f-cdeed95099f0 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:10:07.823721 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c69d5bc6-b652-46f6-a84f-cdeed95099f0 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:10:07.968025 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-c69d5bc6-b652-46f6-a84f-cdeed95099f0 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:10:07.977191 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-c69d5bc6-b652-46f6-a84f-cdeed95099f0 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:10:07.978990 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-c69d5bc6-b652-46f6-a84f-cdeed95099f0 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:10:07.980481 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-c69d5bc6-b652-46f6-a84f-cdeed95099f0 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1740 microversion: 2.20 time: 0.175304 Nov 09 20:10:07.981272 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 208/419] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:10:07 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1740 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:10:09.001670 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-393c6b79-b4fa-4bdd-ba59-a78ae6c8e458 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:10:09.002264 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-393c6b79-b4fa-4bdd-ba59-a78ae6c8e458 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:10:09.009177 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-393c6b79-b4fa-4bdd-ba59-a78ae6c8e458 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:10:09.009467 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-393c6b79-b4fa-4bdd-ba59-a78ae6c8e458 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:10:09.010275 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-393c6b79-b4fa-4bdd-ba59-a78ae6c8e458 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:10:09.010716 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-393c6b79-b4fa-4bdd-ba59-a78ae6c8e458 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:10:09.170933 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-393c6b79-b4fa-4bdd-ba59-a78ae6c8e458 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:10:09.180137 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-393c6b79-b4fa-4bdd-ba59-a78ae6c8e458 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:10:09.182161 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-393c6b79-b4fa-4bdd-ba59-a78ae6c8e458 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:10:09.183553 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-393c6b79-b4fa-4bdd-ba59-a78ae6c8e458 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1740 microversion: 2.20 time: 0.185552 Nov 09 20:10:09.195475 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 212/420] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:10:08 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1740 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 09 20:10:10.202929 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-3ed80978-202c-4889-aab1-1c0fc47c880b tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:10:10.204171 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-3ed80978-202c-4889-aab1-1c0fc47c880b tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:10:10.211210 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-3ed80978-202c-4889-aab1-1c0fc47c880b tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:10:10.211873 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-3ed80978-202c-4889-aab1-1c0fc47c880b tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:10:10.212917 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-3ed80978-202c-4889-aab1-1c0fc47c880b tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:10:10.213554 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-3ed80978-202c-4889-aab1-1c0fc47c880b tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:10:10.392815 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-3ed80978-202c-4889-aab1-1c0fc47c880b tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:10:10.401952 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-3ed80978-202c-4889-aab1-1c0fc47c880b tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:10:10.403691 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-3ed80978-202c-4889-aab1-1c0fc47c880b tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:10:10.405114 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-3ed80978-202c-4889-aab1-1c0fc47c880b tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1740 microversion: 2.20 time: 0.206062 Nov 09 20:10:10.417311 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 209/421] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:10:10 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1740 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:10:11.423667 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-c863409c-cc84-4be2-86bd-474ac87fe946 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:10:11.425478 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-c863409c-cc84-4be2-86bd-474ac87fe946 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:10:11.433067 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c863409c-cc84-4be2-86bd-474ac87fe946 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:10:11.433767 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c863409c-cc84-4be2-86bd-474ac87fe946 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:10:11.435125 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c863409c-cc84-4be2-86bd-474ac87fe946 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:10:11.435769 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c863409c-cc84-4be2-86bd-474ac87fe946 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:10:11.588312 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-c863409c-cc84-4be2-86bd-474ac87fe946 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:10:11.601592 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-c863409c-cc84-4be2-86bd-474ac87fe946 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:10:11.601592 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-c863409c-cc84-4be2-86bd-474ac87fe946 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:10:11.601907 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-c863409c-cc84-4be2-86bd-474ac87fe946 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1740 microversion: 2.20 time: 0.182024 Nov 09 20:10:11.604880 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 213/422] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:10:11 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1740 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:10:12.622074 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-d8899461-c01c-486e-bb0d-b0adf72cdff1 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:10:12.623483 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-d8899461-c01c-486e-bb0d-b0adf72cdff1 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:10:12.633664 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d8899461-c01c-486e-bb0d-b0adf72cdff1 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:10:12.635325 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d8899461-c01c-486e-bb0d-b0adf72cdff1 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:10:12.637244 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d8899461-c01c-486e-bb0d-b0adf72cdff1 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:10:12.637928 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d8899461-c01c-486e-bb0d-b0adf72cdff1 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:10:12.783429 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-d8899461-c01c-486e-bb0d-b0adf72cdff1 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:10:12.792323 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-d8899461-c01c-486e-bb0d-b0adf72cdff1 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:10:12.794163 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-d8899461-c01c-486e-bb0d-b0adf72cdff1 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:10:12.795651 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-d8899461-c01c-486e-bb0d-b0adf72cdff1 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1740 microversion: 2.20 time: 0.177414 Nov 09 20:10:12.797632 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 210/423] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:10:12 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1740 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:10:13.815169 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-d9092203-048d-4997-ab54-b05486dc07fd tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:10:13.815763 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-d9092203-048d-4997-ab54-b05486dc07fd tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:10:13.822935 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d9092203-048d-4997-ab54-b05486dc07fd tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:10:13.823381 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d9092203-048d-4997-ab54-b05486dc07fd tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:10:13.824141 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d9092203-048d-4997-ab54-b05486dc07fd tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:10:13.824613 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d9092203-048d-4997-ab54-b05486dc07fd tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:10:13.958448 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-d9092203-048d-4997-ab54-b05486dc07fd tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:10:13.966146 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-d9092203-048d-4997-ab54-b05486dc07fd tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:10:13.967630 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-d9092203-048d-4997-ab54-b05486dc07fd tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:10:13.968801 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-d9092203-048d-4997-ab54-b05486dc07fd tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1740 microversion: 2.20 time: 0.157389 Nov 09 20:10:13.969369 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 214/424] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:10:13 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1740 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 09 20:10:14.987051 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-b8bbf7dc-cd20-48cc-9e94-9d57288f716b tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:10:14.987673 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-b8bbf7dc-cd20-48cc-9e94-9d57288f716b tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:10:14.994750 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b8bbf7dc-cd20-48cc-9e94-9d57288f716b tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:10:14.995205 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b8bbf7dc-cd20-48cc-9e94-9d57288f716b tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:10:14.995990 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b8bbf7dc-cd20-48cc-9e94-9d57288f716b tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:10:14.996437 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b8bbf7dc-cd20-48cc-9e94-9d57288f716b tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:10:15.123912 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-b8bbf7dc-cd20-48cc-9e94-9d57288f716b tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:10:15.131484 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-b8bbf7dc-cd20-48cc-9e94-9d57288f716b tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:10:15.132995 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-b8bbf7dc-cd20-48cc-9e94-9d57288f716b tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:10:15.134118 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-b8bbf7dc-cd20-48cc-9e94-9d57288f716b tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1722 microversion: 2.20 time: 0.150795 Nov 09 20:10:15.134666 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 211/425] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:10:14 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:10:16.152342 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-8fcc28e4-a011-4bdb-aa85-fea64b755f80 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:10:16.152969 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-8fcc28e4-a011-4bdb-aa85-fea64b755f80 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:10:16.159141 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8fcc28e4-a011-4bdb-aa85-fea64b755f80 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:10:16.159581 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8fcc28e4-a011-4bdb-aa85-fea64b755f80 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:10:16.160336 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8fcc28e4-a011-4bdb-aa85-fea64b755f80 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:10:16.161525 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8fcc28e4-a011-4bdb-aa85-fea64b755f80 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:10:16.291281 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-8fcc28e4-a011-4bdb-aa85-fea64b755f80 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:10:16.298839 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-8fcc28e4-a011-4bdb-aa85-fea64b755f80 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:10:16.300312 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-8fcc28e4-a011-4bdb-aa85-fea64b755f80 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:10:16.301562 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-8fcc28e4-a011-4bdb-aa85-fea64b755f80 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1722 microversion: 2.20 time: 0.152783 Nov 09 20:10:16.302108 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 215/426] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:10:16 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:10:17.319834 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-3c31cd27-964f-4d69-aa27-b2428ec36fff tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:10:17.320353 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-3c31cd27-964f-4d69-aa27-b2428ec36fff tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:10:17.326543 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-3c31cd27-964f-4d69-aa27-b2428ec36fff tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:10:17.326983 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-3c31cd27-964f-4d69-aa27-b2428ec36fff tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:10:17.327748 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-3c31cd27-964f-4d69-aa27-b2428ec36fff tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:10:17.328174 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-3c31cd27-964f-4d69-aa27-b2428ec36fff tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:10:17.454676 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-3c31cd27-964f-4d69-aa27-b2428ec36fff tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:10:17.462512 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-3c31cd27-964f-4d69-aa27-b2428ec36fff tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:10:17.464123 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-3c31cd27-964f-4d69-aa27-b2428ec36fff tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:10:17.465346 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-3c31cd27-964f-4d69-aa27-b2428ec36fff tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1665 microversion: 2.20 time: 0.149886 Nov 09 20:10:17.465905 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 212/427] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:10:17 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1665 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:10:17.483834 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-a01ded8c-e09d-4cec-9142-5062fac3a6bb tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "334c646b-ed41-4854-a092-efa78ad7bbbf"}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:10:17.484965 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-a01ded8c-e09d-4cec-9142-5062fac3a6bb tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:10:17.492095 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a01ded8c-e09d-4cec-9142-5062fac3a6bb tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:10:17.492631 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a01ded8c-e09d-4cec-9142-5062fac3a6bb tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:10:17.493408 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a01ded8c-e09d-4cec-9142-5062fac3a6bb tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:10:17.493842 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a01ded8c-e09d-4cec-9142-5062fac3a6bb tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:10:17.760306 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-a01ded8c-e09d-4cec-9142-5062fac3a6bb tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "POST /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.279893 Nov 09 20:10:17.765237 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 216/428] 10.222.0.25 () {62 vars in 1363 bytes} [Tue Nov 9 20:10:17 2021] POST /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e/os-volume_attachments => generated 188 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 20:10:17.868104 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-195cd98d-80da-411a-83d9-5d84370e257e tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:10:17.868698 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-195cd98d-80da-411a-83d9-5d84370e257e tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:10:17.874445 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-195cd98d-80da-411a-83d9-5d84370e257e tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:10:17.874886 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-195cd98d-80da-411a-83d9-5d84370e257e tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:10:17.875679 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-195cd98d-80da-411a-83d9-5d84370e257e tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:10:17.876106 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-195cd98d-80da-411a-83d9-5d84370e257e tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:10:17.963024 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-195cd98d-80da-411a-83d9-5d84370e257e tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "POST /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e/action" status: 202 len: 0 microversion: 2.20 time: 0.099197 Nov 09 20:10:17.963804 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 213/429] 10.222.0.25 () {62 vars in 1318 bytes} [Tue Nov 9 20:10:17 2021] POST /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e/action => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 09 20:10:17.971652 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-f012ae49-80a9-4eba-8ac0-4353948e58fc tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:10:17.972256 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-f012ae49-80a9-4eba-8ac0-4353948e58fc tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:10:17.979241 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f012ae49-80a9-4eba-8ac0-4353948e58fc tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:10:17.979683 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f012ae49-80a9-4eba-8ac0-4353948e58fc tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:10:17.980493 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f012ae49-80a9-4eba-8ac0-4353948e58fc tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:10:17.980934 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f012ae49-80a9-4eba-8ac0-4353948e58fc tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:10:18.120889 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-f012ae49-80a9-4eba-8ac0-4353948e58fc tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:10:18.136008 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-f012ae49-80a9-4eba-8ac0-4353948e58fc tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:10:18.137598 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-f012ae49-80a9-4eba-8ac0-4353948e58fc tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:10:18.138768 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-f012ae49-80a9-4eba-8ac0-4353948e58fc tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1751 microversion: 2.20 time: 0.170820 Nov 09 20:10:18.150794 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 217/430] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:10:17 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1751 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 09 20:10:18.562232 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [req-fd7a81bb-262b-4572-a9d6-91069d5fe31a req-aa7d34ca-d399-42e5-af13-1e65d715af3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae338c69-d22d-41c2-89b0-b0cec236521e", "name": "network-vif-unplugged", "status": "completed", "tag": "8caa7fa5-9183-46fa-9387-e9fbebafe302"}]} {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:10:18.564776 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 20:10:18.564776 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: warnings.warn(msg) Nov 09 20:10:18.575946 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [req-fd7a81bb-262b-4572-a9d6-91069d5fe31a req-aa7d34ca-d399-42e5-af13-1e65d715af3a service nova] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:10:18.576441 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [req-fd7a81bb-262b-4572-a9d6-91069d5fe31a req-aa7d34ca-d399-42e5-af13-1e65d715af3a service nova] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:10:18.589262 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.compute.server_external_events [req-fd7a81bb-262b-4572-a9d6-91069d5fe31a req-aa7d34ca-d399-42e5-af13-1e65d715af3a service nova] Unable to find a host for instance ae338c69-d22d-41c2-89b0-b0cec236521e. Dropping event network-vif-unplugged {{(pid=116102) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Nov 09 20:10:18.590499 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [req-fd7a81bb-262b-4572-a9d6-91069d5fe31a req-aa7d34ca-d399-42e5-af13-1e65d715af3a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.033335 Nov 09 20:10:18.591095 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 214/431] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Nov 9 20:10:18 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 35 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Nov 09 20:10:19.157459 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-7466e70c-bedc-41a3-8c4b-13cd901dee56 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:10:19.158036 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-7466e70c-bedc-41a3-8c4b-13cd901dee56 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:10:19.165101 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7466e70c-bedc-41a3-8c4b-13cd901dee56 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:10:19.165487 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7466e70c-bedc-41a3-8c4b-13cd901dee56 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:10:19.166266 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7466e70c-bedc-41a3-8c4b-13cd901dee56 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:10:19.166701 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7466e70c-bedc-41a3-8c4b-13cd901dee56 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:10:19.293966 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-7466e70c-bedc-41a3-8c4b-13cd901dee56 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:10:19.302206 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-7466e70c-bedc-41a3-8c4b-13cd901dee56 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:10:19.303684 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-7466e70c-bedc-41a3-8c4b-13cd901dee56 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:10:19.304838 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-7466e70c-bedc-41a3-8c4b-13cd901dee56 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1753 microversion: 2.20 time: 0.151104 Nov 09 20:10:19.305386 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 218/432] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:10:19 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1753 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:10:20.322872 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-919e2eb9-d7a9-4af8-a949-15b6f1061ad3 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:10:20.323477 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-919e2eb9-d7a9-4af8-a949-15b6f1061ad3 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:10:20.329773 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-919e2eb9-d7a9-4af8-a949-15b6f1061ad3 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:10:20.330219 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-919e2eb9-d7a9-4af8-a949-15b6f1061ad3 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:10:20.330987 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-919e2eb9-d7a9-4af8-a949-15b6f1061ad3 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:10:20.331423 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-919e2eb9-d7a9-4af8-a949-15b6f1061ad3 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:10:20.458933 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-919e2eb9-d7a9-4af8-a949-15b6f1061ad3 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:10:20.466938 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-919e2eb9-d7a9-4af8-a949-15b6f1061ad3 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:10:20.468513 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-919e2eb9-d7a9-4af8-a949-15b6f1061ad3 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:10:20.469657 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-919e2eb9-d7a9-4af8-a949-15b6f1061ad3 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1753 microversion: 2.20 time: 0.150522 Nov 09 20:10:20.470213 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 215/433] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:10:20 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1753 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 09 20:10:21.487460 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-29adc5f4-2dea-4833-8624-578ca94e8eeb tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:10:21.488054 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-29adc5f4-2dea-4833-8624-578ca94e8eeb tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:10:21.494873 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-29adc5f4-2dea-4833-8624-578ca94e8eeb tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:10:21.495314 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-29adc5f4-2dea-4833-8624-578ca94e8eeb tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:10:21.496063 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-29adc5f4-2dea-4833-8624-578ca94e8eeb tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:10:21.496512 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-29adc5f4-2dea-4833-8624-578ca94e8eeb tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:10:21.621432 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-29adc5f4-2dea-4833-8624-578ca94e8eeb tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:10:21.630043 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-29adc5f4-2dea-4833-8624-578ca94e8eeb tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:10:21.631537 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-29adc5f4-2dea-4833-8624-578ca94e8eeb tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:10:21.632705 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-29adc5f4-2dea-4833-8624-578ca94e8eeb tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1753 microversion: 2.20 time: 0.148910 Nov 09 20:10:21.633292 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 219/434] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:10:21 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1753 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:10:22.651211 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-1225b342-d7bc-47e8-b16e-5741ec1094a0 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:10:22.651818 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-1225b342-d7bc-47e8-b16e-5741ec1094a0 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:10:22.658009 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-1225b342-d7bc-47e8-b16e-5741ec1094a0 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:10:22.658483 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-1225b342-d7bc-47e8-b16e-5741ec1094a0 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:10:22.659250 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-1225b342-d7bc-47e8-b16e-5741ec1094a0 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:10:22.659677 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-1225b342-d7bc-47e8-b16e-5741ec1094a0 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:10:22.786519 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-1225b342-d7bc-47e8-b16e-5741ec1094a0 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:10:22.794584 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-1225b342-d7bc-47e8-b16e-5741ec1094a0 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:10:22.796083 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-1225b342-d7bc-47e8-b16e-5741ec1094a0 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:10:22.797245 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-1225b342-d7bc-47e8-b16e-5741ec1094a0 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1753 microversion: 2.20 time: 0.149734 Nov 09 20:10:22.797807 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 216/435] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:10:22 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1753 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:10:23.815180 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-79ef7f55-778b-4566-9e95-0c37516e15ba tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:10:23.815770 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-79ef7f55-778b-4566-9e95-0c37516e15ba tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:10:23.821655 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-79ef7f55-778b-4566-9e95-0c37516e15ba tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:10:23.822093 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-79ef7f55-778b-4566-9e95-0c37516e15ba tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:10:23.822844 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-79ef7f55-778b-4566-9e95-0c37516e15ba tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:10:23.823264 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-79ef7f55-778b-4566-9e95-0c37516e15ba tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:10:23.954109 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-79ef7f55-778b-4566-9e95-0c37516e15ba tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:10:23.962400 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-79ef7f55-778b-4566-9e95-0c37516e15ba tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:10:23.963885 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-79ef7f55-778b-4566-9e95-0c37516e15ba tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:10:23.965051 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-79ef7f55-778b-4566-9e95-0c37516e15ba tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1753 microversion: 2.20 time: 0.153557 Nov 09 20:10:23.965611 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 220/436] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:10:23 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1753 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:10:24.983626 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-a0aac864-db91-4ac8-91d2-42959c1cca8e tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:10:24.984222 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-a0aac864-db91-4ac8-91d2-42959c1cca8e tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:10:24.991350 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a0aac864-db91-4ac8-91d2-42959c1cca8e tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:10:24.991795 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a0aac864-db91-4ac8-91d2-42959c1cca8e tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:10:24.992604 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a0aac864-db91-4ac8-91d2-42959c1cca8e tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:10:24.993035 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a0aac864-db91-4ac8-91d2-42959c1cca8e tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:10:25.119707 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-a0aac864-db91-4ac8-91d2-42959c1cca8e tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:10:25.127966 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-a0aac864-db91-4ac8-91d2-42959c1cca8e tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:10:25.129874 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-a0aac864-db91-4ac8-91d2-42959c1cca8e tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:10:25.131100 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-a0aac864-db91-4ac8-91d2-42959c1cca8e tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1753 microversion: 2.20 time: 0.151163 Nov 09 20:10:25.131660 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 217/437] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:10:24 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1753 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:10:26.149890 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-ce477ae8-5c8e-47da-be12-1a0738bf2ed3 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:10:26.150446 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-ce477ae8-5c8e-47da-be12-1a0738bf2ed3 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:10:26.156276 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ce477ae8-5c8e-47da-be12-1a0738bf2ed3 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:10:26.156746 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ce477ae8-5c8e-47da-be12-1a0738bf2ed3 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:10:26.157512 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ce477ae8-5c8e-47da-be12-1a0738bf2ed3 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:10:26.157991 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ce477ae8-5c8e-47da-be12-1a0738bf2ed3 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:10:26.512790 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-ce477ae8-5c8e-47da-be12-1a0738bf2ed3 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:10:26.521414 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-ce477ae8-5c8e-47da-be12-1a0738bf2ed3 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:10:26.522915 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-ce477ae8-5c8e-47da-be12-1a0738bf2ed3 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:10:26.524170 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-ce477ae8-5c8e-47da-be12-1a0738bf2ed3 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1753 microversion: 2.20 time: 0.378231 Nov 09 20:10:26.532103 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 221/438] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:10:26 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1753 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:10:27.578496 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-586b6b35-85b8-426d-ab17-0e26830f478f tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:10:27.579113 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-586b6b35-85b8-426d-ab17-0e26830f478f tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:10:27.585467 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-586b6b35-85b8-426d-ab17-0e26830f478f tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:10:27.585978 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-586b6b35-85b8-426d-ab17-0e26830f478f tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:10:27.586749 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-586b6b35-85b8-426d-ab17-0e26830f478f tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:10:27.587175 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-586b6b35-85b8-426d-ab17-0e26830f478f tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:10:27.715580 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-586b6b35-85b8-426d-ab17-0e26830f478f tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:10:27.723717 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-586b6b35-85b8-426d-ab17-0e26830f478f tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:10:27.725241 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-586b6b35-85b8-426d-ab17-0e26830f478f tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:10:27.726386 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-586b6b35-85b8-426d-ab17-0e26830f478f tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1753 microversion: 2.20 time: 0.151604 Nov 09 20:10:27.726937 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 218/439] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:10:27 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1753 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:10:28.744826 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-4473241d-60b5-4a97-ae69-3623d1d63206 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:10:28.745423 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-4473241d-60b5-4a97-ae69-3623d1d63206 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:10:28.751645 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4473241d-60b5-4a97-ae69-3623d1d63206 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:10:28.752089 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4473241d-60b5-4a97-ae69-3623d1d63206 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:10:28.752894 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4473241d-60b5-4a97-ae69-3623d1d63206 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:10:28.753324 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4473241d-60b5-4a97-ae69-3623d1d63206 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:10:28.883237 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-4473241d-60b5-4a97-ae69-3623d1d63206 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:10:28.891288 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-4473241d-60b5-4a97-ae69-3623d1d63206 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:10:28.892807 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-4473241d-60b5-4a97-ae69-3623d1d63206 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:10:28.893944 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-4473241d-60b5-4a97-ae69-3623d1d63206 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1753 microversion: 2.20 time: 0.152899 Nov 09 20:10:28.894503 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 222/440] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:10:28 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1753 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:10:29.913659 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-d4c454ab-db8d-481a-ab03-0f3a44d01b47 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:10:29.914193 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-d4c454ab-db8d-481a-ab03-0f3a44d01b47 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:10:29.920334 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d4c454ab-db8d-481a-ab03-0f3a44d01b47 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:10:29.920808 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d4c454ab-db8d-481a-ab03-0f3a44d01b47 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:10:29.921581 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d4c454ab-db8d-481a-ab03-0f3a44d01b47 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:10:29.922007 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d4c454ab-db8d-481a-ab03-0f3a44d01b47 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:10:30.049929 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-d4c454ab-db8d-481a-ab03-0f3a44d01b47 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:10:30.059255 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-d4c454ab-db8d-481a-ab03-0f3a44d01b47 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:10:30.060813 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-d4c454ab-db8d-481a-ab03-0f3a44d01b47 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:10:30.061946 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-d4c454ab-db8d-481a-ab03-0f3a44d01b47 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1753 microversion: 2.20 time: 0.153179 Nov 09 20:10:30.062620 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 219/441] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:10:29 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1753 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:10:31.079917 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-88c1cc1e-0e17-4797-a4ea-3198c6608711 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:10:31.081009 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-88c1cc1e-0e17-4797-a4ea-3198c6608711 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:10:31.087715 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-88c1cc1e-0e17-4797-a4ea-3198c6608711 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:10:31.088162 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-88c1cc1e-0e17-4797-a4ea-3198c6608711 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:10:31.088966 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-88c1cc1e-0e17-4797-a4ea-3198c6608711 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:10:31.089397 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-88c1cc1e-0e17-4797-a4ea-3198c6608711 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:10:31.216317 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-88c1cc1e-0e17-4797-a4ea-3198c6608711 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:10:31.224454 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-88c1cc1e-0e17-4797-a4ea-3198c6608711 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:10:31.225931 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-88c1cc1e-0e17-4797-a4ea-3198c6608711 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:10:31.227060 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-88c1cc1e-0e17-4797-a4ea-3198c6608711 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1753 microversion: 2.20 time: 0.150689 Nov 09 20:10:31.227861 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 223/442] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:10:31 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1753 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:10:32.245228 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-b53254a1-d4c3-486d-8293-8b9665bf2f58 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:10:32.245816 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-b53254a1-d4c3-486d-8293-8b9665bf2f58 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:10:32.251944 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b53254a1-d4c3-486d-8293-8b9665bf2f58 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:10:32.252384 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b53254a1-d4c3-486d-8293-8b9665bf2f58 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:10:32.253167 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b53254a1-d4c3-486d-8293-8b9665bf2f58 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:10:32.253593 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b53254a1-d4c3-486d-8293-8b9665bf2f58 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:10:32.384716 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-b53254a1-d4c3-486d-8293-8b9665bf2f58 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:10:32.392708 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-b53254a1-d4c3-486d-8293-8b9665bf2f58 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:10:32.394185 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-b53254a1-d4c3-486d-8293-8b9665bf2f58 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:10:32.395492 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-b53254a1-d4c3-486d-8293-8b9665bf2f58 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1753 microversion: 2.20 time: 0.153905 Nov 09 20:10:32.396050 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 220/443] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:10:32 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1753 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:10:33.413411 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-f5839218-959e-4cc1-9e4c-e0c61ac4f6a3 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:10:33.414011 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-f5839218-959e-4cc1-9e4c-e0c61ac4f6a3 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:10:33.420195 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f5839218-959e-4cc1-9e4c-e0c61ac4f6a3 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:10:33.420786 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f5839218-959e-4cc1-9e4c-e0c61ac4f6a3 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:10:33.421550 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f5839218-959e-4cc1-9e4c-e0c61ac4f6a3 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:10:33.421981 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f5839218-959e-4cc1-9e4c-e0c61ac4f6a3 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:10:33.550229 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-f5839218-959e-4cc1-9e4c-e0c61ac4f6a3 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:10:33.558996 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-f5839218-959e-4cc1-9e4c-e0c61ac4f6a3 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:10:33.560516 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-f5839218-959e-4cc1-9e4c-e0c61ac4f6a3 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:10:33.561658 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-f5839218-959e-4cc1-9e4c-e0c61ac4f6a3 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1753 microversion: 2.20 time: 0.151960 Nov 09 20:10:33.562208 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 224/444] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:10:33 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1753 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:10:34.579765 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-52e4fde9-8be6-4fac-90ed-e90bc8c2b0c5 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:10:34.580427 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-52e4fde9-8be6-4fac-90ed-e90bc8c2b0c5 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:10:34.587912 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-52e4fde9-8be6-4fac-90ed-e90bc8c2b0c5 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:10:34.588356 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-52e4fde9-8be6-4fac-90ed-e90bc8c2b0c5 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:10:34.589155 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-52e4fde9-8be6-4fac-90ed-e90bc8c2b0c5 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:10:34.589585 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-52e4fde9-8be6-4fac-90ed-e90bc8c2b0c5 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:10:34.718645 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-52e4fde9-8be6-4fac-90ed-e90bc8c2b0c5 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:10:34.726619 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-52e4fde9-8be6-4fac-90ed-e90bc8c2b0c5 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:10:34.728476 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-52e4fde9-8be6-4fac-90ed-e90bc8c2b0c5 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:10:34.729608 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-52e4fde9-8be6-4fac-90ed-e90bc8c2b0c5 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1753 microversion: 2.20 time: 0.153492 Nov 09 20:10:34.730161 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 221/445] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:10:34 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1753 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:10:35.746886 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-d4cf83e3-719b-446b-9f7c-5c42c251b904 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:10:35.747409 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-d4cf83e3-719b-446b-9f7c-5c42c251b904 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:10:35.753563 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d4cf83e3-719b-446b-9f7c-5c42c251b904 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:10:35.754620 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d4cf83e3-719b-446b-9f7c-5c42c251b904 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:10:35.755391 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d4cf83e3-719b-446b-9f7c-5c42c251b904 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:10:35.755824 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d4cf83e3-719b-446b-9f7c-5c42c251b904 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:10:35.882793 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-d4cf83e3-719b-446b-9f7c-5c42c251b904 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:10:35.891065 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-d4cf83e3-719b-446b-9f7c-5c42c251b904 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:10:35.892609 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-d4cf83e3-719b-446b-9f7c-5c42c251b904 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:10:35.893747 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-d4cf83e3-719b-446b-9f7c-5c42c251b904 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1753 microversion: 2.20 time: 0.150662 Nov 09 20:10:35.894313 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 225/446] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:10:35 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1753 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:10:36.913193 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-18a53556-a576-4b81-b596-32ab09d69020 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:10:36.913797 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-18a53556-a576-4b81-b596-32ab09d69020 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:10:36.920154 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-18a53556-a576-4b81-b596-32ab09d69020 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:10:36.920637 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-18a53556-a576-4b81-b596-32ab09d69020 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:10:36.921402 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-18a53556-a576-4b81-b596-32ab09d69020 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:10:36.921832 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-18a53556-a576-4b81-b596-32ab09d69020 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:10:37.049266 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-18a53556-a576-4b81-b596-32ab09d69020 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:10:37.057311 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-18a53556-a576-4b81-b596-32ab09d69020 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:10:37.058793 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-18a53556-a576-4b81-b596-32ab09d69020 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:10:37.059925 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-18a53556-a576-4b81-b596-32ab09d69020 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1753 microversion: 2.20 time: 0.151088 Nov 09 20:10:37.060492 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 222/447] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:10:36 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1753 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:10:38.078543 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-e7cc8ccd-dbf9-425f-ae79-3f2c352190cc tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:10:38.079232 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-e7cc8ccd-dbf9-425f-ae79-3f2c352190cc tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:10:38.086276 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e7cc8ccd-dbf9-425f-ae79-3f2c352190cc tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:10:38.086723 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e7cc8ccd-dbf9-425f-ae79-3f2c352190cc tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:10:38.087495 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e7cc8ccd-dbf9-425f-ae79-3f2c352190cc tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:10:38.087930 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e7cc8ccd-dbf9-425f-ae79-3f2c352190cc tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:10:38.215982 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-e7cc8ccd-dbf9-425f-ae79-3f2c352190cc tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:10:38.224922 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-e7cc8ccd-dbf9-425f-ae79-3f2c352190cc tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:10:38.226423 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-e7cc8ccd-dbf9-425f-ae79-3f2c352190cc tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:10:38.227578 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-e7cc8ccd-dbf9-425f-ae79-3f2c352190cc tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1753 microversion: 2.20 time: 0.152695 Nov 09 20:10:38.228414 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 226/448] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:10:38 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1753 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:10:39.245689 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-fa741c50-59cd-43ee-ac07-72a90503035a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:10:39.246292 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-fa741c50-59cd-43ee-ac07-72a90503035a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:10:39.252539 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-fa741c50-59cd-43ee-ac07-72a90503035a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:10:39.252998 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-fa741c50-59cd-43ee-ac07-72a90503035a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:10:39.253767 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-fa741c50-59cd-43ee-ac07-72a90503035a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:10:39.254206 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-fa741c50-59cd-43ee-ac07-72a90503035a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:10:39.381336 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-fa741c50-59cd-43ee-ac07-72a90503035a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:10:39.389303 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-fa741c50-59cd-43ee-ac07-72a90503035a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:10:39.390774 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-fa741c50-59cd-43ee-ac07-72a90503035a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:10:39.391900 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-fa741c50-59cd-43ee-ac07-72a90503035a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1753 microversion: 2.20 time: 0.149895 Nov 09 20:10:39.392477 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 223/449] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:10:39 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1753 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:10:39.843408 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-10b4c198-e368-423e-a8af-2795fa8d608e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:10:39.843934 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-10b4c198-e368-423e-a8af-2795fa8d608e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:10:39.850090 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-10b4c198-e368-423e-a8af-2795fa8d608e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:10:39.850528 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-10b4c198-e368-423e-a8af-2795fa8d608e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:10:39.851284 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-10b4c198-e368-423e-a8af-2795fa8d608e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:10:39.851711 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-10b4c198-e368-423e-a8af-2795fa8d608e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:10:39.969424 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.objects.instance [None req-10b4c198-e368-423e-a8af-2795fa8d608e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lazy-loading 'services' on Instance uuid 632b79c1-d378-423c-8404-3204223226a6 {{(pid=116103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 09 20:10:40.080613 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-10b4c198-e368-423e-a8af-2795fa8d608e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "DELETE /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments/398131fd-877b-46b8-aaf1-a4b1796b761d" status: 202 len: 0 microversion: 2.1 time: 0.240726 Nov 09 20:10:40.081371 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 227/450] 10.222.0.25 () {58 vars in 1415 bytes} [Tue Nov 9 20:10:39 2021] DELETE /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments/398131fd-877b-46b8-aaf1-a4b1796b761d => generated 0 bytes in 242 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 09 20:10:40.409813 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-90e8a3f5-f31a-4236-9061-8842df41f5c2 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:10:40.410638 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-90e8a3f5-f31a-4236-9061-8842df41f5c2 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:10:40.416777 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-90e8a3f5-f31a-4236-9061-8842df41f5c2 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:10:40.417218 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-90e8a3f5-f31a-4236-9061-8842df41f5c2 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:10:40.417980 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-90e8a3f5-f31a-4236-9061-8842df41f5c2 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:10:40.418403 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-90e8a3f5-f31a-4236-9061-8842df41f5c2 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:10:40.547807 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-90e8a3f5-f31a-4236-9061-8842df41f5c2 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:10:40.556572 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-90e8a3f5-f31a-4236-9061-8842df41f5c2 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:10:40.558058 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-90e8a3f5-f31a-4236-9061-8842df41f5c2 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:10:40.559216 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-90e8a3f5-f31a-4236-9061-8842df41f5c2 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1753 microversion: 2.20 time: 0.153111 Nov 09 20:10:40.559761 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 224/451] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:10:40 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1753 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:10:41.578405 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-9b827f19-b03d-40d2-a102-6dc15545b2fa tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:10:41.579126 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-9b827f19-b03d-40d2-a102-6dc15545b2fa tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:10:41.586320 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9b827f19-b03d-40d2-a102-6dc15545b2fa tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:10:41.586774 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9b827f19-b03d-40d2-a102-6dc15545b2fa tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:10:41.587551 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9b827f19-b03d-40d2-a102-6dc15545b2fa tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:10:41.587990 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9b827f19-b03d-40d2-a102-6dc15545b2fa tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:10:41.725803 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-9b827f19-b03d-40d2-a102-6dc15545b2fa tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:10:41.734096 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-9b827f19-b03d-40d2-a102-6dc15545b2fa tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:10:41.735595 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-9b827f19-b03d-40d2-a102-6dc15545b2fa tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:10:41.736807 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-9b827f19-b03d-40d2-a102-6dc15545b2fa tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1753 microversion: 2.20 time: 0.162413 Nov 09 20:10:41.737368 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 228/452] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:10:41 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1753 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:10:42.755605 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-8fdff75b-0797-477f-b146-41caa4136948 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:10:42.756196 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-8fdff75b-0797-477f-b146-41caa4136948 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:10:42.762794 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-8fdff75b-0797-477f-b146-41caa4136948 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:10:42.763239 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-8fdff75b-0797-477f-b146-41caa4136948 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:10:42.764020 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-8fdff75b-0797-477f-b146-41caa4136948 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:10:42.764668 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-8fdff75b-0797-477f-b146-41caa4136948 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:10:42.920975 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-8fdff75b-0797-477f-b146-41caa4136948 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:10:42.929490 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-8fdff75b-0797-477f-b146-41caa4136948 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:10:42.930977 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-8fdff75b-0797-477f-b146-41caa4136948 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:10:42.932188 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-8fdff75b-0797-477f-b146-41caa4136948 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1753 microversion: 2.20 time: 0.180670 Nov 09 20:10:42.932783 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 225/453] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:10:42 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1753 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:10:43.951394 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-7120d019-c4d1-457c-9695-676b8c7310a0 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:10:43.952021 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-7120d019-c4d1-457c-9695-676b8c7310a0 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:10:43.958805 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7120d019-c4d1-457c-9695-676b8c7310a0 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:10:43.959243 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7120d019-c4d1-457c-9695-676b8c7310a0 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:10:43.960015 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7120d019-c4d1-457c-9695-676b8c7310a0 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:10:43.960466 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7120d019-c4d1-457c-9695-676b8c7310a0 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:10:44.101791 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-7120d019-c4d1-457c-9695-676b8c7310a0 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:10:44.111329 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-7120d019-c4d1-457c-9695-676b8c7310a0 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:10:44.112924 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-7120d019-c4d1-457c-9695-676b8c7310a0 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:10:44.114898 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-7120d019-c4d1-457c-9695-676b8c7310a0 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1753 microversion: 2.20 time: 0.167267 Nov 09 20:10:44.115640 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 229/454] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:10:43 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1753 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 09 20:10:45.133911 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-505a42bf-0f3b-457e-9f00-aff340018ce5 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:10:45.134515 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-505a42bf-0f3b-457e-9f00-aff340018ce5 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:10:45.140643 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-505a42bf-0f3b-457e-9f00-aff340018ce5 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:10:45.141091 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-505a42bf-0f3b-457e-9f00-aff340018ce5 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:10:45.141864 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-505a42bf-0f3b-457e-9f00-aff340018ce5 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:10:45.142342 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-505a42bf-0f3b-457e-9f00-aff340018ce5 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:10:45.273551 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-505a42bf-0f3b-457e-9f00-aff340018ce5 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:10:45.282338 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-505a42bf-0f3b-457e-9f00-aff340018ce5 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:10:45.284075 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-505a42bf-0f3b-457e-9f00-aff340018ce5 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:10:45.285858 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-505a42bf-0f3b-457e-9f00-aff340018ce5 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1753 microversion: 2.20 time: 0.155117 Nov 09 20:10:45.286057 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 226/455] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:10:45 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1753 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:10:46.302866 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-5f802dea-1a0f-4450-8826-d1167433d402 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:10:46.303464 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-5f802dea-1a0f-4450-8826-d1167433d402 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:10:46.309633 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5f802dea-1a0f-4450-8826-d1167433d402 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:10:46.310077 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5f802dea-1a0f-4450-8826-d1167433d402 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:10:46.310845 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5f802dea-1a0f-4450-8826-d1167433d402 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:10:46.311272 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5f802dea-1a0f-4450-8826-d1167433d402 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:10:46.446586 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-5f802dea-1a0f-4450-8826-d1167433d402 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:10:46.455375 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-5f802dea-1a0f-4450-8826-d1167433d402 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:10:46.457403 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-5f802dea-1a0f-4450-8826-d1167433d402 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:10:46.458654 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-5f802dea-1a0f-4450-8826-d1167433d402 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1753 microversion: 2.20 time: 0.159455 Nov 09 20:10:46.459563 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 230/456] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:10:46 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1753 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:10:47.477418 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-a27052df-f5d1-4f1d-9e34-05ee63740783 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:10:47.478436 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-a27052df-f5d1-4f1d-9e34-05ee63740783 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:10:47.484619 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a27052df-f5d1-4f1d-9e34-05ee63740783 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:10:47.485067 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a27052df-f5d1-4f1d-9e34-05ee63740783 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:10:47.485892 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a27052df-f5d1-4f1d-9e34-05ee63740783 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:10:47.486264 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a27052df-f5d1-4f1d-9e34-05ee63740783 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:10:47.616314 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-a27052df-f5d1-4f1d-9e34-05ee63740783 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:10:47.624662 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-a27052df-f5d1-4f1d-9e34-05ee63740783 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:10:47.626164 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-a27052df-f5d1-4f1d-9e34-05ee63740783 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:10:47.627323 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-a27052df-f5d1-4f1d-9e34-05ee63740783 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1753 microversion: 2.20 time: 0.153868 Nov 09 20:10:47.628073 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 227/457] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:10:47 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1753 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:10:48.645829 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-0d62f393-13aa-4245-bcec-398457c01d8b tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:10:48.646445 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-0d62f393-13aa-4245-bcec-398457c01d8b tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:10:48.652537 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0d62f393-13aa-4245-bcec-398457c01d8b tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:10:48.652973 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0d62f393-13aa-4245-bcec-398457c01d8b tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:10:48.653729 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0d62f393-13aa-4245-bcec-398457c01d8b tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:10:48.654153 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0d62f393-13aa-4245-bcec-398457c01d8b tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:10:48.783806 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-0d62f393-13aa-4245-bcec-398457c01d8b tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:10:48.792975 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-0d62f393-13aa-4245-bcec-398457c01d8b tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:10:48.794470 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-0d62f393-13aa-4245-bcec-398457c01d8b tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:10:48.795613 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-0d62f393-13aa-4245-bcec-398457c01d8b tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1753 microversion: 2.20 time: 0.154043 Nov 09 20:10:48.796169 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 231/458] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:10:48 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1753 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:10:49.813753 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-bc1e1ab3-b374-45c7-aabb-d35bdb6d2be7 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:10:49.814331 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-bc1e1ab3-b374-45c7-aabb-d35bdb6d2be7 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:10:49.820589 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-bc1e1ab3-b374-45c7-aabb-d35bdb6d2be7 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:10:49.821032 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-bc1e1ab3-b374-45c7-aabb-d35bdb6d2be7 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:10:49.821799 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-bc1e1ab3-b374-45c7-aabb-d35bdb6d2be7 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:10:49.822228 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-bc1e1ab3-b374-45c7-aabb-d35bdb6d2be7 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:10:49.950751 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-bc1e1ab3-b374-45c7-aabb-d35bdb6d2be7 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:10:49.959506 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-bc1e1ab3-b374-45c7-aabb-d35bdb6d2be7 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:10:49.961013 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-bc1e1ab3-b374-45c7-aabb-d35bdb6d2be7 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:10:49.962147 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-bc1e1ab3-b374-45c7-aabb-d35bdb6d2be7 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1753 microversion: 2.20 time: 0.152164 Nov 09 20:10:49.962691 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 228/459] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:10:49 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1753 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:10:50.980002 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-33c715f6-2b1c-4ebc-a62b-6c3c661dccab tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:10:50.980647 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-33c715f6-2b1c-4ebc-a62b-6c3c661dccab tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:10:50.987037 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-33c715f6-2b1c-4ebc-a62b-6c3c661dccab tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:10:50.987479 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-33c715f6-2b1c-4ebc-a62b-6c3c661dccab tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:10:50.989201 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-33c715f6-2b1c-4ebc-a62b-6c3c661dccab tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:10:50.989632 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-33c715f6-2b1c-4ebc-a62b-6c3c661dccab tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:10:51.118950 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-33c715f6-2b1c-4ebc-a62b-6c3c661dccab tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:10:51.127204 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-33c715f6-2b1c-4ebc-a62b-6c3c661dccab tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:10:51.129345 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-33c715f6-2b1c-4ebc-a62b-6c3c661dccab tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:10:51.130520 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-33c715f6-2b1c-4ebc-a62b-6c3c661dccab tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1753 microversion: 2.20 time: 0.154418 Nov 09 20:10:51.131078 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 232/460] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:10:50 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1753 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:10:52.149226 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-33ea7901-b0e1-48d5-aa87-a99084a6bef0 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:10:52.149810 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-33ea7901-b0e1-48d5-aa87-a99084a6bef0 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:10:52.156183 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-33ea7901-b0e1-48d5-aa87-a99084a6bef0 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:10:52.156731 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-33ea7901-b0e1-48d5-aa87-a99084a6bef0 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:10:52.157498 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-33ea7901-b0e1-48d5-aa87-a99084a6bef0 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:10:52.157921 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-33ea7901-b0e1-48d5-aa87-a99084a6bef0 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:10:52.313391 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-33ea7901-b0e1-48d5-aa87-a99084a6bef0 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:10:52.321716 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-33ea7901-b0e1-48d5-aa87-a99084a6bef0 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:10:52.323191 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-33ea7901-b0e1-48d5-aa87-a99084a6bef0 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:10:52.324311 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-33ea7901-b0e1-48d5-aa87-a99084a6bef0 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1753 microversion: 2.20 time: 0.178832 Nov 09 20:10:52.324914 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 229/461] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:10:52 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1753 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:10:52.838341 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-0e0f0cba-6530-4763-b26b-940051290c42 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:10:52.839439 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-0e0f0cba-6530-4763-b26b-940051290c42 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:10:52.846545 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0e0f0cba-6530-4763-b26b-940051290c42 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:10:52.847076 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0e0f0cba-6530-4763-b26b-940051290c42 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:10:52.848490 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0e0f0cba-6530-4763-b26b-940051290c42 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:10:52.848920 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0e0f0cba-6530-4763-b26b-940051290c42 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:10:52.874898 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.objects.instance [None req-0e0f0cba-6530-4763-b26b-940051290c42 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lazy-loading 'flavor' on Instance uuid 80ce5722-8f51-457b-9f9b-ff4b63b103df {{(pid=116103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 09 20:10:52.990402 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-0e0f0cba-6530-4763-b26b-940051290c42 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "POST /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/action" status: 200 len: 32 microversion: 2.1 time: 0.156003 Nov 09 20:10:52.990936 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 233/462] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Nov 9 20:10:52 2021] POST /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/action => generated 32 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 09 20:10:52.999752 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-187cbb78-1da3-4c1f-b420-eac3e7107e05 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:10:53.000361 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-187cbb78-1da3-4c1f-b420-eac3e7107e05 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:10:53.006330 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-187cbb78-1da3-4c1f-b420-eac3e7107e05 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:10:53.006785 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-187cbb78-1da3-4c1f-b420-eac3e7107e05 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:10:53.007566 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-187cbb78-1da3-4c1f-b420-eac3e7107e05 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:10:53.008006 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-187cbb78-1da3-4c1f-b420-eac3e7107e05 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:10:53.142326 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-187cbb78-1da3-4c1f-b420-eac3e7107e05 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:10:53.151085 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-187cbb78-1da3-4c1f-b420-eac3e7107e05 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1567 microversion: 2.1 time: 0.154915 Nov 09 20:10:53.151979 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 230/463] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:10:52 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 20:10:53.343546 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-d23521fd-c4b5-4dbd-b4cb-317ec23e940a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:10:53.344227 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-d23521fd-c4b5-4dbd-b4cb-317ec23e940a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:10:53.350712 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d23521fd-c4b5-4dbd-b4cb-317ec23e940a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:10:53.351181 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d23521fd-c4b5-4dbd-b4cb-317ec23e940a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:10:53.351977 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d23521fd-c4b5-4dbd-b4cb-317ec23e940a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:10:53.352455 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d23521fd-c4b5-4dbd-b4cb-317ec23e940a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:10:53.484890 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-d23521fd-c4b5-4dbd-b4cb-317ec23e940a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:10:53.493500 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-d23521fd-c4b5-4dbd-b4cb-317ec23e940a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:10:53.494989 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-d23521fd-c4b5-4dbd-b4cb-317ec23e940a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:10:53.496139 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-d23521fd-c4b5-4dbd-b4cb-317ec23e940a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1753 microversion: 2.20 time: 0.156694 Nov 09 20:10:53.496735 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 234/464] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:10:53 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1753 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:10:54.168517 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-ae6b83de-29f9-446d-83ba-d1d232a3ff40 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:10:54.169120 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-ae6b83de-29f9-446d-83ba-d1d232a3ff40 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:10:54.175336 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ae6b83de-29f9-446d-83ba-d1d232a3ff40 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:10:54.176463 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ae6b83de-29f9-446d-83ba-d1d232a3ff40 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:10:54.177242 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ae6b83de-29f9-446d-83ba-d1d232a3ff40 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:10:54.177677 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ae6b83de-29f9-446d-83ba-d1d232a3ff40 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:10:54.305412 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-ae6b83de-29f9-446d-83ba-d1d232a3ff40 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:10:54.313182 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-ae6b83de-29f9-446d-83ba-d1d232a3ff40 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1567 microversion: 2.1 time: 0.148331 Nov 09 20:10:54.313750 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 231/465] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:10:54 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1567 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:10:54.514948 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-583e6581-b304-4342-b7ad-146b506381c3 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:10:54.515542 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-583e6581-b304-4342-b7ad-146b506381c3 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:10:54.522266 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-583e6581-b304-4342-b7ad-146b506381c3 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:10:54.522705 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-583e6581-b304-4342-b7ad-146b506381c3 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:10:54.523467 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-583e6581-b304-4342-b7ad-146b506381c3 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:10:54.523890 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-583e6581-b304-4342-b7ad-146b506381c3 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:10:54.654771 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-583e6581-b304-4342-b7ad-146b506381c3 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:10:54.663772 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-583e6581-b304-4342-b7ad-146b506381c3 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:10:54.665314 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-583e6581-b304-4342-b7ad-146b506381c3 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:10:54.666531 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-583e6581-b304-4342-b7ad-146b506381c3 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1753 microversion: 2.20 time: 0.155225 Nov 09 20:10:54.667084 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 235/466] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:10:54 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1753 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:10:55.330319 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-9d84ef34-80db-431a-9aaf-3db0245d6905 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:10:55.331021 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-9d84ef34-80db-431a-9aaf-3db0245d6905 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:10:55.338770 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-9d84ef34-80db-431a-9aaf-3db0245d6905 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:10:55.339273 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-9d84ef34-80db-431a-9aaf-3db0245d6905 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:10:55.340071 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-9d84ef34-80db-431a-9aaf-3db0245d6905 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:10:55.340539 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-9d84ef34-80db-431a-9aaf-3db0245d6905 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:10:55.482691 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-9d84ef34-80db-431a-9aaf-3db0245d6905 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:10:55.491192 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-9d84ef34-80db-431a-9aaf-3db0245d6905 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1567 microversion: 2.1 time: 0.164606 Nov 09 20:10:55.491760 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 232/467] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:10:55 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1567 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:10:55.685369 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-30f01be9-de9c-4aed-b854-93d56ef657de tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:10:55.685946 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-30f01be9-de9c-4aed-b854-93d56ef657de tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:10:55.692628 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-30f01be9-de9c-4aed-b854-93d56ef657de tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:10:55.693076 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-30f01be9-de9c-4aed-b854-93d56ef657de tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:10:55.693851 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-30f01be9-de9c-4aed-b854-93d56ef657de tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:10:55.694283 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-30f01be9-de9c-4aed-b854-93d56ef657de tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:10:55.823486 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-30f01be9-de9c-4aed-b854-93d56ef657de tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:10:55.831510 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-30f01be9-de9c-4aed-b854-93d56ef657de tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:10:55.833724 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-30f01be9-de9c-4aed-b854-93d56ef657de tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:10:55.834858 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-30f01be9-de9c-4aed-b854-93d56ef657de tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1753 microversion: 2.20 time: 0.153907 Nov 09 20:10:55.835406 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 236/468] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:10:55 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1753 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:10:56.509659 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-0d0cf811-a737-4d72-95ea-b6544cdaff71 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:10:56.510277 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-0d0cf811-a737-4d72-95ea-b6544cdaff71 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:10:56.516711 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-0d0cf811-a737-4d72-95ea-b6544cdaff71 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:10:56.517172 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-0d0cf811-a737-4d72-95ea-b6544cdaff71 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:10:56.517999 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-0d0cf811-a737-4d72-95ea-b6544cdaff71 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:10:56.518437 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-0d0cf811-a737-4d72-95ea-b6544cdaff71 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:10:56.659336 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-0d0cf811-a737-4d72-95ea-b6544cdaff71 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:10:56.667825 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-0d0cf811-a737-4d72-95ea-b6544cdaff71 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1567 microversion: 2.1 time: 0.162603 Nov 09 20:10:56.668394 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 233/469] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:10:56 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1567 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:10:56.853691 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-9d5f7d12-6b18-49cb-ba60-3126663dddd9 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:10:56.854276 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-9d5f7d12-6b18-49cb-ba60-3126663dddd9 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:10:56.860436 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9d5f7d12-6b18-49cb-ba60-3126663dddd9 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:10:56.860825 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9d5f7d12-6b18-49cb-ba60-3126663dddd9 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:10:56.861581 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9d5f7d12-6b18-49cb-ba60-3126663dddd9 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:10:56.862007 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9d5f7d12-6b18-49cb-ba60-3126663dddd9 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:10:56.994339 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-9d5f7d12-6b18-49cb-ba60-3126663dddd9 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:10:57.003410 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-9d5f7d12-6b18-49cb-ba60-3126663dddd9 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:10:57.005214 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-9d5f7d12-6b18-49cb-ba60-3126663dddd9 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:10:57.006342 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-9d5f7d12-6b18-49cb-ba60-3126663dddd9 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1753 microversion: 2.20 time: 0.156624 Nov 09 20:10:57.006896 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 237/470] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:10:56 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1753 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:10:57.684927 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-237665d3-9664-4b3f-8a4b-83cb6472cd6f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:10:57.685526 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-237665d3-9664-4b3f-8a4b-83cb6472cd6f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:10:57.692224 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-237665d3-9664-4b3f-8a4b-83cb6472cd6f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:10:57.692695 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-237665d3-9664-4b3f-8a4b-83cb6472cd6f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:10:57.693459 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-237665d3-9664-4b3f-8a4b-83cb6472cd6f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:10:57.693883 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-237665d3-9664-4b3f-8a4b-83cb6472cd6f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:10:57.822677 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-237665d3-9664-4b3f-8a4b-83cb6472cd6f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:10:57.830315 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-237665d3-9664-4b3f-8a4b-83cb6472cd6f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1567 microversion: 2.1 time: 0.149348 Nov 09 20:10:57.830880 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 234/471] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:10:57 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1567 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:10:58.024179 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-67e4419c-2a37-4510-89e9-8bb8ef811447 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:10:58.024804 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-67e4419c-2a37-4510-89e9-8bb8ef811447 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:10:58.030953 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-67e4419c-2a37-4510-89e9-8bb8ef811447 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:10:58.031387 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-67e4419c-2a37-4510-89e9-8bb8ef811447 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:10:58.032141 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-67e4419c-2a37-4510-89e9-8bb8ef811447 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:10:58.032606 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-67e4419c-2a37-4510-89e9-8bb8ef811447 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:10:58.159386 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-67e4419c-2a37-4510-89e9-8bb8ef811447 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:10:58.168374 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-67e4419c-2a37-4510-89e9-8bb8ef811447 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:10:58.169887 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-67e4419c-2a37-4510-89e9-8bb8ef811447 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:10:58.171024 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-67e4419c-2a37-4510-89e9-8bb8ef811447 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1753 microversion: 2.20 time: 0.150450 Nov 09 20:10:58.171575 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 238/472] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:10:58 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1753 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:10:58.846920 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-92bf916c-56d8-4d3b-a1c9-211c1d0b47a7 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:10:58.848102 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-92bf916c-56d8-4d3b-a1c9-211c1d0b47a7 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:10:58.855088 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-92bf916c-56d8-4d3b-a1c9-211c1d0b47a7 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:10:58.855530 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-92bf916c-56d8-4d3b-a1c9-211c1d0b47a7 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:10:58.856291 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-92bf916c-56d8-4d3b-a1c9-211c1d0b47a7 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:10:58.856741 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-92bf916c-56d8-4d3b-a1c9-211c1d0b47a7 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:10:58.983037 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-92bf916c-56d8-4d3b-a1c9-211c1d0b47a7 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:10:58.991348 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-92bf916c-56d8-4d3b-a1c9-211c1d0b47a7 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1567 microversion: 2.1 time: 0.147970 Nov 09 20:10:58.991908 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 235/473] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:10:58 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1567 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:10:59.189230 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-4c228007-7555-415f-bb03-7a8ae32baa77 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:10:59.189834 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-4c228007-7555-415f-bb03-7a8ae32baa77 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:10:59.196849 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4c228007-7555-415f-bb03-7a8ae32baa77 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:10:59.197291 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4c228007-7555-415f-bb03-7a8ae32baa77 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:10:59.198097 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4c228007-7555-415f-bb03-7a8ae32baa77 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:10:59.198520 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4c228007-7555-415f-bb03-7a8ae32baa77 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:10:59.332995 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-4c228007-7555-415f-bb03-7a8ae32baa77 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:10:59.341099 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-4c228007-7555-415f-bb03-7a8ae32baa77 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:10:59.342653 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-4c228007-7555-415f-bb03-7a8ae32baa77 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:10:59.343797 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-4c228007-7555-415f-bb03-7a8ae32baa77 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1753 microversion: 2.20 time: 0.158245 Nov 09 20:10:59.344354 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 239/474] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:10:59 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1753 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:11:00.008553 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-60e812b0-f13c-4f23-b9f2-9f23d6ca1ce1 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:11:00.009186 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-60e812b0-f13c-4f23-b9f2-9f23d6ca1ce1 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:11:00.015393 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-60e812b0-f13c-4f23-b9f2-9f23d6ca1ce1 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:00.015833 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-60e812b0-f13c-4f23-b9f2-9f23d6ca1ce1 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:00.016633 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-60e812b0-f13c-4f23-b9f2-9f23d6ca1ce1 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:00.017057 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-60e812b0-f13c-4f23-b9f2-9f23d6ca1ce1 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:00.147684 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-60e812b0-f13c-4f23-b9f2-9f23d6ca1ce1 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:11:00.155424 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-60e812b0-f13c-4f23-b9f2-9f23d6ca1ce1 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1567 microversion: 2.1 time: 0.150511 Nov 09 20:11:00.155979 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 236/475] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:11:00 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:11:00.362484 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-8cb5b4bd-81fb-4eb5-9730-d50bc842d024 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:11:00.363235 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-8cb5b4bd-81fb-4eb5-9730-d50bc842d024 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:11:00.369636 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8cb5b4bd-81fb-4eb5-9730-d50bc842d024 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:00.370079 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8cb5b4bd-81fb-4eb5-9730-d50bc842d024 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:00.370849 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8cb5b4bd-81fb-4eb5-9730-d50bc842d024 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:00.371273 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8cb5b4bd-81fb-4eb5-9730-d50bc842d024 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:00.502525 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-8cb5b4bd-81fb-4eb5-9730-d50bc842d024 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:11:00.511571 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-8cb5b4bd-81fb-4eb5-9730-d50bc842d024 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:11:00.513116 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-8cb5b4bd-81fb-4eb5-9730-d50bc842d024 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:11:00.514253 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-8cb5b4bd-81fb-4eb5-9730-d50bc842d024 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1753 microversion: 2.20 time: 0.155430 Nov 09 20:11:00.514807 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 240/476] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:11:00 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1753 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:11:01.172838 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-0a8481d9-a6dc-42ae-89b9-c8ddf34315c2 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:11:01.173526 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-0a8481d9-a6dc-42ae-89b9-c8ddf34315c2 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:11:01.179784 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-0a8481d9-a6dc-42ae-89b9-c8ddf34315c2 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:01.180238 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-0a8481d9-a6dc-42ae-89b9-c8ddf34315c2 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:01.181053 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-0a8481d9-a6dc-42ae-89b9-c8ddf34315c2 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:01.181484 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-0a8481d9-a6dc-42ae-89b9-c8ddf34315c2 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:01.313417 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-0a8481d9-a6dc-42ae-89b9-c8ddf34315c2 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:11:01.321256 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-0a8481d9-a6dc-42ae-89b9-c8ddf34315c2 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1567 microversion: 2.1 time: 0.152253 Nov 09 20:11:01.321820 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 237/477] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:11:01 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:11:01.531925 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-5a4cf4fc-7895-4033-87d9-4392b32f9fdb tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:11:01.532559 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-5a4cf4fc-7895-4033-87d9-4392b32f9fdb tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:11:01.539392 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5a4cf4fc-7895-4033-87d9-4392b32f9fdb tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:01.539843 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5a4cf4fc-7895-4033-87d9-4392b32f9fdb tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:01.540644 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5a4cf4fc-7895-4033-87d9-4392b32f9fdb tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:01.541083 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5a4cf4fc-7895-4033-87d9-4392b32f9fdb tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:01.674702 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-5a4cf4fc-7895-4033-87d9-4392b32f9fdb tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:11:01.683470 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-5a4cf4fc-7895-4033-87d9-4392b32f9fdb tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:11:01.685000 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-5a4cf4fc-7895-4033-87d9-4392b32f9fdb tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:11:01.686161 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-5a4cf4fc-7895-4033-87d9-4392b32f9fdb tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1753 microversion: 2.20 time: 0.157822 Nov 09 20:11:01.686725 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 241/478] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:11:01 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1753 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:11:02.338079 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-5ef696cb-555a-4985-aafb-c7b4593c999b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:11:02.338687 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-5ef696cb-555a-4985-aafb-c7b4593c999b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:11:02.344918 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-5ef696cb-555a-4985-aafb-c7b4593c999b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:02.345371 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-5ef696cb-555a-4985-aafb-c7b4593c999b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:02.346146 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-5ef696cb-555a-4985-aafb-c7b4593c999b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:02.346583 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-5ef696cb-555a-4985-aafb-c7b4593c999b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:02.475197 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-5ef696cb-555a-4985-aafb-c7b4593c999b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:11:02.483228 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-5ef696cb-555a-4985-aafb-c7b4593c999b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1567 microversion: 2.1 time: 0.148836 Nov 09 20:11:02.483797 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 238/479] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:11:02 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1567 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:11:02.704932 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-bbaabe55-2b7e-4b3a-825f-90b570755c9f tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:11:02.705533 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-bbaabe55-2b7e-4b3a-825f-90b570755c9f tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:11:02.712850 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bbaabe55-2b7e-4b3a-825f-90b570755c9f tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:02.713292 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bbaabe55-2b7e-4b3a-825f-90b570755c9f tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:02.714051 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bbaabe55-2b7e-4b3a-825f-90b570755c9f tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:02.714482 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bbaabe55-2b7e-4b3a-825f-90b570755c9f tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:02.840749 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-bbaabe55-2b7e-4b3a-825f-90b570755c9f tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:11:02.849852 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-bbaabe55-2b7e-4b3a-825f-90b570755c9f tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:11:02.851339 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-bbaabe55-2b7e-4b3a-825f-90b570755c9f tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:11:02.852507 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-bbaabe55-2b7e-4b3a-825f-90b570755c9f tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1753 microversion: 2.20 time: 0.151254 Nov 09 20:11:02.853314 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 242/480] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:11:02 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1753 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:11:03.500719 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-c5a7a923-9aaf-4e8b-857d-7b030707711e tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:11:03.501315 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-c5a7a923-9aaf-4e8b-857d-7b030707711e tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:11:03.507849 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c5a7a923-9aaf-4e8b-857d-7b030707711e tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:03.508273 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c5a7a923-9aaf-4e8b-857d-7b030707711e tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:03.509058 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c5a7a923-9aaf-4e8b-857d-7b030707711e tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:03.509488 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c5a7a923-9aaf-4e8b-857d-7b030707711e tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:03.640563 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-c5a7a923-9aaf-4e8b-857d-7b030707711e tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:11:03.648514 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-c5a7a923-9aaf-4e8b-857d-7b030707711e tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1567 microversion: 2.1 time: 0.151358 Nov 09 20:11:03.649074 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 239/481] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:11:03 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:11:03.870753 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-0e844df6-f634-4799-9cf5-f1c64f52f06f tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:11:03.871389 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-0e844df6-f634-4799-9cf5-f1c64f52f06f tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:11:03.877635 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0e844df6-f634-4799-9cf5-f1c64f52f06f tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:03.878061 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0e844df6-f634-4799-9cf5-f1c64f52f06f tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:03.879107 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0e844df6-f634-4799-9cf5-f1c64f52f06f tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:03.879621 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0e844df6-f634-4799-9cf5-f1c64f52f06f tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:04.007329 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-0e844df6-f634-4799-9cf5-f1c64f52f06f tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:11:04.015339 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-0e844df6-f634-4799-9cf5-f1c64f52f06f tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:11:04.016860 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-0e844df6-f634-4799-9cf5-f1c64f52f06f tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:11:04.018004 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-0e844df6-f634-4799-9cf5-f1c64f52f06f tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1753 microversion: 2.20 time: 0.150872 Nov 09 20:11:04.018560 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 243/482] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:11:03 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1753 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:11:04.665087 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-8f3e2b27-472b-4b7b-a47f-dd2013637c9b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:11:04.665678 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-8f3e2b27-472b-4b7b-a47f-dd2013637c9b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:11:04.671796 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-8f3e2b27-472b-4b7b-a47f-dd2013637c9b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:04.672251 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-8f3e2b27-472b-4b7b-a47f-dd2013637c9b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:04.673024 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-8f3e2b27-472b-4b7b-a47f-dd2013637c9b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:04.673454 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-8f3e2b27-472b-4b7b-a47f-dd2013637c9b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:04.810426 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-8f3e2b27-472b-4b7b-a47f-dd2013637c9b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:11:04.819133 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-8f3e2b27-472b-4b7b-a47f-dd2013637c9b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1567 microversion: 2.1 time: 0.157612 Nov 09 20:11:04.819706 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 240/483] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:11:04 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:11:05.035737 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-bcf9f5c2-4334-4b1e-9180-cf5785d24ddf tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:11:05.036337 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-bcf9f5c2-4334-4b1e-9180-cf5785d24ddf tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:11:05.042560 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bcf9f5c2-4334-4b1e-9180-cf5785d24ddf tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:05.043009 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bcf9f5c2-4334-4b1e-9180-cf5785d24ddf tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:05.043779 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bcf9f5c2-4334-4b1e-9180-cf5785d24ddf tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:05.044211 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bcf9f5c2-4334-4b1e-9180-cf5785d24ddf tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:05.170893 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-bcf9f5c2-4334-4b1e-9180-cf5785d24ddf tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:11:05.179348 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-bcf9f5c2-4334-4b1e-9180-cf5785d24ddf tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:11:05.180846 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-bcf9f5c2-4334-4b1e-9180-cf5785d24ddf tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:11:05.181963 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-bcf9f5c2-4334-4b1e-9180-cf5785d24ddf tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1753 microversion: 2.20 time: 0.150123 Nov 09 20:11:05.182525 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 244/484] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:11:05 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1753 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:11:05.836356 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-404587fd-64cf-4de2-9f8e-709df097e6d9 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:11:05.836994 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-404587fd-64cf-4de2-9f8e-709df097e6d9 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:11:05.843191 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-404587fd-64cf-4de2-9f8e-709df097e6d9 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:05.843635 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-404587fd-64cf-4de2-9f8e-709df097e6d9 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:05.844439 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-404587fd-64cf-4de2-9f8e-709df097e6d9 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:05.853630 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-404587fd-64cf-4de2-9f8e-709df097e6d9 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:05.973600 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-404587fd-64cf-4de2-9f8e-709df097e6d9 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:11:05.981813 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-404587fd-64cf-4de2-9f8e-709df097e6d9 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1567 microversion: 2.1 time: 0.148998 Nov 09 20:11:05.982407 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 241/485] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:11:05 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1567 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:11:06.201226 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-6c9e776b-6df6-40ca-9545-0a8f86f6acb8 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:11:06.201746 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-6c9e776b-6df6-40ca-9545-0a8f86f6acb8 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:11:06.209265 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6c9e776b-6df6-40ca-9545-0a8f86f6acb8 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:06.209704 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6c9e776b-6df6-40ca-9545-0a8f86f6acb8 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:06.210468 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6c9e776b-6df6-40ca-9545-0a8f86f6acb8 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:06.210919 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6c9e776b-6df6-40ca-9545-0a8f86f6acb8 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:06.344706 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-6c9e776b-6df6-40ca-9545-0a8f86f6acb8 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:11:06.352921 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-6c9e776b-6df6-40ca-9545-0a8f86f6acb8 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:11:06.354640 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-6c9e776b-6df6-40ca-9545-0a8f86f6acb8 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:11:06.355765 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-6c9e776b-6df6-40ca-9545-0a8f86f6acb8 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1753 microversion: 2.20 time: 0.159006 Nov 09 20:11:06.356318 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 245/486] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:11:06 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1753 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:11:06.999764 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-4007ec6e-0fa7-4b25-ab12-4820c85901af tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:11:07.000366 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-4007ec6e-0fa7-4b25-ab12-4820c85901af tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:11:07.007466 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-4007ec6e-0fa7-4b25-ab12-4820c85901af tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:07.007913 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-4007ec6e-0fa7-4b25-ab12-4820c85901af tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:07.008721 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-4007ec6e-0fa7-4b25-ab12-4820c85901af tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:07.009154 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-4007ec6e-0fa7-4b25-ab12-4820c85901af tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:07.135078 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-4007ec6e-0fa7-4b25-ab12-4820c85901af tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:11:07.142918 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-4007ec6e-0fa7-4b25-ab12-4820c85901af tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1547 microversion: 2.1 time: 0.147192 Nov 09 20:11:07.143518 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 242/487] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:11:06 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1547 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:11:07.159507 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-22557fdf-27c0-420d-9bb6-2c402d0b3a33 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:11:07.160130 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-22557fdf-27c0-420d-9bb6-2c402d0b3a33 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:11:07.165772 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-22557fdf-27c0-420d-9bb6-2c402d0b3a33 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:07.166266 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-22557fdf-27c0-420d-9bb6-2c402d0b3a33 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:07.167041 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-22557fdf-27c0-420d-9bb6-2c402d0b3a33 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:07.167464 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-22557fdf-27c0-420d-9bb6-2c402d0b3a33 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:07.243051 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.wsgi [None req-22557fdf-27c0-420d-9bb6-2c402d0b3a33 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] HTTP exception thrown: Cannot 'detach_volume' instance 80ce5722-8f51-457b-9f9b-ff4b63b103df while it is in vm_state rescued Nov 09 20:11:07.243647 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-22557fdf-27c0-420d-9bb6-2c402d0b3a33 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Returning 409 to user: Cannot 'detach_volume' instance 80ce5722-8f51-457b-9f9b-ff4b63b103df while it is in vm_state rescued {{(pid=116103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 09 20:11:07.244501 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-22557fdf-27c0-420d-9bb6-2c402d0b3a33 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "DELETE /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments/b4067724-e196-4d20-a86b-ca56ba60cf02" status: 409 len: 152 microversion: 2.1 time: 0.088735 Nov 09 20:11:07.245047 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 246/488] 10.222.0.25 () {58 vars in 1415 bytes} [Tue Nov 9 20:11:07 2021] DELETE /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments/b4067724-e196-4d20-a86b-ca56ba60cf02 => generated 152 bytes in 90 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 09 20:11:07.253224 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-5be4478a-2f59-42c6-b80f-e31d49ac69c1 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:11:07.253820 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-5be4478a-2f59-42c6-b80f-e31d49ac69c1 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:11:07.259917 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-5be4478a-2f59-42c6-b80f-e31d49ac69c1 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:07.260362 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-5be4478a-2f59-42c6-b80f-e31d49ac69c1 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:07.261171 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-5be4478a-2f59-42c6-b80f-e31d49ac69c1 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:07.261602 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-5be4478a-2f59-42c6-b80f-e31d49ac69c1 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:07.327002 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-5be4478a-2f59-42c6-b80f-e31d49ac69c1 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "POST /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/action" status: 202 len: 0 microversion: 2.1 time: 0.077246 Nov 09 20:11:07.327813 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 243/489] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Nov 9 20:11:07 2021] POST /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 09 20:11:07.336465 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-0cf90343-9d45-41b1-85c2-7ed0ef0a1aea tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:11:07.337125 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-0cf90343-9d45-41b1-85c2-7ed0ef0a1aea tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:11:07.343920 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0cf90343-9d45-41b1-85c2-7ed0ef0a1aea tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:07.344446 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0cf90343-9d45-41b1-85c2-7ed0ef0a1aea tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:07.345240 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0cf90343-9d45-41b1-85c2-7ed0ef0a1aea tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:07.345734 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0cf90343-9d45-41b1-85c2-7ed0ef0a1aea tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:07.374470 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-58804167-866f-45e7-a444-432401892f4b tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:11:07.375149 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-58804167-866f-45e7-a444-432401892f4b tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:11:07.381608 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-58804167-866f-45e7-a444-432401892f4b tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:07.382049 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-58804167-866f-45e7-a444-432401892f4b tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:07.384451 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-58804167-866f-45e7-a444-432401892f4b tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:07.384451 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-58804167-866f-45e7-a444-432401892f4b tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:07.539451 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-0cf90343-9d45-41b1-85c2-7ed0ef0a1aea tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:11:07.547545 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-0cf90343-9d45-41b1-85c2-7ed0ef0a1aea tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1555 microversion: 2.1 time: 0.214841 Nov 09 20:11:07.548111 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 247/490] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:11:07 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1555 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:11:07.562323 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-58804167-866f-45e7-a444-432401892f4b tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:11:07.571482 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-58804167-866f-45e7-a444-432401892f4b tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:11:07.573063 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-58804167-866f-45e7-a444-432401892f4b tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:11:07.574248 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-58804167-866f-45e7-a444-432401892f4b tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1753 microversion: 2.20 time: 0.203814 Nov 09 20:11:07.574784 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 244/491] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:11:07 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1753 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 09 20:11:08.564451 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-74d71db6-1967-48fa-b2ed-cbebad311f1d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:11:08.564976 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-74d71db6-1967-48fa-b2ed-cbebad311f1d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:11:08.571704 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-74d71db6-1967-48fa-b2ed-cbebad311f1d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:08.572151 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-74d71db6-1967-48fa-b2ed-cbebad311f1d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:08.572954 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-74d71db6-1967-48fa-b2ed-cbebad311f1d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:08.573387 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-74d71db6-1967-48fa-b2ed-cbebad311f1d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:08.592376 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-5c0154b9-0b41-42df-8ea2-7f879afe4bd0 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:11:08.593012 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-5c0154b9-0b41-42df-8ea2-7f879afe4bd0 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:11:08.599678 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-5c0154b9-0b41-42df-8ea2-7f879afe4bd0 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:08.600121 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-5c0154b9-0b41-42df-8ea2-7f879afe4bd0 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:08.600926 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-5c0154b9-0b41-42df-8ea2-7f879afe4bd0 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:08.601391 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-5c0154b9-0b41-42df-8ea2-7f879afe4bd0 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:08.765751 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-74d71db6-1967-48fa-b2ed-cbebad311f1d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:11:08.775225 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-74d71db6-1967-48fa-b2ed-cbebad311f1d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1555 microversion: 2.1 time: 0.214420 Nov 09 20:11:08.775850 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 248/492] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:11:08 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1555 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:11:08.781614 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-5c0154b9-0b41-42df-8ea2-7f879afe4bd0 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:11:08.789880 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-5c0154b9-0b41-42df-8ea2-7f879afe4bd0 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:11:08.791356 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-5c0154b9-0b41-42df-8ea2-7f879afe4bd0 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:11:08.792516 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-5c0154b9-0b41-42df-8ea2-7f879afe4bd0 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1753 microversion: 2.20 time: 0.203733 Nov 09 20:11:08.793057 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 245/493] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:11:08 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1753 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 09 20:11:09.792381 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-77f5dd46-8d71-4bcf-b4a0-0c12e5751110 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:11:09.793045 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-77f5dd46-8d71-4bcf-b4a0-0c12e5751110 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:11:09.799071 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-77f5dd46-8d71-4bcf-b4a0-0c12e5751110 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:09.799510 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-77f5dd46-8d71-4bcf-b4a0-0c12e5751110 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:09.800980 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-77f5dd46-8d71-4bcf-b4a0-0c12e5751110 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:09.801442 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-77f5dd46-8d71-4bcf-b4a0-0c12e5751110 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:09.811181 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-20a88fe8-e60e-42ea-9eb9-ffd9335ba5a0 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:11:09.812059 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-20a88fe8-e60e-42ea-9eb9-ffd9335ba5a0 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:11:09.818485 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-20a88fe8-e60e-42ea-9eb9-ffd9335ba5a0 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:09.819260 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-20a88fe8-e60e-42ea-9eb9-ffd9335ba5a0 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:09.820082 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-20a88fe8-e60e-42ea-9eb9-ffd9335ba5a0 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:09.828747 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-20a88fe8-e60e-42ea-9eb9-ffd9335ba5a0 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:09.996684 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-77f5dd46-8d71-4bcf-b4a0-0c12e5751110 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:11:10.005193 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-77f5dd46-8d71-4bcf-b4a0-0c12e5751110 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1561 microversion: 2.1 time: 0.216341 Nov 09 20:11:10.005781 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 249/494] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:11:09 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1561 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:11:10.006165 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-20a88fe8-e60e-42ea-9eb9-ffd9335ba5a0 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:11:10.014777 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-20a88fe8-e60e-42ea-9eb9-ffd9335ba5a0 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:11:10.016026 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-20a88fe8-e60e-42ea-9eb9-ffd9335ba5a0 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:11:10.018836 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-20a88fe8-e60e-42ea-9eb9-ffd9335ba5a0 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1753 microversion: 2.20 time: 0.211124 Nov 09 20:11:10.019525 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 246/495] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:11:09 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1753 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:11:10.081696 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-10194673-9696-4e94-8424-47649de63069 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:11:10.082207 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-10194673-9696-4e94-8424-47649de63069 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:11:10.087911 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-10194673-9696-4e94-8424-47649de63069 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:10.088424 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-10194673-9696-4e94-8424-47649de63069 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:10.089208 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-10194673-9696-4e94-8424-47649de63069 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:10.089638 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-10194673-9696-4e94-8424-47649de63069 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:10.167059 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.objects.instance [None req-10194673-9696-4e94-8424-47649de63069 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lazy-loading 'services' on Instance uuid 80ce5722-8f51-457b-9f9b-ff4b63b103df {{(pid=116103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 09 20:11:10.235822 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-10194673-9696-4e94-8424-47649de63069 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "DELETE /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments/b4067724-e196-4d20-a86b-ca56ba60cf02" status: 202 len: 0 microversion: 2.1 time: 0.157626 Nov 09 20:11:10.236421 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 250/496] 10.222.0.25 () {58 vars in 1415 bytes} [Tue Nov 9 20:11:10 2021] DELETE /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments/b4067724-e196-4d20-a86b-ca56ba60cf02 => generated 0 bytes in 159 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 09 20:11:10.244794 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-02ebe37f-3201-485b-93cf-59e3510168d7 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:11:10.245797 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-02ebe37f-3201-485b-93cf-59e3510168d7 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:11:10.251489 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-02ebe37f-3201-485b-93cf-59e3510168d7 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:10.252032 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-02ebe37f-3201-485b-93cf-59e3510168d7 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:10.252874 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-02ebe37f-3201-485b-93cf-59e3510168d7 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:10.253412 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-02ebe37f-3201-485b-93cf-59e3510168d7 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:10.283651 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-02ebe37f-3201-485b-93cf-59e3510168d7 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042510 Nov 09 20:11:10.284236 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 247/497] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:11:10 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:11:11.037833 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-979157a5-1a40-462b-9868-c477a84b57df tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:11:11.038514 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-979157a5-1a40-462b-9868-c477a84b57df tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:11:11.044760 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-979157a5-1a40-462b-9868-c477a84b57df tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:11.045200 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-979157a5-1a40-462b-9868-c477a84b57df tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:11.045961 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-979157a5-1a40-462b-9868-c477a84b57df tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:11.046392 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-979157a5-1a40-462b-9868-c477a84b57df tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:11.183824 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-979157a5-1a40-462b-9868-c477a84b57df tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:11:11.192952 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-979157a5-1a40-462b-9868-c477a84b57df tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:11:11.194428 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-979157a5-1a40-462b-9868-c477a84b57df tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:11:11.195554 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-979157a5-1a40-462b-9868-c477a84b57df tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1753 microversion: 2.20 time: 0.162278 Nov 09 20:11:11.196106 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 251/498] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:11:11 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1753 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:11:11.294935 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-4dcba5f7-983a-4894-b691-f10bf65740c2 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:11:11.295841 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-4dcba5f7-983a-4894-b691-f10bf65740c2 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:11:11.303000 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-4dcba5f7-983a-4894-b691-f10bf65740c2 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:11.303442 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-4dcba5f7-983a-4894-b691-f10bf65740c2 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:11.304209 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-4dcba5f7-983a-4894-b691-f10bf65740c2 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:11.304666 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-4dcba5f7-983a-4894-b691-f10bf65740c2 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:11.332850 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-4dcba5f7-983a-4894-b691-f10bf65740c2 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041593 Nov 09 20:11:11.333391 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 248/499] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:11:11 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:11:12.141155 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 09 20:11:12.141658 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: Tue Nov 9 20:11:12 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 09 20:11:12.213138 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-bb2e462c-bce8-4630-b1e4-17db378ba230 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:11:12.213734 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-bb2e462c-bce8-4630-b1e4-17db378ba230 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:11:12.219913 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bb2e462c-bce8-4630-b1e4-17db378ba230 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:12.220459 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bb2e462c-bce8-4630-b1e4-17db378ba230 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:12.221217 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bb2e462c-bce8-4630-b1e4-17db378ba230 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:12.221638 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bb2e462c-bce8-4630-b1e4-17db378ba230 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:12.343312 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-1fe3b2d9-a5e3-4ca4-b5ce-102c859dd10c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:11:12.344225 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-1fe3b2d9-a5e3-4ca4-b5ce-102c859dd10c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:11:12.351234 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-1fe3b2d9-a5e3-4ca4-b5ce-102c859dd10c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:12.351680 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-1fe3b2d9-a5e3-4ca4-b5ce-102c859dd10c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:12.352488 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-1fe3b2d9-a5e3-4ca4-b5ce-102c859dd10c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:12.352914 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-1fe3b2d9-a5e3-4ca4-b5ce-102c859dd10c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:12.354950 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-bb2e462c-bce8-4630-b1e4-17db378ba230 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:11:12.363601 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-bb2e462c-bce8-4630-b1e4-17db378ba230 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:11:12.365126 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-bb2e462c-bce8-4630-b1e4-17db378ba230 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:11:12.366256 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-bb2e462c-bce8-4630-b1e4-17db378ba230 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1753 microversion: 2.20 time: 0.156873 Nov 09 20:11:12.366799 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 252/500] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:11:12 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1753 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:11:12.381907 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-1fe3b2d9-a5e3-4ca4-b5ce-102c859dd10c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042311 Nov 09 20:11:12.382449 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 249/501] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:11:12 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 20:11:13.383807 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-b8902d42-6676-427e-bf9b-810975fca253 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:11:13.384563 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-b8902d42-6676-427e-bf9b-810975fca253 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:11:13.391015 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b8902d42-6676-427e-bf9b-810975fca253 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:13.391474 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b8902d42-6676-427e-bf9b-810975fca253 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:13.392261 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b8902d42-6676-427e-bf9b-810975fca253 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:13.393522 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b8902d42-6676-427e-bf9b-810975fca253 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:13.396116 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-bc63c21a-5e70-4e4d-9c94-a1b3ad321b2e tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:11:13.397598 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-bc63c21a-5e70-4e4d-9c94-a1b3ad321b2e tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:11:13.404242 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-bc63c21a-5e70-4e4d-9c94-a1b3ad321b2e tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:13.405122 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-bc63c21a-5e70-4e4d-9c94-a1b3ad321b2e tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:13.406124 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-bc63c21a-5e70-4e4d-9c94-a1b3ad321b2e tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:13.406777 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-bc63c21a-5e70-4e4d-9c94-a1b3ad321b2e tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:13.444891 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-bc63c21a-5e70-4e4d-9c94-a1b3ad321b2e tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055214 Nov 09 20:11:13.449198 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 250/502] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:11:13 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:11:13.529323 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-b8902d42-6676-427e-bf9b-810975fca253 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:11:13.538367 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-b8902d42-6676-427e-bf9b-810975fca253 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:11:13.539777 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-b8902d42-6676-427e-bf9b-810975fca253 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:11:13.540983 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-b8902d42-6676-427e-bf9b-810975fca253 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1753 microversion: 2.20 time: 0.160861 Nov 09 20:11:13.541529 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 253/503] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:11:13 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1753 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:11:14.457042 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-02b9e905-50fb-463f-a77e-2a5ccc2f850a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:11:14.457978 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-02b9e905-50fb-463f-a77e-2a5ccc2f850a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:11:14.464128 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-02b9e905-50fb-463f-a77e-2a5ccc2f850a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:14.464614 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-02b9e905-50fb-463f-a77e-2a5ccc2f850a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:14.465379 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-02b9e905-50fb-463f-a77e-2a5ccc2f850a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:14.465806 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-02b9e905-50fb-463f-a77e-2a5ccc2f850a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:14.495322 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-02b9e905-50fb-463f-a77e-2a5ccc2f850a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042416 Nov 09 20:11:14.495805 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 251/504] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:11:14 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:11:14.558844 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-35c76890-97a6-4c80-b22e-77863f52f3d3 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:11:14.559433 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-35c76890-97a6-4c80-b22e-77863f52f3d3 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:11:14.565547 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-35c76890-97a6-4c80-b22e-77863f52f3d3 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:14.566013 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-35c76890-97a6-4c80-b22e-77863f52f3d3 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:14.566848 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-35c76890-97a6-4c80-b22e-77863f52f3d3 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:14.567271 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-35c76890-97a6-4c80-b22e-77863f52f3d3 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:14.693562 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-35c76890-97a6-4c80-b22e-77863f52f3d3 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:11:14.701554 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-35c76890-97a6-4c80-b22e-77863f52f3d3 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:11:14.703084 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-35c76890-97a6-4c80-b22e-77863f52f3d3 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:11:14.704224 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-35c76890-97a6-4c80-b22e-77863f52f3d3 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1753 microversion: 2.20 time: 0.149048 Nov 09 20:11:14.704899 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 254/505] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:11:14 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1753 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:11:15.506387 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-390a38c6-ab1f-40f7-af89-a12584617d4a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:11:15.507287 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-390a38c6-ab1f-40f7-af89-a12584617d4a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:11:15.513281 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-390a38c6-ab1f-40f7-af89-a12584617d4a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:15.513722 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-390a38c6-ab1f-40f7-af89-a12584617d4a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:15.514481 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-390a38c6-ab1f-40f7-af89-a12584617d4a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:15.514906 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-390a38c6-ab1f-40f7-af89-a12584617d4a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:15.543814 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-390a38c6-ab1f-40f7-af89-a12584617d4a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041351 Nov 09 20:11:15.544357 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 252/506] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:11:15 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:11:15.723916 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-edac6b71-2fc9-4fbc-911a-e9fbcb811598 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:11:15.724622 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-edac6b71-2fc9-4fbc-911a-e9fbcb811598 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:11:15.731756 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-edac6b71-2fc9-4fbc-911a-e9fbcb811598 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:15.732200 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-edac6b71-2fc9-4fbc-911a-e9fbcb811598 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:15.733059 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-edac6b71-2fc9-4fbc-911a-e9fbcb811598 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:15.733484 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-edac6b71-2fc9-4fbc-911a-e9fbcb811598 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:15.873590 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-edac6b71-2fc9-4fbc-911a-e9fbcb811598 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:11:15.881985 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-edac6b71-2fc9-4fbc-911a-e9fbcb811598 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:11:15.883469 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-edac6b71-2fc9-4fbc-911a-e9fbcb811598 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:11:15.884631 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-edac6b71-2fc9-4fbc-911a-e9fbcb811598 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1753 microversion: 2.20 time: 0.165416 Nov 09 20:11:15.885173 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 255/507] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:11:15 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1753 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:11:16.555115 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-b015f6bb-a955-4d7f-844b-57e04591dec8 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:11:16.556057 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-b015f6bb-a955-4d7f-844b-57e04591dec8 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:11:16.562252 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b015f6bb-a955-4d7f-844b-57e04591dec8 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:16.562694 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b015f6bb-a955-4d7f-844b-57e04591dec8 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:16.563472 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b015f6bb-a955-4d7f-844b-57e04591dec8 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:16.563901 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b015f6bb-a955-4d7f-844b-57e04591dec8 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:16.592762 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-b015f6bb-a955-4d7f-844b-57e04591dec8 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041327 Nov 09 20:11:16.593308 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 253/508] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:11:16 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 20:11:16.903776 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-eb9df477-8963-4d51-a5f6-c950f93c9543 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:11:16.904367 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-eb9df477-8963-4d51-a5f6-c950f93c9543 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:11:16.910714 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-eb9df477-8963-4d51-a5f6-c950f93c9543 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:16.911167 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-eb9df477-8963-4d51-a5f6-c950f93c9543 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:16.912061 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-eb9df477-8963-4d51-a5f6-c950f93c9543 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:16.912378 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-eb9df477-8963-4d51-a5f6-c950f93c9543 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:17.045890 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-eb9df477-8963-4d51-a5f6-c950f93c9543 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:11:17.054634 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-eb9df477-8963-4d51-a5f6-c950f93c9543 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:11:17.056175 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-eb9df477-8963-4d51-a5f6-c950f93c9543 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:11:17.057437 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-eb9df477-8963-4d51-a5f6-c950f93c9543 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1753 microversion: 2.20 time: 0.157251 Nov 09 20:11:17.057990 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 256/509] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:11:16 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1753 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:11:17.604373 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-7da13ced-753d-432c-aca1-f11b95ed09c7 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:11:17.605304 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-7da13ced-753d-432c-aca1-f11b95ed09c7 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:11:17.611425 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-7da13ced-753d-432c-aca1-f11b95ed09c7 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:17.611878 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-7da13ced-753d-432c-aca1-f11b95ed09c7 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:17.613554 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-7da13ced-753d-432c-aca1-f11b95ed09c7 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:17.614135 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-7da13ced-753d-432c-aca1-f11b95ed09c7 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:17.642242 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-7da13ced-753d-432c-aca1-f11b95ed09c7 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041831 Nov 09 20:11:17.642785 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 254/510] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:11:17 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:11:18.078020 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-6af5ad5f-9038-45dd-9fcc-e0c9344299d1 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:11:18.078617 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-6af5ad5f-9038-45dd-9fcc-e0c9344299d1 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:11:18.085762 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6af5ad5f-9038-45dd-9fcc-e0c9344299d1 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:18.086202 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6af5ad5f-9038-45dd-9fcc-e0c9344299d1 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:18.086967 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6af5ad5f-9038-45dd-9fcc-e0c9344299d1 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:18.087396 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6af5ad5f-9038-45dd-9fcc-e0c9344299d1 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:18.219638 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-6af5ad5f-9038-45dd-9fcc-e0c9344299d1 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:11:18.228077 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-6af5ad5f-9038-45dd-9fcc-e0c9344299d1 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:11:18.229848 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-6af5ad5f-9038-45dd-9fcc-e0c9344299d1 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:11:18.230975 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-6af5ad5f-9038-45dd-9fcc-e0c9344299d1 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1753 microversion: 2.20 time: 0.156623 Nov 09 20:11:18.231539 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 257/511] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:11:18 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1753 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:11:18.653987 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-c51b92b3-e0c4-444c-985c-1cfd0fa33728 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:11:18.654891 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-c51b92b3-e0c4-444c-985c-1cfd0fa33728 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:11:18.661105 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c51b92b3-e0c4-444c-985c-1cfd0fa33728 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:18.661549 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c51b92b3-e0c4-444c-985c-1cfd0fa33728 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:18.662313 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c51b92b3-e0c4-444c-985c-1cfd0fa33728 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:18.662743 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c51b92b3-e0c4-444c-985c-1cfd0fa33728 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:18.691628 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-c51b92b3-e0c4-444c-985c-1cfd0fa33728 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040701 Nov 09 20:11:18.692170 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 255/512] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:11:18 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:11:19.248943 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-d57d79ff-4a99-4aca-bc68-367bcfd5f7df tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:11:19.249471 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-d57d79ff-4a99-4aca-bc68-367bcfd5f7df tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:11:19.256238 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d57d79ff-4a99-4aca-bc68-367bcfd5f7df tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:19.256705 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d57d79ff-4a99-4aca-bc68-367bcfd5f7df tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:19.257468 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d57d79ff-4a99-4aca-bc68-367bcfd5f7df tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:19.257891 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d57d79ff-4a99-4aca-bc68-367bcfd5f7df tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:19.386136 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-d57d79ff-4a99-4aca-bc68-367bcfd5f7df tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:11:19.394154 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-d57d79ff-4a99-4aca-bc68-367bcfd5f7df tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:11:19.395630 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-d57d79ff-4a99-4aca-bc68-367bcfd5f7df tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:11:19.396791 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-d57d79ff-4a99-4aca-bc68-367bcfd5f7df tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1753 microversion: 2.20 time: 0.151499 Nov 09 20:11:19.397342 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 258/513] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:11:19 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1753 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:11:19.702704 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-bdcc78e6-429e-4e80-ad6e-d45e7beb32e4 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:11:19.703659 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-bdcc78e6-429e-4e80-ad6e-d45e7beb32e4 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:11:19.710425 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-bdcc78e6-429e-4e80-ad6e-d45e7beb32e4 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:19.710866 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-bdcc78e6-429e-4e80-ad6e-d45e7beb32e4 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:19.711627 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-bdcc78e6-429e-4e80-ad6e-d45e7beb32e4 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:19.712053 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-bdcc78e6-429e-4e80-ad6e-d45e7beb32e4 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:19.740660 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-bdcc78e6-429e-4e80-ad6e-d45e7beb32e4 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041567 Nov 09 20:11:19.741198 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 256/514] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:11:19 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:11:20.415339 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-ef470eea-5234-4550-afa3-9fda555319ab tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:11:20.415952 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-ef470eea-5234-4550-afa3-9fda555319ab tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:11:20.422096 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ef470eea-5234-4550-afa3-9fda555319ab tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:20.422531 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ef470eea-5234-4550-afa3-9fda555319ab tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:20.423284 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ef470eea-5234-4550-afa3-9fda555319ab tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:20.423704 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ef470eea-5234-4550-afa3-9fda555319ab tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:20.560009 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-ef470eea-5234-4550-afa3-9fda555319ab tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:11:20.568175 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-ef470eea-5234-4550-afa3-9fda555319ab tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:11:20.569730 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-ef470eea-5234-4550-afa3-9fda555319ab tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:11:20.570859 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-ef470eea-5234-4550-afa3-9fda555319ab tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1753 microversion: 2.20 time: 0.159169 Nov 09 20:11:20.571409 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 259/515] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:11:20 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1753 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:11:20.750862 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-53aeb539-bb0f-4a51-9208-c74238bf5d51 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:11:20.751781 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-53aeb539-bb0f-4a51-9208-c74238bf5d51 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:11:20.759389 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-53aeb539-bb0f-4a51-9208-c74238bf5d51 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:20.759834 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-53aeb539-bb0f-4a51-9208-c74238bf5d51 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:20.760639 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-53aeb539-bb0f-4a51-9208-c74238bf5d51 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:20.761090 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-53aeb539-bb0f-4a51-9208-c74238bf5d51 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:20.791022 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-53aeb539-bb0f-4a51-9208-c74238bf5d51 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043844 Nov 09 20:11:20.791577 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 257/516] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:11:20 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:11:21.589312 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-ac1b4f89-a2fb-4b57-96e3-f833afe36516 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:11:21.589912 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-ac1b4f89-a2fb-4b57-96e3-f833afe36516 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:11:21.596049 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ac1b4f89-a2fb-4b57-96e3-f833afe36516 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:21.596535 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ac1b4f89-a2fb-4b57-96e3-f833afe36516 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:21.597797 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ac1b4f89-a2fb-4b57-96e3-f833afe36516 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:21.598225 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ac1b4f89-a2fb-4b57-96e3-f833afe36516 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:21.726997 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-ac1b4f89-a2fb-4b57-96e3-f833afe36516 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:11:21.735263 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-ac1b4f89-a2fb-4b57-96e3-f833afe36516 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:11:21.736777 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-ac1b4f89-a2fb-4b57-96e3-f833afe36516 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:11:21.738816 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-ac1b4f89-a2fb-4b57-96e3-f833afe36516 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1753 microversion: 2.20 time: 0.153018 Nov 09 20:11:21.739371 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 260/517] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:11:21 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1753 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:11:21.802980 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-be9f19c7-907b-4ea1-bb81-0297d27929f1 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:11:21.803819 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-be9f19c7-907b-4ea1-bb81-0297d27929f1 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:11:21.810168 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-be9f19c7-907b-4ea1-bb81-0297d27929f1 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:21.810618 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-be9f19c7-907b-4ea1-bb81-0297d27929f1 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:21.811398 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-be9f19c7-907b-4ea1-bb81-0297d27929f1 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:21.811836 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-be9f19c7-907b-4ea1-bb81-0297d27929f1 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:21.839826 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-be9f19c7-907b-4ea1-bb81-0297d27929f1 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041349 Nov 09 20:11:21.840458 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 258/518] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:11:21 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:11:22.757400 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-cdbd1099-82f8-48c6-8d83-e395b6f8a2a4 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:11:22.758003 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-cdbd1099-82f8-48c6-8d83-e395b6f8a2a4 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:11:22.764167 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cdbd1099-82f8-48c6-8d83-e395b6f8a2a4 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:22.764644 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cdbd1099-82f8-48c6-8d83-e395b6f8a2a4 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:22.765409 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cdbd1099-82f8-48c6-8d83-e395b6f8a2a4 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:22.765842 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cdbd1099-82f8-48c6-8d83-e395b6f8a2a4 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:22.851565 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-9350c6a1-174e-4cca-8b94-f160b9a24ff8 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:11:22.852501 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-9350c6a1-174e-4cca-8b94-f160b9a24ff8 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:11:22.859126 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-9350c6a1-174e-4cca-8b94-f160b9a24ff8 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:22.859661 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-9350c6a1-174e-4cca-8b94-f160b9a24ff8 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:22.860600 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-9350c6a1-174e-4cca-8b94-f160b9a24ff8 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:22.861110 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-9350c6a1-174e-4cca-8b94-f160b9a24ff8 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:22.891049 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-9350c6a1-174e-4cca-8b94-f160b9a24ff8 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043076 Nov 09 20:11:22.891980 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 259/519] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:11:22 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 20:11:22.894762 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-cdbd1099-82f8-48c6-8d83-e395b6f8a2a4 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:11:22.902807 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-cdbd1099-82f8-48c6-8d83-e395b6f8a2a4 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:11:22.904274 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-cdbd1099-82f8-48c6-8d83-e395b6f8a2a4 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:11:22.905431 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-cdbd1099-82f8-48c6-8d83-e395b6f8a2a4 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1753 microversion: 2.20 time: 0.152405 Nov 09 20:11:22.906253 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 261/520] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:11:22 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1753 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:11:23.902916 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-34fc8130-3c11-42ec-ad5b-789fc2e052e5 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:11:23.903733 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-34fc8130-3c11-42ec-ad5b-789fc2e052e5 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:11:23.910539 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-34fc8130-3c11-42ec-ad5b-789fc2e052e5 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:23.910978 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-34fc8130-3c11-42ec-ad5b-789fc2e052e5 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:23.911741 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-34fc8130-3c11-42ec-ad5b-789fc2e052e5 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:23.912168 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-34fc8130-3c11-42ec-ad5b-789fc2e052e5 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:23.923329 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-0e963611-4ca4-4b26-8c06-1469feca3436 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:11:23.923928 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-0e963611-4ca4-4b26-8c06-1469feca3436 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:11:23.930249 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0e963611-4ca4-4b26-8c06-1469feca3436 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:23.930700 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0e963611-4ca4-4b26-8c06-1469feca3436 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:23.931470 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0e963611-4ca4-4b26-8c06-1469feca3436 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:23.931907 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0e963611-4ca4-4b26-8c06-1469feca3436 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:23.940964 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-34fc8130-3c11-42ec-ad5b-789fc2e052e5 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041826 Nov 09 20:11:23.941735 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 260/521] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:11:23 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:11:24.062888 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-0e963611-4ca4-4b26-8c06-1469feca3436 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:11:24.071537 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-0e963611-4ca4-4b26-8c06-1469feca3436 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:11:24.073044 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-0e963611-4ca4-4b26-8c06-1469feca3436 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:11:24.074169 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-0e963611-4ca4-4b26-8c06-1469feca3436 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1753 microversion: 2.20 time: 0.154492 Nov 09 20:11:24.074714 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 262/522] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:11:23 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1753 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 09 20:11:24.952622 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-5ded6b04-6ae1-4397-a08e-a92c4b742fe1 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:11:24.953422 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-5ded6b04-6ae1-4397-a08e-a92c4b742fe1 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:11:24.960270 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-5ded6b04-6ae1-4397-a08e-a92c4b742fe1 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:24.960745 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-5ded6b04-6ae1-4397-a08e-a92c4b742fe1 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:24.961515 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-5ded6b04-6ae1-4397-a08e-a92c4b742fe1 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:24.961944 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-5ded6b04-6ae1-4397-a08e-a92c4b742fe1 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:24.990002 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-5ded6b04-6ae1-4397-a08e-a92c4b742fe1 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041380 Nov 09 20:11:24.990544 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 261/523] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:11:24 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:11:25.092947 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-adbec3a9-73a1-44cb-8709-569bb4d65ddf tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:11:25.093574 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-adbec3a9-73a1-44cb-8709-569bb4d65ddf tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:11:25.099724 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-adbec3a9-73a1-44cb-8709-569bb4d65ddf tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:25.100172 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-adbec3a9-73a1-44cb-8709-569bb4d65ddf tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:25.100972 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-adbec3a9-73a1-44cb-8709-569bb4d65ddf tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:25.101406 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-adbec3a9-73a1-44cb-8709-569bb4d65ddf tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:25.229854 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-adbec3a9-73a1-44cb-8709-569bb4d65ddf tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:11:25.238484 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-adbec3a9-73a1-44cb-8709-569bb4d65ddf tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:11:25.240029 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-adbec3a9-73a1-44cb-8709-569bb4d65ddf tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:11:25.241201 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-adbec3a9-73a1-44cb-8709-569bb4d65ddf tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1753 microversion: 2.20 time: 0.152024 Nov 09 20:11:25.241756 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 263/524] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:11:25 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1753 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:11:26.001488 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-14d729ea-20eb-4eed-9833-ee129a2f445a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:11:26.002269 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-14d729ea-20eb-4eed-9833-ee129a2f445a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:11:26.008700 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-14d729ea-20eb-4eed-9833-ee129a2f445a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:26.009149 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-14d729ea-20eb-4eed-9833-ee129a2f445a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:26.009925 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-14d729ea-20eb-4eed-9833-ee129a2f445a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:26.010354 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-14d729ea-20eb-4eed-9833-ee129a2f445a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:26.039686 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-14d729ea-20eb-4eed-9833-ee129a2f445a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041996 Nov 09 20:11:26.040235 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 262/525] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:11:25 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:11:26.259690 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-93087b77-fa71-4eec-9b91-061c2aa9aeeb tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:11:26.260189 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-93087b77-fa71-4eec-9b91-061c2aa9aeeb tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:11:26.266078 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-93087b77-fa71-4eec-9b91-061c2aa9aeeb tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:26.266513 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-93087b77-fa71-4eec-9b91-061c2aa9aeeb tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:26.267269 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-93087b77-fa71-4eec-9b91-061c2aa9aeeb tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:26.267692 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-93087b77-fa71-4eec-9b91-061c2aa9aeeb tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:26.398767 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-93087b77-fa71-4eec-9b91-061c2aa9aeeb tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:11:26.406768 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-93087b77-fa71-4eec-9b91-061c2aa9aeeb tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:11:26.408288 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-93087b77-fa71-4eec-9b91-061c2aa9aeeb tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:11:26.409524 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-93087b77-fa71-4eec-9b91-061c2aa9aeeb tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1753 microversion: 2.20 time: 0.153613 Nov 09 20:11:26.410680 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 264/526] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:11:26 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1753 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:11:27.051215 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-31dbbd0a-af04-4a0d-b3da-227887fe0b05 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:11:27.052182 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-31dbbd0a-af04-4a0d-b3da-227887fe0b05 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:11:27.058695 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-31dbbd0a-af04-4a0d-b3da-227887fe0b05 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:27.059139 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-31dbbd0a-af04-4a0d-b3da-227887fe0b05 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:27.059907 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-31dbbd0a-af04-4a0d-b3da-227887fe0b05 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:27.060334 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-31dbbd0a-af04-4a0d-b3da-227887fe0b05 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:27.087696 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-31dbbd0a-af04-4a0d-b3da-227887fe0b05 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041252 Nov 09 20:11:27.088226 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 263/527] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:11:27 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:11:27.427073 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-dea63428-4c84-4e49-8dd6-00661af18ebb tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:11:27.427690 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-dea63428-4c84-4e49-8dd6-00661af18ebb tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:11:27.433557 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-dea63428-4c84-4e49-8dd6-00661af18ebb tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:27.433995 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-dea63428-4c84-4e49-8dd6-00661af18ebb tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:27.434751 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-dea63428-4c84-4e49-8dd6-00661af18ebb tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:27.435176 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-dea63428-4c84-4e49-8dd6-00661af18ebb tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:27.489524 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 09 20:11:27.489755 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: Tue Nov 9 20:11:27 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e (ip 10.222.0.25) !!! Nov 09 20:11:27.569348 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-dea63428-4c84-4e49-8dd6-00661af18ebb tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:11:27.577405 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-dea63428-4c84-4e49-8dd6-00661af18ebb tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:11:27.579065 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-dea63428-4c84-4e49-8dd6-00661af18ebb tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:11:27.580016 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-dea63428-4c84-4e49-8dd6-00661af18ebb tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1753 microversion: 2.20 time: 0.157116 Nov 09 20:11:27.580608 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 265/528] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:11:27 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1753 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:11:28.099212 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-a1a827df-7466-49f3-b148-1690954faf5f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:11:28.100179 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-a1a827df-7466-49f3-b148-1690954faf5f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:11:28.106736 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a1a827df-7466-49f3-b148-1690954faf5f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:28.107177 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a1a827df-7466-49f3-b148-1690954faf5f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:28.107975 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a1a827df-7466-49f3-b148-1690954faf5f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:28.108428 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a1a827df-7466-49f3-b148-1690954faf5f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:28.136859 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-a1a827df-7466-49f3-b148-1690954faf5f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041669 Nov 09 20:11:28.137398 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 264/529] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:11:28 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:11:28.598798 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-ce461d38-c097-447a-86c3-f991076b9bb8 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:11:28.599374 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-ce461d38-c097-447a-86c3-f991076b9bb8 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:11:28.606028 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ce461d38-c097-447a-86c3-f991076b9bb8 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:28.606475 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ce461d38-c097-447a-86c3-f991076b9bb8 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:28.607280 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ce461d38-c097-447a-86c3-f991076b9bb8 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:28.607709 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ce461d38-c097-447a-86c3-f991076b9bb8 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:28.734339 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-ce461d38-c097-447a-86c3-f991076b9bb8 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:11:28.743196 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-ce461d38-c097-447a-86c3-f991076b9bb8 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:11:28.744726 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-ce461d38-c097-447a-86c3-f991076b9bb8 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:11:28.745878 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-ce461d38-c097-447a-86c3-f991076b9bb8 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1753 microversion: 2.20 time: 0.151371 Nov 09 20:11:28.746429 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 266/530] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:11:28 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1753 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:11:29.148911 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-3f2c6a9c-2cc3-40de-8c64-bff50b021805 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:11:29.149835 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-3f2c6a9c-2cc3-40de-8c64-bff50b021805 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:11:29.155986 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-3f2c6a9c-2cc3-40de-8c64-bff50b021805 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:29.156511 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-3f2c6a9c-2cc3-40de-8c64-bff50b021805 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:29.157353 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-3f2c6a9c-2cc3-40de-8c64-bff50b021805 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:29.157838 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-3f2c6a9c-2cc3-40de-8c64-bff50b021805 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:29.186306 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-3f2c6a9c-2cc3-40de-8c64-bff50b021805 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041963 Nov 09 20:11:29.186846 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 265/531] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:11:29 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:11:29.763706 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-cc99a5b2-ed5d-4301-a394-5ca940a94fd8 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:11:29.764311 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-cc99a5b2-ed5d-4301-a394-5ca940a94fd8 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:11:29.771116 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cc99a5b2-ed5d-4301-a394-5ca940a94fd8 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:29.771556 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cc99a5b2-ed5d-4301-a394-5ca940a94fd8 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:29.772421 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cc99a5b2-ed5d-4301-a394-5ca940a94fd8 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:29.772906 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cc99a5b2-ed5d-4301-a394-5ca940a94fd8 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:29.903420 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-cc99a5b2-ed5d-4301-a394-5ca940a94fd8 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:11:29.911945 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-cc99a5b2-ed5d-4301-a394-5ca940a94fd8 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:11:29.913478 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-cc99a5b2-ed5d-4301-a394-5ca940a94fd8 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:11:29.914635 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-cc99a5b2-ed5d-4301-a394-5ca940a94fd8 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1753 microversion: 2.20 time: 0.154567 Nov 09 20:11:29.915440 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 267/532] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:11:29 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1753 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:11:30.197367 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-7517c6e9-4c46-4000-99af-07c921806b45 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:11:30.198263 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-7517c6e9-4c46-4000-99af-07c921806b45 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:11:30.204664 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-7517c6e9-4c46-4000-99af-07c921806b45 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:30.205111 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-7517c6e9-4c46-4000-99af-07c921806b45 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:30.205887 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-7517c6e9-4c46-4000-99af-07c921806b45 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:30.206322 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-7517c6e9-4c46-4000-99af-07c921806b45 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:30.235218 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-7517c6e9-4c46-4000-99af-07c921806b45 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041571 Nov 09 20:11:30.235767 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 266/533] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:11:30 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:11:30.933438 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-35296efa-d1b5-45db-a982-8b432963198f tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:11:30.934070 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-35296efa-d1b5-45db-a982-8b432963198f tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:11:30.940113 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-35296efa-d1b5-45db-a982-8b432963198f tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:30.940600 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-35296efa-d1b5-45db-a982-8b432963198f tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:30.942097 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-35296efa-d1b5-45db-a982-8b432963198f tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:30.942526 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-35296efa-d1b5-45db-a982-8b432963198f tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:31.071815 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-35296efa-d1b5-45db-a982-8b432963198f tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:11:31.079811 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-35296efa-d1b5-45db-a982-8b432963198f tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:11:31.081317 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-35296efa-d1b5-45db-a982-8b432963198f tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:11:31.083145 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-35296efa-d1b5-45db-a982-8b432963198f tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1753 microversion: 2.20 time: 0.153417 Nov 09 20:11:31.083692 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 268/534] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:11:30 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1753 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 09 20:11:31.249201 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-c19793a6-ce20-4ad4-996c-ef425d29bc44 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:11:31.249999 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-c19793a6-ce20-4ad4-996c-ef425d29bc44 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:11:31.257196 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c19793a6-ce20-4ad4-996c-ef425d29bc44 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:31.257647 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c19793a6-ce20-4ad4-996c-ef425d29bc44 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:31.258440 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c19793a6-ce20-4ad4-996c-ef425d29bc44 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:31.258883 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c19793a6-ce20-4ad4-996c-ef425d29bc44 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:31.287825 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-c19793a6-ce20-4ad4-996c-ef425d29bc44 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042451 Nov 09 20:11:31.288382 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 267/535] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:11:31 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:11:32.101788 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-9e088d66-1727-4fce-b851-46498225018c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:11:32.102393 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-9e088d66-1727-4fce-b851-46498225018c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:11:32.108853 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9e088d66-1727-4fce-b851-46498225018c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:32.109307 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9e088d66-1727-4fce-b851-46498225018c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:32.110156 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9e088d66-1727-4fce-b851-46498225018c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:32.110612 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9e088d66-1727-4fce-b851-46498225018c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:32.240213 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-9e088d66-1727-4fce-b851-46498225018c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:11:32.248186 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-9e088d66-1727-4fce-b851-46498225018c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:11:32.249701 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-9e088d66-1727-4fce-b851-46498225018c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:11:32.250833 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-9e088d66-1727-4fce-b851-46498225018c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1753 microversion: 2.20 time: 0.153618 Nov 09 20:11:32.251376 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 269/536] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:11:32 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1753 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:11:32.298868 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-dba43eb1-0e1e-4c64-b2ba-476239309e22 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:11:32.299767 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-dba43eb1-0e1e-4c64-b2ba-476239309e22 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:11:32.306117 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-dba43eb1-0e1e-4c64-b2ba-476239309e22 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:32.306563 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-dba43eb1-0e1e-4c64-b2ba-476239309e22 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:32.307326 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-dba43eb1-0e1e-4c64-b2ba-476239309e22 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:32.307754 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-dba43eb1-0e1e-4c64-b2ba-476239309e22 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:32.337282 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-dba43eb1-0e1e-4c64-b2ba-476239309e22 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042092 Nov 09 20:11:32.337832 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 268/537] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:11:32 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:11:33.270072 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-7b80050a-b484-4818-a378-d655ca537c17 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:11:33.270630 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-7b80050a-b484-4818-a378-d655ca537c17 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:11:33.276875 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7b80050a-b484-4818-a378-d655ca537c17 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:33.277325 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7b80050a-b484-4818-a378-d655ca537c17 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:33.278098 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7b80050a-b484-4818-a378-d655ca537c17 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:33.278529 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7b80050a-b484-4818-a378-d655ca537c17 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:33.348885 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-f7973738-3436-4e8b-b493-e9e27ff17bc4 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:11:33.349805 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-f7973738-3436-4e8b-b493-e9e27ff17bc4 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:11:33.356330 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f7973738-3436-4e8b-b493-e9e27ff17bc4 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:33.356677 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f7973738-3436-4e8b-b493-e9e27ff17bc4 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:33.357448 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f7973738-3436-4e8b-b493-e9e27ff17bc4 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:33.357881 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f7973738-3436-4e8b-b493-e9e27ff17bc4 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:33.387970 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-f7973738-3436-4e8b-b493-e9e27ff17bc4 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043170 Nov 09 20:11:33.388567 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 269/538] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:11:33 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 20:11:33.407665 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-7b80050a-b484-4818-a378-d655ca537c17 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:11:33.415679 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-7b80050a-b484-4818-a378-d655ca537c17 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:11:33.417202 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-7b80050a-b484-4818-a378-d655ca537c17 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:11:33.418338 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-7b80050a-b484-4818-a378-d655ca537c17 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1753 microversion: 2.20 time: 0.152696 Nov 09 20:11:33.418889 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 270/539] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:11:33 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1753 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:11:34.399655 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-e7c48b16-24a3-4da0-bd68-39e39c98da93 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:11:34.400581 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-e7c48b16-24a3-4da0-bd68-39e39c98da93 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:11:34.407091 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e7c48b16-24a3-4da0-bd68-39e39c98da93 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:34.407538 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e7c48b16-24a3-4da0-bd68-39e39c98da93 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:34.408312 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e7c48b16-24a3-4da0-bd68-39e39c98da93 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:34.408772 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e7c48b16-24a3-4da0-bd68-39e39c98da93 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:34.436859 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-fb468cff-bb08-4960-9f85-5f2048f64c18 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:11:34.437465 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-fb468cff-bb08-4960-9f85-5f2048f64c18 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:11:34.438150 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-e7c48b16-24a3-4da0-bd68-39e39c98da93 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042195 Nov 09 20:11:34.438704 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 270/540] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:11:34 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:11:34.443499 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fb468cff-bb08-4960-9f85-5f2048f64c18 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:34.443941 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fb468cff-bb08-4960-9f85-5f2048f64c18 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:34.444745 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fb468cff-bb08-4960-9f85-5f2048f64c18 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:34.445193 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fb468cff-bb08-4960-9f85-5f2048f64c18 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:34.572620 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-fb468cff-bb08-4960-9f85-5f2048f64c18 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:11:34.580633 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-fb468cff-bb08-4960-9f85-5f2048f64c18 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:11:34.582738 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-fb468cff-bb08-4960-9f85-5f2048f64c18 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:11:34.583863 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-fb468cff-bb08-4960-9f85-5f2048f64c18 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1753 microversion: 2.20 time: 0.150768 Nov 09 20:11:34.584458 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 271/541] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:11:34 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1753 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 09 20:11:35.449656 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-010fb8c0-dafc-4582-8df9-b02476e9a113 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:11:35.450483 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-010fb8c0-dafc-4582-8df9-b02476e9a113 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:11:35.456731 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-010fb8c0-dafc-4582-8df9-b02476e9a113 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:35.457171 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-010fb8c0-dafc-4582-8df9-b02476e9a113 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:35.458091 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-010fb8c0-dafc-4582-8df9-b02476e9a113 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:35.458521 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-010fb8c0-dafc-4582-8df9-b02476e9a113 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:35.486641 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-010fb8c0-dafc-4582-8df9-b02476e9a113 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040760 Nov 09 20:11:35.487184 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 271/542] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:11:35 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:11:35.602510 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-c285b560-5779-4114-8392-b2fe87027293 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:11:35.603123 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-c285b560-5779-4114-8392-b2fe87027293 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:11:35.609527 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c285b560-5779-4114-8392-b2fe87027293 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:35.609970 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c285b560-5779-4114-8392-b2fe87027293 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:35.610732 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c285b560-5779-4114-8392-b2fe87027293 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:35.611157 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c285b560-5779-4114-8392-b2fe87027293 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:35.744576 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-c285b560-5779-4114-8392-b2fe87027293 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:11:35.752636 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-c285b560-5779-4114-8392-b2fe87027293 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:11:35.754218 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-c285b560-5779-4114-8392-b2fe87027293 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:11:35.755347 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-c285b560-5779-4114-8392-b2fe87027293 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1753 microversion: 2.20 time: 0.156736 Nov 09 20:11:35.755898 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 272/543] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:11:35 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1753 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:11:36.498539 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-17920392-5b59-4d9f-8617-58b9b098918a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:11:36.499437 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-17920392-5b59-4d9f-8617-58b9b098918a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:11:36.506702 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-17920392-5b59-4d9f-8617-58b9b098918a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:36.507148 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-17920392-5b59-4d9f-8617-58b9b098918a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:36.507920 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-17920392-5b59-4d9f-8617-58b9b098918a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:36.508355 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-17920392-5b59-4d9f-8617-58b9b098918a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:36.537167 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-17920392-5b59-4d9f-8617-58b9b098918a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042418 Nov 09 20:11:36.537710 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 272/544] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:11:36 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:11:36.773354 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-4257a479-a9fe-47c0-b26f-9938062d265c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:11:36.773874 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-4257a479-a9fe-47c0-b26f-9938062d265c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:11:36.779986 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4257a479-a9fe-47c0-b26f-9938062d265c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:36.780449 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4257a479-a9fe-47c0-b26f-9938062d265c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:36.781210 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4257a479-a9fe-47c0-b26f-9938062d265c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:36.781634 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4257a479-a9fe-47c0-b26f-9938062d265c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:36.913203 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-4257a479-a9fe-47c0-b26f-9938062d265c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:11:36.921191 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-4257a479-a9fe-47c0-b26f-9938062d265c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:11:36.922663 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-4257a479-a9fe-47c0-b26f-9938062d265c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:11:36.923822 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-4257a479-a9fe-47c0-b26f-9938062d265c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1753 microversion: 2.20 time: 0.154209 Nov 09 20:11:36.924353 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 273/545] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:11:36 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1753 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:11:37.548472 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-dedbfe2d-1846-4185-93c7-71e792705e55 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:11:37.549306 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-dedbfe2d-1846-4185-93c7-71e792705e55 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:11:37.556194 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-dedbfe2d-1846-4185-93c7-71e792705e55 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:37.556663 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-dedbfe2d-1846-4185-93c7-71e792705e55 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:37.557425 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-dedbfe2d-1846-4185-93c7-71e792705e55 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:37.557852 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-dedbfe2d-1846-4185-93c7-71e792705e55 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:37.585853 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-dedbfe2d-1846-4185-93c7-71e792705e55 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041256 Nov 09 20:11:37.586394 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 273/546] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:11:37 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:11:37.943026 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-15f18532-de04-4628-a062-1c7f29eaf18a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:11:37.943625 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-15f18532-de04-4628-a062-1c7f29eaf18a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:11:37.949825 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-15f18532-de04-4628-a062-1c7f29eaf18a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:37.950273 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-15f18532-de04-4628-a062-1c7f29eaf18a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:37.951041 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-15f18532-de04-4628-a062-1c7f29eaf18a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:37.951453 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-15f18532-de04-4628-a062-1c7f29eaf18a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:38.083749 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-15f18532-de04-4628-a062-1c7f29eaf18a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:11:38.091915 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-15f18532-de04-4628-a062-1c7f29eaf18a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:11:38.093425 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-15f18532-de04-4628-a062-1c7f29eaf18a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:11:38.094546 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-15f18532-de04-4628-a062-1c7f29eaf18a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1753 microversion: 2.20 time: 0.155812 Nov 09 20:11:38.095126 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 274/547] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:11:37 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1753 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:11:38.596837 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-54c32876-8f6a-467c-a20d-bcd001382b46 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:11:38.597735 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-54c32876-8f6a-467c-a20d-bcd001382b46 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:11:38.604132 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-54c32876-8f6a-467c-a20d-bcd001382b46 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:38.604603 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-54c32876-8f6a-467c-a20d-bcd001382b46 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:38.605402 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-54c32876-8f6a-467c-a20d-bcd001382b46 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:38.605822 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-54c32876-8f6a-467c-a20d-bcd001382b46 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:38.634044 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-54c32876-8f6a-467c-a20d-bcd001382b46 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040875 Nov 09 20:11:38.634590 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 274/548] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:11:38 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:11:39.113462 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-175ea952-e448-4349-a349-4a7ec91ff53c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:11:39.114273 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-175ea952-e448-4349-a349-4a7ec91ff53c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:11:39.120858 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-175ea952-e448-4349-a349-4a7ec91ff53c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:39.121304 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-175ea952-e448-4349-a349-4a7ec91ff53c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:39.122072 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-175ea952-e448-4349-a349-4a7ec91ff53c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:39.122503 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-175ea952-e448-4349-a349-4a7ec91ff53c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:39.249371 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-175ea952-e448-4349-a349-4a7ec91ff53c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:11:39.257646 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-175ea952-e448-4349-a349-4a7ec91ff53c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:11:39.259135 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-175ea952-e448-4349-a349-4a7ec91ff53c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:11:39.260274 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-175ea952-e448-4349-a349-4a7ec91ff53c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1753 microversion: 2.20 time: 0.151224 Nov 09 20:11:39.260863 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 275/549] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:11:39 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1753 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:11:39.645598 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-289b13af-c001-490b-8b23-3de588f6653d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:11:39.646534 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-289b13af-c001-490b-8b23-3de588f6653d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:11:39.652742 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-289b13af-c001-490b-8b23-3de588f6653d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:39.653189 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-289b13af-c001-490b-8b23-3de588f6653d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:39.653960 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-289b13af-c001-490b-8b23-3de588f6653d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:39.654390 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-289b13af-c001-490b-8b23-3de588f6653d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:39.683086 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-289b13af-c001-490b-8b23-3de588f6653d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042132 Nov 09 20:11:39.683629 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 275/550] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:11:39 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:11:40.278506 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-cea66a5c-5dfb-4edd-882c-0ffaecc4cff2 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:11:40.279026 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-cea66a5c-5dfb-4edd-882c-0ffaecc4cff2 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:11:40.285434 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cea66a5c-5dfb-4edd-882c-0ffaecc4cff2 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:40.285878 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cea66a5c-5dfb-4edd-882c-0ffaecc4cff2 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:40.286650 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cea66a5c-5dfb-4edd-882c-0ffaecc4cff2 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:40.287075 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cea66a5c-5dfb-4edd-882c-0ffaecc4cff2 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:40.415761 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-cea66a5c-5dfb-4edd-882c-0ffaecc4cff2 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:11:40.423707 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-cea66a5c-5dfb-4edd-882c-0ffaecc4cff2 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:11:40.425798 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-cea66a5c-5dfb-4edd-882c-0ffaecc4cff2 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:11:40.427112 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-cea66a5c-5dfb-4edd-882c-0ffaecc4cff2 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1753 microversion: 2.20 time: 0.152343 Nov 09 20:11:40.427658 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 276/551] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:11:40 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1753 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:11:40.694123 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-27ecff98-55ed-49cb-a3be-866e6daa7994 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:11:40.695025 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-27ecff98-55ed-49cb-a3be-866e6daa7994 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:11:40.701168 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-27ecff98-55ed-49cb-a3be-866e6daa7994 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:40.701607 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-27ecff98-55ed-49cb-a3be-866e6daa7994 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:40.702366 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-27ecff98-55ed-49cb-a3be-866e6daa7994 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:40.702792 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-27ecff98-55ed-49cb-a3be-866e6daa7994 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:40.730967 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-27ecff98-55ed-49cb-a3be-866e6daa7994 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040613 Nov 09 20:11:40.731505 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 276/552] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:11:40 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:11:41.445604 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-74966519-2e7d-4946-ac60-07cb9bdadceb tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:11:41.446225 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-74966519-2e7d-4946-ac60-07cb9bdadceb tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:11:41.452377 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-74966519-2e7d-4946-ac60-07cb9bdadceb tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:41.452847 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-74966519-2e7d-4946-ac60-07cb9bdadceb tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:41.453608 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-74966519-2e7d-4946-ac60-07cb9bdadceb tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:41.454035 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-74966519-2e7d-4946-ac60-07cb9bdadceb tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:41.580414 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-74966519-2e7d-4946-ac60-07cb9bdadceb tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:11:41.589036 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-74966519-2e7d-4946-ac60-07cb9bdadceb tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:11:41.590520 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-74966519-2e7d-4946-ac60-07cb9bdadceb tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:11:41.591692 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-74966519-2e7d-4946-ac60-07cb9bdadceb tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1753 microversion: 2.20 time: 0.149761 Nov 09 20:11:41.592246 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 277/553] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:11:41 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1753 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:11:41.741734 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-8c9feb78-920b-4e68-bd16-3745941dc82e tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:11:41.742628 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-8c9feb78-920b-4e68-bd16-3745941dc82e tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:11:41.748801 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-8c9feb78-920b-4e68-bd16-3745941dc82e tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:41.749249 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-8c9feb78-920b-4e68-bd16-3745941dc82e tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:41.750007 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-8c9feb78-920b-4e68-bd16-3745941dc82e tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:41.750434 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-8c9feb78-920b-4e68-bd16-3745941dc82e tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:41.778441 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-8c9feb78-920b-4e68-bd16-3745941dc82e tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040948 Nov 09 20:11:41.778984 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 277/554] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:11:41 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:11:42.610110 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-dcb70828-f398-476f-a7a4-838f4e6738b3 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:11:42.610708 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-dcb70828-f398-476f-a7a4-838f4e6738b3 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:11:42.617229 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-dcb70828-f398-476f-a7a4-838f4e6738b3 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:42.617673 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-dcb70828-f398-476f-a7a4-838f4e6738b3 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:42.618433 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-dcb70828-f398-476f-a7a4-838f4e6738b3 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:42.618862 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-dcb70828-f398-476f-a7a4-838f4e6738b3 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:42.746203 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-dcb70828-f398-476f-a7a4-838f4e6738b3 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:11:42.755128 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-dcb70828-f398-476f-a7a4-838f4e6738b3 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:11:42.756644 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-dcb70828-f398-476f-a7a4-838f4e6738b3 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:11:42.757784 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-dcb70828-f398-476f-a7a4-838f4e6738b3 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1753 microversion: 2.20 time: 0.151394 Nov 09 20:11:42.758340 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 278/555] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:11:42 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1753 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:11:42.789647 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-7bcec77e-aec3-470b-a560-965b31c1df2b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:11:42.790574 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-7bcec77e-aec3-470b-a560-965b31c1df2b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:11:42.796740 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-7bcec77e-aec3-470b-a560-965b31c1df2b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:42.797183 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-7bcec77e-aec3-470b-a560-965b31c1df2b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:42.797946 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-7bcec77e-aec3-470b-a560-965b31c1df2b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:42.798373 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-7bcec77e-aec3-470b-a560-965b31c1df2b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:42.827046 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-7bcec77e-aec3-470b-a560-965b31c1df2b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041079 Nov 09 20:11:42.827587 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 278/556] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:11:42 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:11:43.776096 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-4d348e76-93e8-4485-8883-b981d69ec440 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:11:43.777253 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-4d348e76-93e8-4485-8883-b981d69ec440 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:11:43.783744 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4d348e76-93e8-4485-8883-b981d69ec440 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:43.784195 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4d348e76-93e8-4485-8883-b981d69ec440 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:43.784992 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4d348e76-93e8-4485-8883-b981d69ec440 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:43.785932 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4d348e76-93e8-4485-8883-b981d69ec440 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:43.838446 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-79b4eade-b9c8-4a5b-90a8-381aae75c7b0 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:11:43.839344 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-79b4eade-b9c8-4a5b-90a8-381aae75c7b0 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:11:43.845563 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-79b4eade-b9c8-4a5b-90a8-381aae75c7b0 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:43.846005 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-79b4eade-b9c8-4a5b-90a8-381aae75c7b0 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:43.846777 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-79b4eade-b9c8-4a5b-90a8-381aae75c7b0 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:43.847199 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-79b4eade-b9c8-4a5b-90a8-381aae75c7b0 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:43.878289 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-79b4eade-b9c8-4a5b-90a8-381aae75c7b0 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043579 Nov 09 20:11:43.878849 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 279/557] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:11:43 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 20:11:43.917945 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-4d348e76-93e8-4485-8883-b981d69ec440 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:11:43.926010 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-4d348e76-93e8-4485-8883-b981d69ec440 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:11:43.927474 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-4d348e76-93e8-4485-8883-b981d69ec440 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:11:43.928650 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-4d348e76-93e8-4485-8883-b981d69ec440 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1753 microversion: 2.20 time: 0.156279 Nov 09 20:11:43.929205 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 279/558] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:11:43 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1753 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:11:44.890256 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-ae667518-ff23-41d9-b7de-a301d3df844c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:11:44.891208 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-ae667518-ff23-41d9-b7de-a301d3df844c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:11:44.898116 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ae667518-ff23-41d9-b7de-a301d3df844c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:44.898580 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ae667518-ff23-41d9-b7de-a301d3df844c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:44.899352 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ae667518-ff23-41d9-b7de-a301d3df844c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:44.899788 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ae667518-ff23-41d9-b7de-a301d3df844c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:44.930211 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-ae667518-ff23-41d9-b7de-a301d3df844c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043802 Nov 09 20:11:44.930782 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 280/559] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:11:44 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:11:44.949899 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-fc9ae639-8a34-49c2-ab41-588cd8e8f5e3 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:11:44.950878 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-fc9ae639-8a34-49c2-ab41-588cd8e8f5e3 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:11:44.956879 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fc9ae639-8a34-49c2-ab41-588cd8e8f5e3 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:44.957358 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fc9ae639-8a34-49c2-ab41-588cd8e8f5e3 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:44.958131 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fc9ae639-8a34-49c2-ab41-588cd8e8f5e3 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:44.958558 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fc9ae639-8a34-49c2-ab41-588cd8e8f5e3 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:45.093923 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-fc9ae639-8a34-49c2-ab41-588cd8e8f5e3 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:11:45.104596 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-fc9ae639-8a34-49c2-ab41-588cd8e8f5e3 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:11:45.106082 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-fc9ae639-8a34-49c2-ab41-588cd8e8f5e3 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:11:45.107598 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-fc9ae639-8a34-49c2-ab41-588cd8e8f5e3 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1753 microversion: 2.20 time: 0.161227 Nov 09 20:11:45.108362 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 280/560] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:11:44 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1753 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:11:45.944589 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-5fe9f9cf-bfad-4c94-8ebf-12b181bd1d50 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:11:45.945484 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-5fe9f9cf-bfad-4c94-8ebf-12b181bd1d50 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:11:45.951412 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-5fe9f9cf-bfad-4c94-8ebf-12b181bd1d50 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:45.951855 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-5fe9f9cf-bfad-4c94-8ebf-12b181bd1d50 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:45.952646 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-5fe9f9cf-bfad-4c94-8ebf-12b181bd1d50 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:45.953137 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-5fe9f9cf-bfad-4c94-8ebf-12b181bd1d50 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:45.982352 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-5fe9f9cf-bfad-4c94-8ebf-12b181bd1d50 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042311 Nov 09 20:11:45.982891 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 281/561] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:11:45 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:11:46.126712 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-3c48a951-4054-499a-8537-16a2419cd3d3 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:11:46.127302 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-3c48a951-4054-499a-8537-16a2419cd3d3 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:11:46.134185 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3c48a951-4054-499a-8537-16a2419cd3d3 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:46.134622 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3c48a951-4054-499a-8537-16a2419cd3d3 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:46.135380 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3c48a951-4054-499a-8537-16a2419cd3d3 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:46.135805 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3c48a951-4054-499a-8537-16a2419cd3d3 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:46.268141 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-3c48a951-4054-499a-8537-16a2419cd3d3 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:11:46.276324 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-3c48a951-4054-499a-8537-16a2419cd3d3 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:11:46.277860 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-3c48a951-4054-499a-8537-16a2419cd3d3 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:11:46.278998 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-3c48a951-4054-499a-8537-16a2419cd3d3 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1753 microversion: 2.20 time: 0.155954 Nov 09 20:11:46.279737 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 281/562] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:11:46 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1753 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:11:46.992957 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-f37eb75d-efad-4b25-93b9-f9e5d1752f6c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:11:46.993837 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-f37eb75d-efad-4b25-93b9-f9e5d1752f6c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:11:47.000099 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f37eb75d-efad-4b25-93b9-f9e5d1752f6c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:47.000594 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f37eb75d-efad-4b25-93b9-f9e5d1752f6c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:47.001370 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f37eb75d-efad-4b25-93b9-f9e5d1752f6c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:47.001802 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f37eb75d-efad-4b25-93b9-f9e5d1752f6c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:47.030223 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-f37eb75d-efad-4b25-93b9-f9e5d1752f6c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041152 Nov 09 20:11:47.030765 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 282/563] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:11:46 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:11:47.301257 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-3b3a177a-a949-4c6d-9b7e-3dc3f43b675e tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:11:47.301886 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-3b3a177a-a949-4c6d-9b7e-3dc3f43b675e tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:11:47.308230 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3b3a177a-a949-4c6d-9b7e-3dc3f43b675e tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:47.308765 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3b3a177a-a949-4c6d-9b7e-3dc3f43b675e tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:47.309598 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3b3a177a-a949-4c6d-9b7e-3dc3f43b675e tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:47.310031 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3b3a177a-a949-4c6d-9b7e-3dc3f43b675e tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:47.438416 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-3b3a177a-a949-4c6d-9b7e-3dc3f43b675e tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:11:47.447275 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-3b3a177a-a949-4c6d-9b7e-3dc3f43b675e tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:11:47.448776 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-3b3a177a-a949-4c6d-9b7e-3dc3f43b675e tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:11:47.449912 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-3b3a177a-a949-4c6d-9b7e-3dc3f43b675e tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1753 microversion: 2.20 time: 0.152403 Nov 09 20:11:47.450461 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 282/564] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:11:47 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1753 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:11:48.042080 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-68654dbd-37ab-4527-9320-9b90c585c3ca tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:11:48.043008 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-68654dbd-37ab-4527-9320-9b90c585c3ca tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:11:48.049363 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-68654dbd-37ab-4527-9320-9b90c585c3ca tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:48.049816 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-68654dbd-37ab-4527-9320-9b90c585c3ca tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:48.050592 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-68654dbd-37ab-4527-9320-9b90c585c3ca tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:48.051654 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-68654dbd-37ab-4527-9320-9b90c585c3ca tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:48.080186 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-68654dbd-37ab-4527-9320-9b90c585c3ca tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041764 Nov 09 20:11:48.080772 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 283/565] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:11:48 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:11:48.468648 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-2a679bc7-3920-4c28-9e89-589ccd516d04 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:11:48.469371 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-2a679bc7-3920-4c28-9e89-589ccd516d04 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:11:48.476628 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2a679bc7-3920-4c28-9e89-589ccd516d04 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:48.477273 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2a679bc7-3920-4c28-9e89-589ccd516d04 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:48.478054 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2a679bc7-3920-4c28-9e89-589ccd516d04 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:48.478491 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2a679bc7-3920-4c28-9e89-589ccd516d04 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:48.607500 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-2a679bc7-3920-4c28-9e89-589ccd516d04 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:11:48.616038 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-2a679bc7-3920-4c28-9e89-589ccd516d04 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:11:48.617554 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-2a679bc7-3920-4c28-9e89-589ccd516d04 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:11:48.618726 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-2a679bc7-3920-4c28-9e89-589ccd516d04 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1753 microversion: 2.20 time: 0.153928 Nov 09 20:11:48.619277 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 283/566] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:11:48 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1753 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:11:49.092064 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-e90aee48-8417-4bf5-ab7c-34533e52080f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:11:49.093015 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-e90aee48-8417-4bf5-ab7c-34533e52080f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:11:49.100812 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e90aee48-8417-4bf5-ab7c-34533e52080f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:49.101586 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e90aee48-8417-4bf5-ab7c-34533e52080f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:49.102069 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e90aee48-8417-4bf5-ab7c-34533e52080f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:49.102508 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e90aee48-8417-4bf5-ab7c-34533e52080f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:49.133348 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-e90aee48-8417-4bf5-ab7c-34533e52080f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044943 Nov 09 20:11:49.133902 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 284/567] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:11:49 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:11:49.636493 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-3a4d6699-a9b4-46c6-8feb-862a091c4e34 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:11:49.637092 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-3a4d6699-a9b4-46c6-8feb-862a091c4e34 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:11:49.643451 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3a4d6699-a9b4-46c6-8feb-862a091c4e34 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:49.643898 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3a4d6699-a9b4-46c6-8feb-862a091c4e34 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:49.645329 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3a4d6699-a9b4-46c6-8feb-862a091c4e34 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:49.645758 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3a4d6699-a9b4-46c6-8feb-862a091c4e34 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:49.789789 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-3a4d6699-a9b4-46c6-8feb-862a091c4e34 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:11:49.796164 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-3a4d6699-a9b4-46c6-8feb-862a091c4e34 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:11:49.797654 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-3a4d6699-a9b4-46c6-8feb-862a091c4e34 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:11:49.798797 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-3a4d6699-a9b4-46c6-8feb-862a091c4e34 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1753 microversion: 2.20 time: 0.165953 Nov 09 20:11:49.799344 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 284/568] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:11:49 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1753 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:11:50.144849 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-5ed2354f-e8b1-49a2-9cdc-e33d6ddb4f54 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:11:50.145799 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-5ed2354f-e8b1-49a2-9cdc-e33d6ddb4f54 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:11:50.151959 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-5ed2354f-e8b1-49a2-9cdc-e33d6ddb4f54 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:50.152431 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-5ed2354f-e8b1-49a2-9cdc-e33d6ddb4f54 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:50.153210 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-5ed2354f-e8b1-49a2-9cdc-e33d6ddb4f54 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:50.153642 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-5ed2354f-e8b1-49a2-9cdc-e33d6ddb4f54 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:50.182134 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-5ed2354f-e8b1-49a2-9cdc-e33d6ddb4f54 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041205 Nov 09 20:11:50.182688 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 285/569] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:11:50 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:11:50.817008 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-b9f9ad9b-29b5-4a88-8b76-9582a0de8053 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:11:50.817599 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-b9f9ad9b-29b5-4a88-8b76-9582a0de8053 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:11:50.824202 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b9f9ad9b-29b5-4a88-8b76-9582a0de8053 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:50.824670 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b9f9ad9b-29b5-4a88-8b76-9582a0de8053 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:50.825442 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b9f9ad9b-29b5-4a88-8b76-9582a0de8053 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:50.825865 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b9f9ad9b-29b5-4a88-8b76-9582a0de8053 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:50.955535 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-b9f9ad9b-29b5-4a88-8b76-9582a0de8053 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:11:50.964773 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-b9f9ad9b-29b5-4a88-8b76-9582a0de8053 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:11:50.966249 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-b9f9ad9b-29b5-4a88-8b76-9582a0de8053 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:11:50.967388 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-b9f9ad9b-29b5-4a88-8b76-9582a0de8053 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1753 microversion: 2.20 time: 0.154228 Nov 09 20:11:50.967942 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 285/570] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:11:50 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1753 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:11:51.193970 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-d573e3df-e217-4fff-a050-c4115c2f7f83 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:11:51.194873 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-d573e3df-e217-4fff-a050-c4115c2f7f83 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:11:51.201463 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d573e3df-e217-4fff-a050-c4115c2f7f83 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:51.201926 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d573e3df-e217-4fff-a050-c4115c2f7f83 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:51.203529 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d573e3df-e217-4fff-a050-c4115c2f7f83 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:51.204027 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d573e3df-e217-4fff-a050-c4115c2f7f83 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:51.234051 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-d573e3df-e217-4fff-a050-c4115c2f7f83 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044334 Nov 09 20:11:51.234615 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 286/571] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:11:51 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:11:51.986664 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-d9c2231e-7d1c-4345-9a46-e4948df5d141 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:11:51.987256 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-d9c2231e-7d1c-4345-9a46-e4948df5d141 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:11:51.994314 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d9c2231e-7d1c-4345-9a46-e4948df5d141 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:51.994751 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d9c2231e-7d1c-4345-9a46-e4948df5d141 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:51.995508 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d9c2231e-7d1c-4345-9a46-e4948df5d141 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:51.995932 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d9c2231e-7d1c-4345-9a46-e4948df5d141 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:52.124795 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-d9c2231e-7d1c-4345-9a46-e4948df5d141 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:11:52.132749 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-d9c2231e-7d1c-4345-9a46-e4948df5d141 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:11:52.134229 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-d9c2231e-7d1c-4345-9a46-e4948df5d141 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:11:52.135358 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-d9c2231e-7d1c-4345-9a46-e4948df5d141 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1753 microversion: 2.20 time: 0.152321 Nov 09 20:11:52.135908 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 286/572] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:11:51 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1753 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:11:52.245265 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-7f8649df-45b8-49c4-9fac-c2d6b5c12836 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:11:52.246214 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-7f8649df-45b8-49c4-9fac-c2d6b5c12836 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:11:52.252345 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-7f8649df-45b8-49c4-9fac-c2d6b5c12836 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:52.252818 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-7f8649df-45b8-49c4-9fac-c2d6b5c12836 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:52.253612 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-7f8649df-45b8-49c4-9fac-c2d6b5c12836 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:52.254057 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-7f8649df-45b8-49c4-9fac-c2d6b5c12836 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:52.282444 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-7f8649df-45b8-49c4-9fac-c2d6b5c12836 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040861 Nov 09 20:11:52.282987 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 287/573] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:11:52 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:11:53.153570 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-d4b6b521-2d2b-4bec-a382-f2d1b746b1d2 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:11:53.154084 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-d4b6b521-2d2b-4bec-a382-f2d1b746b1d2 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:11:53.160214 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d4b6b521-2d2b-4bec-a382-f2d1b746b1d2 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:53.160701 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d4b6b521-2d2b-4bec-a382-f2d1b746b1d2 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:53.161556 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d4b6b521-2d2b-4bec-a382-f2d1b746b1d2 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:53.161981 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d4b6b521-2d2b-4bec-a382-f2d1b746b1d2 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:53.290784 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-d4b6b521-2d2b-4bec-a382-f2d1b746b1d2 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:11:53.294302 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-7fc976fb-89d1-4cc1-b60b-9ef603368766 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:11:53.295208 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-7fc976fb-89d1-4cc1-b60b-9ef603368766 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:11:53.299254 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-d4b6b521-2d2b-4bec-a382-f2d1b746b1d2 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:11:53.301392 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-d4b6b521-2d2b-4bec-a382-f2d1b746b1d2 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:11:53.302178 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-7fc976fb-89d1-4cc1-b60b-9ef603368766 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:53.302633 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-7fc976fb-89d1-4cc1-b60b-9ef603368766 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:53.302807 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-d4b6b521-2d2b-4bec-a382-f2d1b746b1d2 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1753 microversion: 2.20 time: 0.153092 Nov 09 20:11:53.303367 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 287/574] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:11:53 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1753 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:11:53.303473 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-7fc976fb-89d1-4cc1-b60b-9ef603368766 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:53.303826 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-7fc976fb-89d1-4cc1-b60b-9ef603368766 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:53.331667 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-7fc976fb-89d1-4cc1-b60b-9ef603368766 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041470 Nov 09 20:11:53.332318 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 288/575] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:11:53 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 20:11:54.321377 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-75814494-decf-43d4-a7e5-be2df12dccdd tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:11:54.321971 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-75814494-decf-43d4-a7e5-be2df12dccdd tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:11:54.328036 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-75814494-decf-43d4-a7e5-be2df12dccdd tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:54.328514 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-75814494-decf-43d4-a7e5-be2df12dccdd tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:54.329275 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-75814494-decf-43d4-a7e5-be2df12dccdd tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:54.329696 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-75814494-decf-43d4-a7e5-be2df12dccdd tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:54.342751 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-ce6ebc45-3213-4060-aaf7-58ecd715e204 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:11:54.343713 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-ce6ebc45-3213-4060-aaf7-58ecd715e204 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:11:54.350692 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ce6ebc45-3213-4060-aaf7-58ecd715e204 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:54.351300 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ce6ebc45-3213-4060-aaf7-58ecd715e204 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:54.352078 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ce6ebc45-3213-4060-aaf7-58ecd715e204 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:54.352541 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ce6ebc45-3213-4060-aaf7-58ecd715e204 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:54.383539 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-ce6ebc45-3213-4060-aaf7-58ecd715e204 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044415 Nov 09 20:11:54.384101 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 289/576] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:11:54 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 20:11:54.458935 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-75814494-decf-43d4-a7e5-be2df12dccdd tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:11:54.466917 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-75814494-decf-43d4-a7e5-be2df12dccdd tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:11:54.468394 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-75814494-decf-43d4-a7e5-be2df12dccdd tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:11:54.469545 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-75814494-decf-43d4-a7e5-be2df12dccdd tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1753 microversion: 2.20 time: 0.151807 Nov 09 20:11:54.470098 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 288/577] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:11:54 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1753 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:11:55.395484 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-2d92c561-81d9-4cef-b449-ee0807b7d6dc tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:11:55.396381 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-2d92c561-81d9-4cef-b449-ee0807b7d6dc tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:11:55.402530 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-2d92c561-81d9-4cef-b449-ee0807b7d6dc tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:55.402988 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-2d92c561-81d9-4cef-b449-ee0807b7d6dc tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:55.403733 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-2d92c561-81d9-4cef-b449-ee0807b7d6dc tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:55.404156 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-2d92c561-81d9-4cef-b449-ee0807b7d6dc tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:55.433500 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-2d92c561-81d9-4cef-b449-ee0807b7d6dc tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042379 Nov 09 20:11:55.434041 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 290/578] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:11:55 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:11:55.488189 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-49298025-0a46-427c-bce8-359cc9221c56 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:11:55.488914 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-49298025-0a46-427c-bce8-359cc9221c56 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:11:55.494993 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-49298025-0a46-427c-bce8-359cc9221c56 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:55.495429 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-49298025-0a46-427c-bce8-359cc9221c56 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:55.496183 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-49298025-0a46-427c-bce8-359cc9221c56 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:55.496640 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-49298025-0a46-427c-bce8-359cc9221c56 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:55.622178 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-49298025-0a46-427c-bce8-359cc9221c56 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:11:55.630821 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-49298025-0a46-427c-bce8-359cc9221c56 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:11:55.632318 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-49298025-0a46-427c-bce8-359cc9221c56 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:11:55.633487 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-49298025-0a46-427c-bce8-359cc9221c56 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1753 microversion: 2.20 time: 0.148982 Nov 09 20:11:55.634051 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 289/579] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:11:55 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1753 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:11:56.444914 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-6f6d5f62-5214-4e51-98bc-0cc2c5199874 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:11:56.445934 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-6f6d5f62-5214-4e51-98bc-0cc2c5199874 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:11:56.452154 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6f6d5f62-5214-4e51-98bc-0cc2c5199874 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:56.452636 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6f6d5f62-5214-4e51-98bc-0cc2c5199874 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:56.453401 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6f6d5f62-5214-4e51-98bc-0cc2c5199874 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:56.453826 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6f6d5f62-5214-4e51-98bc-0cc2c5199874 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:56.482125 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-6f6d5f62-5214-4e51-98bc-0cc2c5199874 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041030 Nov 09 20:11:56.482663 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 291/580] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:11:56 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:11:56.651537 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-89218d24-17d4-476a-8986-00d96a9b0379 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:11:56.652134 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-89218d24-17d4-476a-8986-00d96a9b0379 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:11:56.658196 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-89218d24-17d4-476a-8986-00d96a9b0379 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:56.658645 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-89218d24-17d4-476a-8986-00d96a9b0379 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:56.659404 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-89218d24-17d4-476a-8986-00d96a9b0379 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:56.659830 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-89218d24-17d4-476a-8986-00d96a9b0379 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:56.786988 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-89218d24-17d4-476a-8986-00d96a9b0379 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:11:56.795227 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-89218d24-17d4-476a-8986-00d96a9b0379 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:11:56.796793 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-89218d24-17d4-476a-8986-00d96a9b0379 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:11:56.798017 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-89218d24-17d4-476a-8986-00d96a9b0379 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1753 microversion: 2.20 time: 0.150185 Nov 09 20:11:56.798640 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 290/581] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:11:56 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1753 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:11:57.494078 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-c1dfdab9-eb1f-4f78-83d3-0075b7d7ae5c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:11:57.495013 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-c1dfdab9-eb1f-4f78-83d3-0075b7d7ae5c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:11:57.501178 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c1dfdab9-eb1f-4f78-83d3-0075b7d7ae5c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:57.501618 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c1dfdab9-eb1f-4f78-83d3-0075b7d7ae5c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:57.502377 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c1dfdab9-eb1f-4f78-83d3-0075b7d7ae5c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:57.502839 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c1dfdab9-eb1f-4f78-83d3-0075b7d7ae5c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:57.531478 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-c1dfdab9-eb1f-4f78-83d3-0075b7d7ae5c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041346 Nov 09 20:11:57.532028 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 292/582] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:11:57 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:11:57.815859 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-81b3b358-de05-4633-b960-0bb22228911a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:11:57.816568 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-81b3b358-de05-4633-b960-0bb22228911a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:11:57.822822 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-81b3b358-de05-4633-b960-0bb22228911a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:57.823265 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-81b3b358-de05-4633-b960-0bb22228911a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:57.824027 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-81b3b358-de05-4633-b960-0bb22228911a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:57.824487 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-81b3b358-de05-4633-b960-0bb22228911a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:57.957995 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-81b3b358-de05-4633-b960-0bb22228911a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:11:57.965981 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-81b3b358-de05-4633-b960-0bb22228911a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:11:57.967473 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-81b3b358-de05-4633-b960-0bb22228911a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:11:57.968638 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-81b3b358-de05-4633-b960-0bb22228911a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1753 microversion: 2.20 time: 0.156561 Nov 09 20:11:57.969192 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 291/583] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:11:57 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1753 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:11:58.542803 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-f051992b-0c22-4225-aa3f-14b853aaf933 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:11:58.543626 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-f051992b-0c22-4225-aa3f-14b853aaf933 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:11:58.549822 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f051992b-0c22-4225-aa3f-14b853aaf933 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:58.550258 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f051992b-0c22-4225-aa3f-14b853aaf933 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:58.551248 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f051992b-0c22-4225-aa3f-14b853aaf933 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:58.551671 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f051992b-0c22-4225-aa3f-14b853aaf933 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:58.579705 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-f051992b-0c22-4225-aa3f-14b853aaf933 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040702 Nov 09 20:11:58.580236 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 293/584] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:11:58 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:11:58.986789 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-a4c9e00d-76d8-4745-8d14-4a52ad537bd8 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:11:58.987381 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-a4c9e00d-76d8-4745-8d14-4a52ad537bd8 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:11:58.994089 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a4c9e00d-76d8-4745-8d14-4a52ad537bd8 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:58.994529 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a4c9e00d-76d8-4745-8d14-4a52ad537bd8 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:58.995289 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a4c9e00d-76d8-4745-8d14-4a52ad537bd8 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:58.995710 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a4c9e00d-76d8-4745-8d14-4a52ad537bd8 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:59.122872 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-a4c9e00d-76d8-4745-8d14-4a52ad537bd8 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:11:59.132095 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-a4c9e00d-76d8-4745-8d14-4a52ad537bd8 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:11:59.133683 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-a4c9e00d-76d8-4745-8d14-4a52ad537bd8 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:11:59.134818 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-a4c9e00d-76d8-4745-8d14-4a52ad537bd8 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1753 microversion: 2.20 time: 0.151752 Nov 09 20:11:59.135374 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 292/585] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:11:58 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1753 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:11:59.590953 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-daeb8249-930a-4a26-ab3d-0d6610456bd8 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:11:59.591896 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-daeb8249-930a-4a26-ab3d-0d6610456bd8 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:11:59.598718 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-daeb8249-930a-4a26-ab3d-0d6610456bd8 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:59.599155 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-daeb8249-930a-4a26-ab3d-0d6610456bd8 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:59.599918 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-daeb8249-930a-4a26-ab3d-0d6610456bd8 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:11:59.600343 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-daeb8249-930a-4a26-ab3d-0d6610456bd8 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:11:59.628683 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-daeb8249-930a-4a26-ab3d-0d6610456bd8 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041396 Nov 09 20:11:59.629232 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 294/586] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:11:59 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:12:00.152833 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-645442f6-bece-41ef-81fe-ce6b7d007253 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:12:00.153423 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-645442f6-bece-41ef-81fe-ce6b7d007253 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:12:00.159712 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-645442f6-bece-41ef-81fe-ce6b7d007253 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:00.160158 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-645442f6-bece-41ef-81fe-ce6b7d007253 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:00.160978 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-645442f6-bece-41ef-81fe-ce6b7d007253 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:00.161422 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-645442f6-bece-41ef-81fe-ce6b7d007253 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:00.293929 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-645442f6-bece-41ef-81fe-ce6b7d007253 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:12:00.302200 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-645442f6-bece-41ef-81fe-ce6b7d007253 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:12:00.304076 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-645442f6-bece-41ef-81fe-ce6b7d007253 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:12:00.305278 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-645442f6-bece-41ef-81fe-ce6b7d007253 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1753 microversion: 2.20 time: 0.156082 Nov 09 20:12:00.305831 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 293/587] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:12:00 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1753 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:12:00.639816 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-8e86a6b7-960b-4286-8ff6-d9199a65dc22 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:12:00.640746 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-8e86a6b7-960b-4286-8ff6-d9199a65dc22 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:12:00.647169 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-8e86a6b7-960b-4286-8ff6-d9199a65dc22 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:00.647604 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-8e86a6b7-960b-4286-8ff6-d9199a65dc22 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:00.648365 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-8e86a6b7-960b-4286-8ff6-d9199a65dc22 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:00.648819 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-8e86a6b7-960b-4286-8ff6-d9199a65dc22 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:00.677173 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-8e86a6b7-960b-4286-8ff6-d9199a65dc22 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041024 Nov 09 20:12:00.677711 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 295/588] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:12:00 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:12:01.322755 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-640feead-2361-4a78-94e2-c8d00a93f170 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:12:01.323350 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-640feead-2361-4a78-94e2-c8d00a93f170 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:12:01.329524 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-640feead-2361-4a78-94e2-c8d00a93f170 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:01.329968 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-640feead-2361-4a78-94e2-c8d00a93f170 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:01.330726 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-640feead-2361-4a78-94e2-c8d00a93f170 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:01.331152 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-640feead-2361-4a78-94e2-c8d00a93f170 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:01.456640 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-640feead-2361-4a78-94e2-c8d00a93f170 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:12:01.465218 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-640feead-2361-4a78-94e2-c8d00a93f170 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:12:01.466715 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-640feead-2361-4a78-94e2-c8d00a93f170 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:12:01.467851 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-640feead-2361-4a78-94e2-c8d00a93f170 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1753 microversion: 2.20 time: 0.148708 Nov 09 20:12:01.468444 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 294/589] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:12:01 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1753 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:12:01.688318 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-d23fa675-064f-4ae4-9bdc-1bae76e4cc89 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:12:01.689277 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-d23fa675-064f-4ae4-9bdc-1bae76e4cc89 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:12:01.695999 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d23fa675-064f-4ae4-9bdc-1bae76e4cc89 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:01.696474 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d23fa675-064f-4ae4-9bdc-1bae76e4cc89 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:01.697247 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d23fa675-064f-4ae4-9bdc-1bae76e4cc89 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:01.697674 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d23fa675-064f-4ae4-9bdc-1bae76e4cc89 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:01.726518 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-d23fa675-064f-4ae4-9bdc-1bae76e4cc89 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041886 Nov 09 20:12:01.727059 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 296/590] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:12:01 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:12:02.487007 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-ffe22053-26a6-4675-8bcf-294b73deb8d7 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:12:02.487605 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-ffe22053-26a6-4675-8bcf-294b73deb8d7 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:12:02.494640 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ffe22053-26a6-4675-8bcf-294b73deb8d7 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:02.495090 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ffe22053-26a6-4675-8bcf-294b73deb8d7 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:02.495860 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ffe22053-26a6-4675-8bcf-294b73deb8d7 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:02.496287 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ffe22053-26a6-4675-8bcf-294b73deb8d7 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:02.625726 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-ffe22053-26a6-4675-8bcf-294b73deb8d7 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:12:02.635888 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-ffe22053-26a6-4675-8bcf-294b73deb8d7 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:12:02.637387 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-ffe22053-26a6-4675-8bcf-294b73deb8d7 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:12:02.638513 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-ffe22053-26a6-4675-8bcf-294b73deb8d7 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1753 microversion: 2.20 time: 0.155285 Nov 09 20:12:02.639054 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 295/591] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:12:02 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1753 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 09 20:12:02.737885 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-8227ad71-1abf-48bd-8110-168e563b95e5 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:12:02.739104 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-8227ad71-1abf-48bd-8110-168e563b95e5 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:12:02.745390 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-8227ad71-1abf-48bd-8110-168e563b95e5 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:02.745833 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-8227ad71-1abf-48bd-8110-168e563b95e5 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:02.746589 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-8227ad71-1abf-48bd-8110-168e563b95e5 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:02.747012 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-8227ad71-1abf-48bd-8110-168e563b95e5 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:02.775230 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-8227ad71-1abf-48bd-8110-168e563b95e5 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041017 Nov 09 20:12:02.775772 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 297/592] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:12:02 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:12:03.657520 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-bed242f6-20ea-472e-ae55-7391f68341f3 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:12:03.658118 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-bed242f6-20ea-472e-ae55-7391f68341f3 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:12:03.664466 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bed242f6-20ea-472e-ae55-7391f68341f3 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:03.664909 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bed242f6-20ea-472e-ae55-7391f68341f3 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:03.665671 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bed242f6-20ea-472e-ae55-7391f68341f3 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:03.666092 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bed242f6-20ea-472e-ae55-7391f68341f3 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:03.787708 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-0194a9a0-4d2e-486a-bd3a-739117c6735e tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:12:03.788643 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-0194a9a0-4d2e-486a-bd3a-739117c6735e tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:12:03.795121 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-0194a9a0-4d2e-486a-bd3a-739117c6735e tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:03.795560 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-0194a9a0-4d2e-486a-bd3a-739117c6735e tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:03.796334 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-0194a9a0-4d2e-486a-bd3a-739117c6735e tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:03.796783 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-0194a9a0-4d2e-486a-bd3a-739117c6735e tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:03.797613 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-bed242f6-20ea-472e-ae55-7391f68341f3 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:12:03.806448 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-bed242f6-20ea-472e-ae55-7391f68341f3 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:12:03.807945 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-bed242f6-20ea-472e-ae55-7391f68341f3 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:12:03.809115 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-bed242f6-20ea-472e-ae55-7391f68341f3 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1753 microversion: 2.20 time: 0.155236 Nov 09 20:12:03.809677 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 296/593] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:12:03 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1753 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 09 20:12:03.826165 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-0194a9a0-4d2e-486a-bd3a-739117c6735e tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043467 Nov 09 20:12:03.826708 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 298/594] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:12:03 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 20:12:04.826720 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-a4e7e640-9a55-4322-bc1c-8d04fb373f50 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:12:04.827315 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-a4e7e640-9a55-4322-bc1c-8d04fb373f50 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:12:04.834529 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a4e7e640-9a55-4322-bc1c-8d04fb373f50 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:04.834979 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a4e7e640-9a55-4322-bc1c-8d04fb373f50 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:04.835759 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a4e7e640-9a55-4322-bc1c-8d04fb373f50 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:04.836190 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a4e7e640-9a55-4322-bc1c-8d04fb373f50 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:04.838023 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-2ab10671-23df-4366-9ace-d0448da7deb1 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:12:04.838931 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-2ab10671-23df-4366-9ace-d0448da7deb1 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:12:04.845453 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-2ab10671-23df-4366-9ace-d0448da7deb1 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:04.846100 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-2ab10671-23df-4366-9ace-d0448da7deb1 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:04.847021 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-2ab10671-23df-4366-9ace-d0448da7deb1 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:04.847616 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-2ab10671-23df-4366-9ace-d0448da7deb1 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:04.879612 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-2ab10671-23df-4366-9ace-d0448da7deb1 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044465 Nov 09 20:12:04.880383 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 299/595] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:12:04 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 20:12:04.965844 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-a4e7e640-9a55-4322-bc1c-8d04fb373f50 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:12:04.973849 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-a4e7e640-9a55-4322-bc1c-8d04fb373f50 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:12:04.975354 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-a4e7e640-9a55-4322-bc1c-8d04fb373f50 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:12:04.976498 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-a4e7e640-9a55-4322-bc1c-8d04fb373f50 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1753 microversion: 2.20 time: 0.153444 Nov 09 20:12:04.977074 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 297/596] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:12:04 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1753 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:12:05.890919 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-1c2d99af-ff00-49a1-bcec-2d892fd091de tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:12:05.891863 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-1c2d99af-ff00-49a1-bcec-2d892fd091de tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:12:05.898717 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-1c2d99af-ff00-49a1-bcec-2d892fd091de tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:05.899169 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-1c2d99af-ff00-49a1-bcec-2d892fd091de tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:05.899991 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-1c2d99af-ff00-49a1-bcec-2d892fd091de tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:05.900385 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-1c2d99af-ff00-49a1-bcec-2d892fd091de tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:05.929003 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-1c2d99af-ff00-49a1-bcec-2d892fd091de tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041820 Nov 09 20:12:05.929556 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 300/597] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:12:05 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:12:05.994652 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-2139c265-3aec-4e96-a9fa-7ff4be87303a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:12:05.995240 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-2139c265-3aec-4e96-a9fa-7ff4be87303a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:12:06.001347 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2139c265-3aec-4e96-a9fa-7ff4be87303a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:06.001786 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2139c265-3aec-4e96-a9fa-7ff4be87303a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:06.002539 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2139c265-3aec-4e96-a9fa-7ff4be87303a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:06.002964 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2139c265-3aec-4e96-a9fa-7ff4be87303a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:06.133455 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-2139c265-3aec-4e96-a9fa-7ff4be87303a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:12:06.141512 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-2139c265-3aec-4e96-a9fa-7ff4be87303a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:12:06.143025 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-2139c265-3aec-4e96-a9fa-7ff4be87303a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:12:06.145183 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-2139c265-3aec-4e96-a9fa-7ff4be87303a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1753 microversion: 2.20 time: 0.153147 Nov 09 20:12:06.145741 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 298/598] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:12:05 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1753 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:12:06.940703 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-90e5efdc-5f43-4c90-aace-a852a9159f29 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:12:06.942025 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-90e5efdc-5f43-4c90-aace-a852a9159f29 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:12:06.948344 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-90e5efdc-5f43-4c90-aace-a852a9159f29 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:06.948813 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-90e5efdc-5f43-4c90-aace-a852a9159f29 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:06.949577 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-90e5efdc-5f43-4c90-aace-a852a9159f29 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:06.950005 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-90e5efdc-5f43-4c90-aace-a852a9159f29 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:06.978203 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-90e5efdc-5f43-4c90-aace-a852a9159f29 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041176 Nov 09 20:12:06.978751 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 301/599] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:12:06 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:12:07.163701 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-c806b262-098d-43ad-80dc-753c2ed5d609 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:12:07.164278 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-c806b262-098d-43ad-80dc-753c2ed5d609 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:12:07.170474 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c806b262-098d-43ad-80dc-753c2ed5d609 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:07.170912 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c806b262-098d-43ad-80dc-753c2ed5d609 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:07.171692 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c806b262-098d-43ad-80dc-753c2ed5d609 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:07.172113 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c806b262-098d-43ad-80dc-753c2ed5d609 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:07.299280 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-c806b262-098d-43ad-80dc-753c2ed5d609 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:12:07.307445 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-c806b262-098d-43ad-80dc-753c2ed5d609 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:12:07.308948 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-c806b262-098d-43ad-80dc-753c2ed5d609 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:12:07.310074 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-c806b262-098d-43ad-80dc-753c2ed5d609 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1753 microversion: 2.20 time: 0.150734 Nov 09 20:12:07.310629 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 299/600] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:12:07 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1753 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:12:07.990255 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-bc5cb0e2-fbac-4a43-aad2-9d6ca0736dbb tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:12:07.991165 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-bc5cb0e2-fbac-4a43-aad2-9d6ca0736dbb tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:12:07.997463 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-bc5cb0e2-fbac-4a43-aad2-9d6ca0736dbb tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:07.997938 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-bc5cb0e2-fbac-4a43-aad2-9d6ca0736dbb tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:07.998715 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-bc5cb0e2-fbac-4a43-aad2-9d6ca0736dbb tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:07.999151 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-bc5cb0e2-fbac-4a43-aad2-9d6ca0736dbb tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:08.027843 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-bc5cb0e2-fbac-4a43-aad2-9d6ca0736dbb tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041798 Nov 09 20:12:08.028385 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 302/601] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:12:07 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:12:08.327570 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-3599224e-008d-4ba3-bc8d-f96c5ac206e5 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:12:08.328168 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-3599224e-008d-4ba3-bc8d-f96c5ac206e5 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:12:08.334605 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3599224e-008d-4ba3-bc8d-f96c5ac206e5 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:08.335049 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3599224e-008d-4ba3-bc8d-f96c5ac206e5 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:08.335818 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3599224e-008d-4ba3-bc8d-f96c5ac206e5 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:08.336250 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3599224e-008d-4ba3-bc8d-f96c5ac206e5 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:08.466484 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-3599224e-008d-4ba3-bc8d-f96c5ac206e5 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:12:08.475436 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-3599224e-008d-4ba3-bc8d-f96c5ac206e5 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:12:08.476959 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-3599224e-008d-4ba3-bc8d-f96c5ac206e5 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:12:08.478102 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-3599224e-008d-4ba3-bc8d-f96c5ac206e5 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1753 microversion: 2.20 time: 0.154216 Nov 09 20:12:08.478660 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 300/602] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:12:08 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1753 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:12:09.039197 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-d5884435-01f3-4797-aa2c-ea6fc22ef5b2 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:12:09.040264 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-d5884435-01f3-4797-aa2c-ea6fc22ef5b2 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:12:09.046547 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d5884435-01f3-4797-aa2c-ea6fc22ef5b2 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:09.046990 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d5884435-01f3-4797-aa2c-ea6fc22ef5b2 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:09.047754 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d5884435-01f3-4797-aa2c-ea6fc22ef5b2 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:09.048181 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d5884435-01f3-4797-aa2c-ea6fc22ef5b2 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:09.076100 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-d5884435-01f3-4797-aa2c-ea6fc22ef5b2 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040659 Nov 09 20:12:09.076680 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 303/603] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:12:09 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:12:09.496095 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-398d672b-6696-417d-b158-56768b3e3d03 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:12:09.496721 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-398d672b-6696-417d-b158-56768b3e3d03 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:12:09.503009 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-398d672b-6696-417d-b158-56768b3e3d03 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:09.504165 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-398d672b-6696-417d-b158-56768b3e3d03 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:09.505012 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-398d672b-6696-417d-b158-56768b3e3d03 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:09.505441 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-398d672b-6696-417d-b158-56768b3e3d03 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:09.632576 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-398d672b-6696-417d-b158-56768b3e3d03 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:12:09.641361 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-398d672b-6696-417d-b158-56768b3e3d03 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:12:09.642840 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-398d672b-6696-417d-b158-56768b3e3d03 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:12:09.643981 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-398d672b-6696-417d-b158-56768b3e3d03 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1753 microversion: 2.20 time: 0.151484 Nov 09 20:12:09.644884 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 301/604] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:12:09 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1753 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:12:10.086926 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-414c3205-1f0e-4caf-b06d-281f15d49b89 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:12:10.087837 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-414c3205-1f0e-4caf-b06d-281f15d49b89 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:12:10.094046 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-414c3205-1f0e-4caf-b06d-281f15d49b89 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:10.094497 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-414c3205-1f0e-4caf-b06d-281f15d49b89 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:10.095270 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-414c3205-1f0e-4caf-b06d-281f15d49b89 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:10.095705 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-414c3205-1f0e-4caf-b06d-281f15d49b89 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:10.125783 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-414c3205-1f0e-4caf-b06d-281f15d49b89 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042585 Nov 09 20:12:10.126348 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 304/605] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:12:10 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:12:10.662468 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-40a5a687-fca4-4f0d-a144-8d24b5fde69d tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:12:10.663066 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-40a5a687-fca4-4f0d-a144-8d24b5fde69d tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:12:10.669270 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-40a5a687-fca4-4f0d-a144-8d24b5fde69d tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:10.669748 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-40a5a687-fca4-4f0d-a144-8d24b5fde69d tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:10.670521 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-40a5a687-fca4-4f0d-a144-8d24b5fde69d tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:10.670943 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-40a5a687-fca4-4f0d-a144-8d24b5fde69d tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:10.797080 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-40a5a687-fca4-4f0d-a144-8d24b5fde69d tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:12:10.805510 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-40a5a687-fca4-4f0d-a144-8d24b5fde69d tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:12:10.806997 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-40a5a687-fca4-4f0d-a144-8d24b5fde69d tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:12:10.808126 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-40a5a687-fca4-4f0d-a144-8d24b5fde69d tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1753 microversion: 2.20 time: 0.149497 Nov 09 20:12:10.808717 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 302/606] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:12:10 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1753 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:12:11.136993 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-8c789708-db0d-4b50-992f-feb7b9f20148 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:12:11.137962 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-8c789708-db0d-4b50-992f-feb7b9f20148 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:12:11.144757 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-8c789708-db0d-4b50-992f-feb7b9f20148 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:11.145198 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-8c789708-db0d-4b50-992f-feb7b9f20148 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:11.146016 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-8c789708-db0d-4b50-992f-feb7b9f20148 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:11.146444 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-8c789708-db0d-4b50-992f-feb7b9f20148 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:11.177288 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-8c789708-db0d-4b50-992f-feb7b9f20148 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043932 Nov 09 20:12:11.177855 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 305/607] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:12:11 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:12:11.826535 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-d5dbb279-dc95-4f6d-aeea-064a2c6af9a0 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:12:11.827040 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-d5dbb279-dc95-4f6d-aeea-064a2c6af9a0 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:12:11.834056 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d5dbb279-dc95-4f6d-aeea-064a2c6af9a0 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:11.834494 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d5dbb279-dc95-4f6d-aeea-064a2c6af9a0 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:11.835260 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d5dbb279-dc95-4f6d-aeea-064a2c6af9a0 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:11.835689 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d5dbb279-dc95-4f6d-aeea-064a2c6af9a0 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:11.965402 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-d5dbb279-dc95-4f6d-aeea-064a2c6af9a0 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:12:11.973994 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-d5dbb279-dc95-4f6d-aeea-064a2c6af9a0 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:12:11.975476 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-d5dbb279-dc95-4f6d-aeea-064a2c6af9a0 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:12:11.976640 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-d5dbb279-dc95-4f6d-aeea-064a2c6af9a0 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1753 microversion: 2.20 time: 0.153842 Nov 09 20:12:11.977204 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 303/608] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:12:11 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1753 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:12:12.187650 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-e3fd40bb-497e-4e44-b7f2-78422e92c5ae tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:12:12.188571 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-e3fd40bb-497e-4e44-b7f2-78422e92c5ae tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:12:12.195240 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e3fd40bb-497e-4e44-b7f2-78422e92c5ae tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:12.195674 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e3fd40bb-497e-4e44-b7f2-78422e92c5ae tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:12.196450 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e3fd40bb-497e-4e44-b7f2-78422e92c5ae tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:12.196874 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e3fd40bb-497e-4e44-b7f2-78422e92c5ae tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:12.225050 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-e3fd40bb-497e-4e44-b7f2-78422e92c5ae tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041114 Nov 09 20:12:12.225585 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 306/609] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:12:12 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:12:12.995348 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-0d71f344-74aa-44a8-a04f-1f1c57bd14dc tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:12:12.995929 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-0d71f344-74aa-44a8-a04f-1f1c57bd14dc tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:12:13.002058 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0d71f344-74aa-44a8-a04f-1f1c57bd14dc tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:13.002492 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0d71f344-74aa-44a8-a04f-1f1c57bd14dc tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:13.003246 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0d71f344-74aa-44a8-a04f-1f1c57bd14dc tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:13.003713 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0d71f344-74aa-44a8-a04f-1f1c57bd14dc tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:13.130452 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-0d71f344-74aa-44a8-a04f-1f1c57bd14dc tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:12:13.138395 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-0d71f344-74aa-44a8-a04f-1f1c57bd14dc tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:12:13.139860 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-0d71f344-74aa-44a8-a04f-1f1c57bd14dc tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:12:13.141020 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-0d71f344-74aa-44a8-a04f-1f1c57bd14dc tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1753 microversion: 2.20 time: 0.149961 Nov 09 20:12:13.141571 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 304/610] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:12:12 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1753 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:12:13.236353 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-088e181d-5bb1-4fb7-9f25-2ff6d7104b47 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:12:13.237394 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-088e181d-5bb1-4fb7-9f25-2ff6d7104b47 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:12:13.243696 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-088e181d-5bb1-4fb7-9f25-2ff6d7104b47 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:13.244228 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-088e181d-5bb1-4fb7-9f25-2ff6d7104b47 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:13.245028 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-088e181d-5bb1-4fb7-9f25-2ff6d7104b47 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:13.245514 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-088e181d-5bb1-4fb7-9f25-2ff6d7104b47 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:13.275008 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-088e181d-5bb1-4fb7-9f25-2ff6d7104b47 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042392 Nov 09 20:12:13.275561 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 307/611] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:12:13 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:12:14.159522 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-39f91a05-da5e-4454-a3d1-e8931621ef4d tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:12:14.160655 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-39f91a05-da5e-4454-a3d1-e8931621ef4d tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:12:14.166416 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-39f91a05-da5e-4454-a3d1-e8931621ef4d tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:14.166892 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-39f91a05-da5e-4454-a3d1-e8931621ef4d tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:14.167659 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-39f91a05-da5e-4454-a3d1-e8931621ef4d tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:14.168090 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-39f91a05-da5e-4454-a3d1-e8931621ef4d tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:14.286414 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-6672442d-392d-4f3e-acdc-760d0f98744f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:12:14.287443 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-6672442d-392d-4f3e-acdc-760d0f98744f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:12:14.293633 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6672442d-392d-4f3e-acdc-760d0f98744f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:14.294147 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6672442d-392d-4f3e-acdc-760d0f98744f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:14.294982 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6672442d-392d-4f3e-acdc-760d0f98744f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:14.295476 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6672442d-392d-4f3e-acdc-760d0f98744f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:14.299108 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-39f91a05-da5e-4454-a3d1-e8931621ef4d tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:12:14.308018 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-39f91a05-da5e-4454-a3d1-e8931621ef4d tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:12:14.309551 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-39f91a05-da5e-4454-a3d1-e8931621ef4d tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:12:14.310699 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-39f91a05-da5e-4454-a3d1-e8931621ef4d tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1753 microversion: 2.20 time: 0.154903 Nov 09 20:12:14.311258 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 305/612] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:12:14 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1753 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:12:14.324631 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-6672442d-392d-4f3e-acdc-760d0f98744f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042634 Nov 09 20:12:14.325181 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 308/613] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:12:14 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 20:12:15.329064 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-9da64468-c942-4693-8778-03d067e9b179 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:12:15.329662 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-9da64468-c942-4693-8778-03d067e9b179 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:12:15.335632 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-38ba6c80-367c-44e0-b12a-161a75b7e243 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:12:15.336556 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-38ba6c80-367c-44e0-b12a-161a75b7e243 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:12:15.336721 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9da64468-c942-4693-8778-03d067e9b179 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:15.337164 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9da64468-c942-4693-8778-03d067e9b179 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:15.337928 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9da64468-c942-4693-8778-03d067e9b179 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:15.338353 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9da64468-c942-4693-8778-03d067e9b179 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:15.342145 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-38ba6c80-367c-44e0-b12a-161a75b7e243 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:15.342589 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-38ba6c80-367c-44e0-b12a-161a75b7e243 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:15.343350 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-38ba6c80-367c-44e0-b12a-161a75b7e243 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:15.343774 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-38ba6c80-367c-44e0-b12a-161a75b7e243 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:15.372335 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-38ba6c80-367c-44e0-b12a-161a75b7e243 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041261 Nov 09 20:12:15.372917 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 309/614] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:12:15 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 20:12:15.465964 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-9da64468-c942-4693-8778-03d067e9b179 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:12:15.474277 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-9da64468-c942-4693-8778-03d067e9b179 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:12:15.475761 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-9da64468-c942-4693-8778-03d067e9b179 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:12:15.477006 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-9da64468-c942-4693-8778-03d067e9b179 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1753 microversion: 2.20 time: 0.151613 Nov 09 20:12:15.477720 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 306/615] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:12:15 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1753 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:12:16.386656 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-5d4bddf3-41d4-4a18-97f4-1f24549f9abe tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:12:16.387545 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-5d4bddf3-41d4-4a18-97f4-1f24549f9abe tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:12:16.394813 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-5d4bddf3-41d4-4a18-97f4-1f24549f9abe tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:16.395754 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-5d4bddf3-41d4-4a18-97f4-1f24549f9abe tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:16.396541 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-5d4bddf3-41d4-4a18-97f4-1f24549f9abe tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:16.396969 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-5d4bddf3-41d4-4a18-97f4-1f24549f9abe tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:16.425864 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-5d4bddf3-41d4-4a18-97f4-1f24549f9abe tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045716 Nov 09 20:12:16.426457 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 310/616] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:12:16 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:12:16.495999 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-27546f07-ebdb-48ca-aae2-8bb3b42d9a85 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:12:16.496628 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-27546f07-ebdb-48ca-aae2-8bb3b42d9a85 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:12:16.502806 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-27546f07-ebdb-48ca-aae2-8bb3b42d9a85 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:16.503258 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-27546f07-ebdb-48ca-aae2-8bb3b42d9a85 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:16.504024 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-27546f07-ebdb-48ca-aae2-8bb3b42d9a85 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:16.505033 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-27546f07-ebdb-48ca-aae2-8bb3b42d9a85 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:16.630054 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-27546f07-ebdb-48ca-aae2-8bb3b42d9a85 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:12:16.638197 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-27546f07-ebdb-48ca-aae2-8bb3b42d9a85 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:12:16.639685 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-27546f07-ebdb-48ca-aae2-8bb3b42d9a85 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:12:16.640864 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-27546f07-ebdb-48ca-aae2-8bb3b42d9a85 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1753 microversion: 2.20 time: 0.148559 Nov 09 20:12:16.641425 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 307/617] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:12:16 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1753 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:12:17.437060 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-191c697a-5975-4e07-89d2-57f35277d753 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:12:17.437960 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-191c697a-5975-4e07-89d2-57f35277d753 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:12:17.444646 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-191c697a-5975-4e07-89d2-57f35277d753 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:17.445106 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-191c697a-5975-4e07-89d2-57f35277d753 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:17.445957 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-191c697a-5975-4e07-89d2-57f35277d753 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:17.446417 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-191c697a-5975-4e07-89d2-57f35277d753 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:17.474886 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-191c697a-5975-4e07-89d2-57f35277d753 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041495 Nov 09 20:12:17.475431 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 311/618] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:12:17 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:12:17.658881 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-630bbebe-bd3d-4120-bf3d-a01798a4d4cf tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:12:17.659481 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-630bbebe-bd3d-4120-bf3d-a01798a4d4cf tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:12:17.665881 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-630bbebe-bd3d-4120-bf3d-a01798a4d4cf tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:17.666317 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-630bbebe-bd3d-4120-bf3d-a01798a4d4cf tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:17.667079 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-630bbebe-bd3d-4120-bf3d-a01798a4d4cf tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:17.667499 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-630bbebe-bd3d-4120-bf3d-a01798a4d4cf tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:18.011148 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-630bbebe-bd3d-4120-bf3d-a01798a4d4cf tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:12:18.019357 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-630bbebe-bd3d-4120-bf3d-a01798a4d4cf tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:12:18.021215 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-630bbebe-bd3d-4120-bf3d-a01798a4d4cf tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:12:18.022356 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-630bbebe-bd3d-4120-bf3d-a01798a4d4cf tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1753 microversion: 2.20 time: 0.367289 Nov 09 20:12:18.022899 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 308/619] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:12:17 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1753 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:12:18.486316 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-7dcd2aa5-6fc9-4e20-8c60-ed7e0d007a88 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:12:18.487235 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-7dcd2aa5-6fc9-4e20-8c60-ed7e0d007a88 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:12:18.493573 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-7dcd2aa5-6fc9-4e20-8c60-ed7e0d007a88 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:18.494021 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-7dcd2aa5-6fc9-4e20-8c60-ed7e0d007a88 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:18.494789 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-7dcd2aa5-6fc9-4e20-8c60-ed7e0d007a88 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:18.495219 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-7dcd2aa5-6fc9-4e20-8c60-ed7e0d007a88 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:18.524052 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-7dcd2aa5-6fc9-4e20-8c60-ed7e0d007a88 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041486 Nov 09 20:12:18.524625 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 312/620] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:12:18 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:12:19.040522 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-cb5431c7-4f41-4dcf-ab6d-25e2386569c6 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:12:19.048814 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-cb5431c7-4f41-4dcf-ab6d-25e2386569c6 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:12:19.048814 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cb5431c7-4f41-4dcf-ab6d-25e2386569c6 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:19.048814 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cb5431c7-4f41-4dcf-ab6d-25e2386569c6 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:19.049601 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cb5431c7-4f41-4dcf-ab6d-25e2386569c6 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:19.049683 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cb5431c7-4f41-4dcf-ab6d-25e2386569c6 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:19.179353 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-cb5431c7-4f41-4dcf-ab6d-25e2386569c6 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:12:19.187415 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-cb5431c7-4f41-4dcf-ab6d-25e2386569c6 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:12:19.188956 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-cb5431c7-4f41-4dcf-ab6d-25e2386569c6 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:12:19.190070 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-cb5431c7-4f41-4dcf-ab6d-25e2386569c6 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1753 microversion: 2.20 time: 0.153183 Nov 09 20:12:19.190625 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 309/621] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:12:19 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1753 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:12:19.535330 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-aa75c4bf-8513-4551-8d8f-103ba284a329 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:12:19.536186 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-aa75c4bf-8513-4551-8d8f-103ba284a329 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:12:19.542381 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-aa75c4bf-8513-4551-8d8f-103ba284a329 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:19.542822 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-aa75c4bf-8513-4551-8d8f-103ba284a329 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:19.543579 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-aa75c4bf-8513-4551-8d8f-103ba284a329 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:19.544001 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-aa75c4bf-8513-4551-8d8f-103ba284a329 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:19.572019 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-aa75c4bf-8513-4551-8d8f-103ba284a329 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040522 Nov 09 20:12:19.572591 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 313/622] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:12:19 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:12:20.208324 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-36843052-b7e9-48c6-b2e7-4d96672d2627 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:12:20.208864 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-36843052-b7e9-48c6-b2e7-4d96672d2627 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:12:20.214978 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-36843052-b7e9-48c6-b2e7-4d96672d2627 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:20.215415 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-36843052-b7e9-48c6-b2e7-4d96672d2627 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:20.216172 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-36843052-b7e9-48c6-b2e7-4d96672d2627 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:20.216624 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-36843052-b7e9-48c6-b2e7-4d96672d2627 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:20.344826 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-36843052-b7e9-48c6-b2e7-4d96672d2627 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:12:20.353530 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-36843052-b7e9-48c6-b2e7-4d96672d2627 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:12:20.355278 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-36843052-b7e9-48c6-b2e7-4d96672d2627 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:12:20.356434 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-36843052-b7e9-48c6-b2e7-4d96672d2627 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1753 microversion: 2.20 time: 0.152083 Nov 09 20:12:20.356993 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 310/623] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:12:20 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1753 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:12:20.583839 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-41014783-fa78-44bb-8a64-e885f4bc44aa tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:12:20.584691 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-41014783-fa78-44bb-8a64-e885f4bc44aa tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:12:20.590834 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-41014783-fa78-44bb-8a64-e885f4bc44aa tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:20.591274 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-41014783-fa78-44bb-8a64-e885f4bc44aa tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:20.592039 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-41014783-fa78-44bb-8a64-e885f4bc44aa tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:20.592499 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-41014783-fa78-44bb-8a64-e885f4bc44aa tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:20.620760 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-41014783-fa78-44bb-8a64-e885f4bc44aa tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041295 Nov 09 20:12:20.621303 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 314/624] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:12:20 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:12:21.375718 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-33daa8b4-8620-49e8-97ce-f48e330cc386 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:12:21.376311 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-33daa8b4-8620-49e8-97ce-f48e330cc386 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:12:21.383227 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-33daa8b4-8620-49e8-97ce-f48e330cc386 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:21.383673 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-33daa8b4-8620-49e8-97ce-f48e330cc386 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:21.384472 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-33daa8b4-8620-49e8-97ce-f48e330cc386 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:21.384905 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-33daa8b4-8620-49e8-97ce-f48e330cc386 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:21.511428 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-33daa8b4-8620-49e8-97ce-f48e330cc386 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:12:21.519442 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-33daa8b4-8620-49e8-97ce-f48e330cc386 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:12:21.521356 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-33daa8b4-8620-49e8-97ce-f48e330cc386 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:12:21.522505 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-33daa8b4-8620-49e8-97ce-f48e330cc386 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1753 microversion: 2.20 time: 0.150466 Nov 09 20:12:21.523060 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 311/625] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:12:21 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1753 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:12:21.633097 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-5317a57a-6f07-4727-ba9c-89c119417c29 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:12:21.634147 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-5317a57a-6f07-4727-ba9c-89c119417c29 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:12:21.640322 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-5317a57a-6f07-4727-ba9c-89c119417c29 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:21.640801 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-5317a57a-6f07-4727-ba9c-89c119417c29 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:21.641569 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-5317a57a-6f07-4727-ba9c-89c119417c29 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:21.642002 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-5317a57a-6f07-4727-ba9c-89c119417c29 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:21.670636 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-5317a57a-6f07-4727-ba9c-89c119417c29 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042410 Nov 09 20:12:21.671181 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 315/626] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:12:21 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 20:12:22.539877 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-7b435118-b83e-4ccc-8d82-e8d7a6004895 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:12:22.540464 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-7b435118-b83e-4ccc-8d82-e8d7a6004895 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:12:22.546579 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7b435118-b83e-4ccc-8d82-e8d7a6004895 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:22.547017 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7b435118-b83e-4ccc-8d82-e8d7a6004895 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:22.547769 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7b435118-b83e-4ccc-8d82-e8d7a6004895 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:22.548222 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7b435118-b83e-4ccc-8d82-e8d7a6004895 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:22.674569 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-7b435118-b83e-4ccc-8d82-e8d7a6004895 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:12:22.681959 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-a0ed7962-b178-4acf-8704-8d4037f15f39 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:12:22.682897 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-a0ed7962-b178-4acf-8704-8d4037f15f39 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:12:22.683696 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-7b435118-b83e-4ccc-8d82-e8d7a6004895 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:12:22.685432 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-7b435118-b83e-4ccc-8d82-e8d7a6004895 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:12:22.686572 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-7b435118-b83e-4ccc-8d82-e8d7a6004895 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1753 microversion: 2.20 time: 0.150647 Nov 09 20:12:22.687119 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 312/627] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:12:22 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1753 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:12:22.689247 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a0ed7962-b178-4acf-8704-8d4037f15f39 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:22.689701 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a0ed7962-b178-4acf-8704-8d4037f15f39 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:22.690484 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a0ed7962-b178-4acf-8704-8d4037f15f39 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:22.690923 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a0ed7962-b178-4acf-8704-8d4037f15f39 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:22.720586 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-a0ed7962-b178-4acf-8704-8d4037f15f39 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042484 Nov 09 20:12:22.721149 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 316/628] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:12:22 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:12:23.704682 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-1aa59d31-2135-45ad-a23e-ae78daaf3d12 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:12:23.705342 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-1aa59d31-2135-45ad-a23e-ae78daaf3d12 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:12:23.711882 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1aa59d31-2135-45ad-a23e-ae78daaf3d12 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:23.712329 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1aa59d31-2135-45ad-a23e-ae78daaf3d12 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:23.713127 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1aa59d31-2135-45ad-a23e-ae78daaf3d12 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:23.713555 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1aa59d31-2135-45ad-a23e-ae78daaf3d12 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:23.732653 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-8577934d-d9ce-4e41-9659-a8633b9de972 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:12:23.733562 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-8577934d-d9ce-4e41-9659-a8633b9de972 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:12:23.740259 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-8577934d-d9ce-4e41-9659-a8633b9de972 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:23.740733 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-8577934d-d9ce-4e41-9659-a8633b9de972 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:23.741514 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-8577934d-d9ce-4e41-9659-a8633b9de972 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:23.741950 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-8577934d-d9ce-4e41-9659-a8633b9de972 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:23.771368 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-8577934d-d9ce-4e41-9659-a8633b9de972 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042691 Nov 09 20:12:23.772117 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 317/629] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:12:23 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 20:12:23.847611 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-1aa59d31-2135-45ad-a23e-ae78daaf3d12 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:12:23.856046 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-1aa59d31-2135-45ad-a23e-ae78daaf3d12 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:12:23.857569 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-1aa59d31-2135-45ad-a23e-ae78daaf3d12 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:12:23.858708 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-1aa59d31-2135-45ad-a23e-ae78daaf3d12 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1753 microversion: 2.20 time: 0.157901 Nov 09 20:12:23.859268 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 313/630] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:12:23 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1753 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:12:24.782717 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-d96a9ee4-af4a-438f-9e96-8ebb29c1b3a6 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:12:24.783620 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-d96a9ee4-af4a-438f-9e96-8ebb29c1b3a6 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:12:24.789907 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d96a9ee4-af4a-438f-9e96-8ebb29c1b3a6 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:24.790352 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d96a9ee4-af4a-438f-9e96-8ebb29c1b3a6 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:24.791122 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d96a9ee4-af4a-438f-9e96-8ebb29c1b3a6 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:24.791556 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d96a9ee4-af4a-438f-9e96-8ebb29c1b3a6 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:24.819619 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-d96a9ee4-af4a-438f-9e96-8ebb29c1b3a6 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040756 Nov 09 20:12:24.820171 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 318/631] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:12:24 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:12:24.877862 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-9c811ca1-11c3-4e6c-b471-499f19b23c05 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:12:24.878450 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-9c811ca1-11c3-4e6c-b471-499f19b23c05 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:12:24.885078 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9c811ca1-11c3-4e6c-b471-499f19b23c05 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:24.885520 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9c811ca1-11c3-4e6c-b471-499f19b23c05 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:24.886277 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9c811ca1-11c3-4e6c-b471-499f19b23c05 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:24.886698 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9c811ca1-11c3-4e6c-b471-499f19b23c05 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:25.012516 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-9c811ca1-11c3-4e6c-b471-499f19b23c05 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:12:25.021219 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-9c811ca1-11c3-4e6c-b471-499f19b23c05 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:12:25.022689 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-9c811ca1-11c3-4e6c-b471-499f19b23c05 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:12:25.023812 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-9c811ca1-11c3-4e6c-b471-499f19b23c05 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1753 microversion: 2.20 time: 0.149666 Nov 09 20:12:25.024358 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 314/632] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:12:24 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1753 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 09 20:12:25.830876 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-5ac6fa45-037b-41d1-86f8-c0ba2a6fb719 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:12:25.831791 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-5ac6fa45-037b-41d1-86f8-c0ba2a6fb719 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:12:25.838554 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-5ac6fa45-037b-41d1-86f8-c0ba2a6fb719 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:25.839005 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-5ac6fa45-037b-41d1-86f8-c0ba2a6fb719 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:25.839796 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-5ac6fa45-037b-41d1-86f8-c0ba2a6fb719 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:25.840232 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-5ac6fa45-037b-41d1-86f8-c0ba2a6fb719 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:25.870178 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-5ac6fa45-037b-41d1-86f8-c0ba2a6fb719 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043042 Nov 09 20:12:25.870733 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 319/633] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:12:25 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:12:26.042638 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-ed3b1d81-c958-4a07-81f0-8ea0ca3fd3ea tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:12:26.043260 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-ed3b1d81-c958-4a07-81f0-8ea0ca3fd3ea tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:12:26.048980 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ed3b1d81-c958-4a07-81f0-8ea0ca3fd3ea tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:26.049416 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ed3b1d81-c958-4a07-81f0-8ea0ca3fd3ea tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:26.050172 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ed3b1d81-c958-4a07-81f0-8ea0ca3fd3ea tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:26.050597 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ed3b1d81-c958-4a07-81f0-8ea0ca3fd3ea tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:26.182195 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-ed3b1d81-c958-4a07-81f0-8ea0ca3fd3ea tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:12:26.190317 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-ed3b1d81-c958-4a07-81f0-8ea0ca3fd3ea tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:12:26.191947 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-ed3b1d81-c958-4a07-81f0-8ea0ca3fd3ea tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:12:26.193223 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-ed3b1d81-c958-4a07-81f0-8ea0ca3fd3ea tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1753 microversion: 2.20 time: 0.154464 Nov 09 20:12:26.193779 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 315/634] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:12:26 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1753 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:12:26.882032 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-4b1cb499-3aac-4557-a46b-24672744e902 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:12:26.882965 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-4b1cb499-3aac-4557-a46b-24672744e902 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:12:26.889089 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-4b1cb499-3aac-4557-a46b-24672744e902 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:26.889529 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-4b1cb499-3aac-4557-a46b-24672744e902 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:26.890294 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-4b1cb499-3aac-4557-a46b-24672744e902 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:26.890721 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-4b1cb499-3aac-4557-a46b-24672744e902 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:26.918406 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-4b1cb499-3aac-4557-a46b-24672744e902 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040797 Nov 09 20:12:26.918945 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 320/635] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:12:26 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 20:12:27.211186 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-25b87676-8823-4a24-a044-24e1e1163a34 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:12:27.211714 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-25b87676-8823-4a24-a044-24e1e1163a34 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:12:27.217904 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-25b87676-8823-4a24-a044-24e1e1163a34 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:27.218341 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-25b87676-8823-4a24-a044-24e1e1163a34 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:27.219102 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-25b87676-8823-4a24-a044-24e1e1163a34 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:27.219529 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-25b87676-8823-4a24-a044-24e1e1163a34 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:27.350804 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-25b87676-8823-4a24-a044-24e1e1163a34 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:12:27.359161 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-25b87676-8823-4a24-a044-24e1e1163a34 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:12:27.360679 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-25b87676-8823-4a24-a044-24e1e1163a34 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:12:27.361813 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-25b87676-8823-4a24-a044-24e1e1163a34 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1753 microversion: 2.20 time: 0.154399 Nov 09 20:12:27.362374 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 316/636] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:12:27 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1753 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:12:27.929896 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-4bc9611b-63d6-4f2f-9f09-bb1bc9874fb3 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:12:27.930766 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-4bc9611b-63d6-4f2f-9f09-bb1bc9874fb3 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:12:27.936948 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-4bc9611b-63d6-4f2f-9f09-bb1bc9874fb3 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:27.937394 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-4bc9611b-63d6-4f2f-9f09-bb1bc9874fb3 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:27.938165 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-4bc9611b-63d6-4f2f-9f09-bb1bc9874fb3 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:27.938599 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-4bc9611b-63d6-4f2f-9f09-bb1bc9874fb3 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:27.967385 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-4bc9611b-63d6-4f2f-9f09-bb1bc9874fb3 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041378 Nov 09 20:12:27.967932 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 321/637] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:12:27 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:12:28.380237 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-53f48ff5-9daa-49cb-b843-7368c4203afd tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:12:28.380862 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-53f48ff5-9daa-49cb-b843-7368c4203afd tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:12:28.386908 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-53f48ff5-9daa-49cb-b843-7368c4203afd tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:28.387354 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-53f48ff5-9daa-49cb-b843-7368c4203afd tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:28.388126 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-53f48ff5-9daa-49cb-b843-7368c4203afd tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:28.388590 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-53f48ff5-9daa-49cb-b843-7368c4203afd tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:28.521790 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-53f48ff5-9daa-49cb-b843-7368c4203afd tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:12:28.530278 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-53f48ff5-9daa-49cb-b843-7368c4203afd tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:12:28.531792 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-53f48ff5-9daa-49cb-b843-7368c4203afd tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:12:28.532985 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-53f48ff5-9daa-49cb-b843-7368c4203afd tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1753 microversion: 2.20 time: 0.156934 Nov 09 20:12:28.533543 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 317/638] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:12:28 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1753 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:12:28.980049 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-cbe76469-b80c-4fb5-b193-5c36d650d773 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:12:28.981000 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-cbe76469-b80c-4fb5-b193-5c36d650d773 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:12:28.987206 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-cbe76469-b80c-4fb5-b193-5c36d650d773 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:28.987653 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-cbe76469-b80c-4fb5-b193-5c36d650d773 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:28.988441 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-cbe76469-b80c-4fb5-b193-5c36d650d773 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:28.988901 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-cbe76469-b80c-4fb5-b193-5c36d650d773 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:29.016531 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-cbe76469-b80c-4fb5-b193-5c36d650d773 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040399 Nov 09 20:12:29.017075 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 322/639] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:12:28 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:12:29.550650 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-3448cb60-8746-4e65-9029-77b4c5120ccc tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:12:29.551203 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-3448cb60-8746-4e65-9029-77b4c5120ccc tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:12:29.557482 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3448cb60-8746-4e65-9029-77b4c5120ccc tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:29.557920 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3448cb60-8746-4e65-9029-77b4c5120ccc tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:29.558674 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3448cb60-8746-4e65-9029-77b4c5120ccc tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:29.559096 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3448cb60-8746-4e65-9029-77b4c5120ccc tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:29.687155 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-3448cb60-8746-4e65-9029-77b4c5120ccc tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:12:29.695801 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-3448cb60-8746-4e65-9029-77b4c5120ccc tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:12:29.697304 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-3448cb60-8746-4e65-9029-77b4c5120ccc tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:12:29.698427 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-3448cb60-8746-4e65-9029-77b4c5120ccc tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1753 microversion: 2.20 time: 0.151440 Nov 09 20:12:29.698978 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 318/640] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:12:29 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1753 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:12:30.028354 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-93d1e96b-62c3-459b-a949-90043554df84 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:12:30.029284 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-93d1e96b-62c3-459b-a949-90043554df84 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:12:30.035983 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-93d1e96b-62c3-459b-a949-90043554df84 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:30.036475 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-93d1e96b-62c3-459b-a949-90043554df84 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:30.037250 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-93d1e96b-62c3-459b-a949-90043554df84 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:30.037681 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-93d1e96b-62c3-459b-a949-90043554df84 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:30.066281 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-93d1e96b-62c3-459b-a949-90043554df84 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041650 Nov 09 20:12:30.066833 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 323/641] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:12:30 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:12:30.716822 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-9479aaf5-4567-469d-ba39-3760e2b814bf tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:12:30.717424 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-9479aaf5-4567-469d-ba39-3760e2b814bf tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:12:30.724501 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9479aaf5-4567-469d-ba39-3760e2b814bf tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:30.724949 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9479aaf5-4567-469d-ba39-3760e2b814bf tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:30.725719 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9479aaf5-4567-469d-ba39-3760e2b814bf tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:30.726152 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9479aaf5-4567-469d-ba39-3760e2b814bf tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:30.854977 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-9479aaf5-4567-469d-ba39-3760e2b814bf tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:12:30.862954 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-9479aaf5-4567-469d-ba39-3760e2b814bf tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:12:30.864425 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-9479aaf5-4567-469d-ba39-3760e2b814bf tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:12:30.865551 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-9479aaf5-4567-469d-ba39-3760e2b814bf tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1753 microversion: 2.20 time: 0.152470 Nov 09 20:12:30.866097 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 319/642] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:12:30 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1753 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:12:31.077571 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-19e5e68e-8e81-408d-a1a8-8d5cc1b34571 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:12:31.078391 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-19e5e68e-8e81-408d-a1a8-8d5cc1b34571 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:12:31.085376 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-19e5e68e-8e81-408d-a1a8-8d5cc1b34571 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:31.085812 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-19e5e68e-8e81-408d-a1a8-8d5cc1b34571 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:31.086575 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-19e5e68e-8e81-408d-a1a8-8d5cc1b34571 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:31.087000 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-19e5e68e-8e81-408d-a1a8-8d5cc1b34571 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:31.118514 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-19e5e68e-8e81-408d-a1a8-8d5cc1b34571 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044692 Nov 09 20:12:31.119076 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 324/643] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:12:31 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:12:31.882856 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-dc6c118c-5a78-480f-b47f-22b0b18884eb tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:12:31.883463 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-dc6c118c-5a78-480f-b47f-22b0b18884eb tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:12:31.889597 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-dc6c118c-5a78-480f-b47f-22b0b18884eb tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:31.890032 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-dc6c118c-5a78-480f-b47f-22b0b18884eb tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:31.890879 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-dc6c118c-5a78-480f-b47f-22b0b18884eb tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:31.891304 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-dc6c118c-5a78-480f-b47f-22b0b18884eb tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:32.020873 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-dc6c118c-5a78-480f-b47f-22b0b18884eb tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:12:32.028792 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-dc6c118c-5a78-480f-b47f-22b0b18884eb tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:12:32.030265 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-dc6c118c-5a78-480f-b47f-22b0b18884eb tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:12:32.031392 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-dc6c118c-5a78-480f-b47f-22b0b18884eb tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1753 microversion: 2.20 time: 0.152313 Nov 09 20:12:32.031935 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 320/644] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:12:31 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1753 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:12:32.130251 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-6572d558-2f3a-4b8c-9e18-3527cd983f31 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:12:32.131155 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-6572d558-2f3a-4b8c-9e18-3527cd983f31 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:12:32.137427 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6572d558-2f3a-4b8c-9e18-3527cd983f31 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:32.137814 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6572d558-2f3a-4b8c-9e18-3527cd983f31 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:32.138583 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6572d558-2f3a-4b8c-9e18-3527cd983f31 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:32.139007 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6572d558-2f3a-4b8c-9e18-3527cd983f31 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:32.169254 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-6572d558-2f3a-4b8c-9e18-3527cd983f31 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042725 Nov 09 20:12:32.169798 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 325/645] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:12:32 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:12:33.049800 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-8081b0e6-0e62-4eb2-b168-c29e35336e61 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:12:33.050383 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-8081b0e6-0e62-4eb2-b168-c29e35336e61 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:12:33.057074 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8081b0e6-0e62-4eb2-b168-c29e35336e61 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:33.057543 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8081b0e6-0e62-4eb2-b168-c29e35336e61 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:33.058297 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8081b0e6-0e62-4eb2-b168-c29e35336e61 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:33.058721 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8081b0e6-0e62-4eb2-b168-c29e35336e61 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:33.181563 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-f5f0ce8e-ef0c-44a8-ac99-094fa5a6b8d0 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:12:33.182575 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-f5f0ce8e-ef0c-44a8-ac99-094fa5a6b8d0 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:12:33.186545 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-8081b0e6-0e62-4eb2-b168-c29e35336e61 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:12:33.188641 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f5f0ce8e-ef0c-44a8-ac99-094fa5a6b8d0 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:33.189094 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f5f0ce8e-ef0c-44a8-ac99-094fa5a6b8d0 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:33.189881 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f5f0ce8e-ef0c-44a8-ac99-094fa5a6b8d0 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:33.190316 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f5f0ce8e-ef0c-44a8-ac99-094fa5a6b8d0 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:33.195239 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-8081b0e6-0e62-4eb2-b168-c29e35336e61 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:12:33.196747 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-8081b0e6-0e62-4eb2-b168-c29e35336e61 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:12:33.197891 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-8081b0e6-0e62-4eb2-b168-c29e35336e61 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1753 microversion: 2.20 time: 0.151814 Nov 09 20:12:33.198443 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 321/646] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:12:33 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1753 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:12:33.219099 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-f5f0ce8e-ef0c-44a8-ac99-094fa5a6b8d0 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041163 Nov 09 20:12:33.219656 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 326/647] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:12:33 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 20:12:34.216572 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-3ff3661b-c5cc-4c65-a357-4c165264121a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:12:34.217173 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-3ff3661b-c5cc-4c65-a357-4c165264121a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:12:34.223388 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3ff3661b-c5cc-4c65-a357-4c165264121a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:34.223861 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3ff3661b-c5cc-4c65-a357-4c165264121a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:34.224644 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3ff3661b-c5cc-4c65-a357-4c165264121a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:34.225078 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3ff3661b-c5cc-4c65-a357-4c165264121a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:34.230482 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-7f48dfa2-0846-4dc9-be62-d24289b74e28 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:12:34.231450 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-7f48dfa2-0846-4dc9-be62-d24289b74e28 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:12:34.237576 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-7f48dfa2-0846-4dc9-be62-d24289b74e28 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:34.238023 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-7f48dfa2-0846-4dc9-be62-d24289b74e28 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:34.239282 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-7f48dfa2-0846-4dc9-be62-d24289b74e28 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:34.239870 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-7f48dfa2-0846-4dc9-be62-d24289b74e28 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:34.269346 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-7f48dfa2-0846-4dc9-be62-d24289b74e28 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042730 Nov 09 20:12:34.269927 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 327/648] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:12:34 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 20:12:34.356345 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-3ff3661b-c5cc-4c65-a357-4c165264121a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:12:34.364963 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-3ff3661b-c5cc-4c65-a357-4c165264121a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:12:34.366405 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-3ff3661b-c5cc-4c65-a357-4c165264121a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:12:34.367526 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-3ff3661b-c5cc-4c65-a357-4c165264121a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1753 microversion: 2.20 time: 0.154606 Nov 09 20:12:34.368072 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 322/649] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:12:34 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1753 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:12:35.280802 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-0c5f3041-7fe0-4eb4-8c45-0f6e9bed54ab tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:12:35.281717 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-0c5f3041-7fe0-4eb4-8c45-0f6e9bed54ab tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:12:35.288602 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-0c5f3041-7fe0-4eb4-8c45-0f6e9bed54ab tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:35.289056 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-0c5f3041-7fe0-4eb4-8c45-0f6e9bed54ab tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:35.289868 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-0c5f3041-7fe0-4eb4-8c45-0f6e9bed54ab tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:35.290298 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-0c5f3041-7fe0-4eb4-8c45-0f6e9bed54ab tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:35.319765 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-0c5f3041-7fe0-4eb4-8c45-0f6e9bed54ab tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042764 Nov 09 20:12:35.320333 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 328/650] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:12:35 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:12:35.385904 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-d7a4b739-9e28-434b-9715-d9e637926036 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:12:35.386495 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-d7a4b739-9e28-434b-9715-d9e637926036 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:12:35.392733 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d7a4b739-9e28-434b-9715-d9e637926036 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:35.393177 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d7a4b739-9e28-434b-9715-d9e637926036 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:35.393937 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d7a4b739-9e28-434b-9715-d9e637926036 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:35.394366 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d7a4b739-9e28-434b-9715-d9e637926036 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:35.521637 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-d7a4b739-9e28-434b-9715-d9e637926036 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:12:35.529606 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-d7a4b739-9e28-434b-9715-d9e637926036 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:12:35.531132 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-d7a4b739-9e28-434b-9715-d9e637926036 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:12:35.532197 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-d7a4b739-9e28-434b-9715-d9e637926036 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1753 microversion: 2.20 time: 0.149962 Nov 09 20:12:35.532775 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 323/651] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:12:35 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1753 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:12:36.330940 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-da35fc21-594c-49ed-abad-9387ce38e4ac tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:12:36.331865 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-da35fc21-594c-49ed-abad-9387ce38e4ac tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:12:36.338705 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-da35fc21-594c-49ed-abad-9387ce38e4ac tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:36.339146 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-da35fc21-594c-49ed-abad-9387ce38e4ac tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:36.339932 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-da35fc21-594c-49ed-abad-9387ce38e4ac tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:36.340356 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-da35fc21-594c-49ed-abad-9387ce38e4ac tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:36.368917 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-da35fc21-594c-49ed-abad-9387ce38e4ac tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041658 Nov 09 20:12:36.369460 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 329/652] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:12:36 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:12:36.551019 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-03be1f9f-5ac7-4480-a643-2d5e3119a00c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:12:36.551571 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-03be1f9f-5ac7-4480-a643-2d5e3119a00c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:12:36.557675 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-03be1f9f-5ac7-4480-a643-2d5e3119a00c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:36.558111 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-03be1f9f-5ac7-4480-a643-2d5e3119a00c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:36.558861 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-03be1f9f-5ac7-4480-a643-2d5e3119a00c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:36.559281 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-03be1f9f-5ac7-4480-a643-2d5e3119a00c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:36.768570 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-03be1f9f-5ac7-4480-a643-2d5e3119a00c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:12:36.777481 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-03be1f9f-5ac7-4480-a643-2d5e3119a00c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:12:36.779114 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-03be1f9f-5ac7-4480-a643-2d5e3119a00c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:12:36.780462 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-03be1f9f-5ac7-4480-a643-2d5e3119a00c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1753 microversion: 2.20 time: 0.233281 Nov 09 20:12:36.788737 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 324/653] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:12:36 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1753 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:12:37.381020 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-0eee9da5-93f3-447a-bbf3-db55aef0312c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:12:37.381923 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-0eee9da5-93f3-447a-bbf3-db55aef0312c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:12:37.388067 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-0eee9da5-93f3-447a-bbf3-db55aef0312c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:37.388534 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-0eee9da5-93f3-447a-bbf3-db55aef0312c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:37.389295 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-0eee9da5-93f3-447a-bbf3-db55aef0312c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:37.389719 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-0eee9da5-93f3-447a-bbf3-db55aef0312c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:37.420023 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-0eee9da5-93f3-447a-bbf3-db55aef0312c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043533 Nov 09 20:12:37.420626 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 330/654] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:12:37 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:12:37.798667 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-5893d4c8-86bb-4652-9df8-830f2db2799d tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:12:37.799549 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-5893d4c8-86bb-4652-9df8-830f2db2799d tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:12:37.806808 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5893d4c8-86bb-4652-9df8-830f2db2799d tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:37.807210 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5893d4c8-86bb-4652-9df8-830f2db2799d tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:37.807888 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5893d4c8-86bb-4652-9df8-830f2db2799d tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:37.808329 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5893d4c8-86bb-4652-9df8-830f2db2799d tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:37.939337 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-5893d4c8-86bb-4652-9df8-830f2db2799d tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:12:37.947659 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-5893d4c8-86bb-4652-9df8-830f2db2799d tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:12:37.949181 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-5893d4c8-86bb-4652-9df8-830f2db2799d tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:12:37.950410 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-5893d4c8-86bb-4652-9df8-830f2db2799d tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1753 microversion: 2.20 time: 0.155392 Nov 09 20:12:37.950970 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 325/655] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:12:37 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1753 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:12:38.431523 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-48793cef-7cb2-46a5-b1b9-5929eb522b5b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:12:38.432445 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-48793cef-7cb2-46a5-b1b9-5929eb522b5b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:12:38.438589 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-48793cef-7cb2-46a5-b1b9-5929eb522b5b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:38.439039 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-48793cef-7cb2-46a5-b1b9-5929eb522b5b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:38.439835 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-48793cef-7cb2-46a5-b1b9-5929eb522b5b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:38.440266 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-48793cef-7cb2-46a5-b1b9-5929eb522b5b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:38.469480 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-48793cef-7cb2-46a5-b1b9-5929eb522b5b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041729 Nov 09 20:12:38.470025 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 331/656] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:12:38 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:12:38.968929 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-c88b610d-34cb-4223-9a16-6f700b556fac tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:12:38.969520 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-c88b610d-34cb-4223-9a16-6f700b556fac tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:12:38.976493 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c88b610d-34cb-4223-9a16-6f700b556fac tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:38.976931 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c88b610d-34cb-4223-9a16-6f700b556fac tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:38.977688 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c88b610d-34cb-4223-9a16-6f700b556fac tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:38.978112 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c88b610d-34cb-4223-9a16-6f700b556fac tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:39.020254 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 09 20:12:39.020506 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: Tue Nov 9 20:12:39 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 09 20:12:39.110234 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-c88b610d-34cb-4223-9a16-6f700b556fac tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:12:39.119741 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-c88b610d-34cb-4223-9a16-6f700b556fac tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:12:39.121283 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-c88b610d-34cb-4223-9a16-6f700b556fac tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:12:39.122411 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-c88b610d-34cb-4223-9a16-6f700b556fac tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1753 microversion: 2.20 time: 0.157163 Nov 09 20:12:39.122963 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 326/657] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:12:38 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1753 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:12:39.481061 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-8ea45cca-ea04-4da1-853d-843812d1f8cd tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:12:39.482009 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-8ea45cca-ea04-4da1-853d-843812d1f8cd tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:12:39.489012 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-8ea45cca-ea04-4da1-853d-843812d1f8cd tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:39.489380 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-8ea45cca-ea04-4da1-853d-843812d1f8cd tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:39.490164 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-8ea45cca-ea04-4da1-853d-843812d1f8cd tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:39.490597 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-8ea45cca-ea04-4da1-853d-843812d1f8cd tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:39.518687 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-8ea45cca-ea04-4da1-853d-843812d1f8cd tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041587 Nov 09 20:12:39.519232 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 332/658] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:12:39 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:12:40.140051 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-1a23bdeb-b2fc-418a-b2f3-409afc2b89b7 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:12:40.140668 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-1a23bdeb-b2fc-418a-b2f3-409afc2b89b7 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:12:40.146807 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1a23bdeb-b2fc-418a-b2f3-409afc2b89b7 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:40.147244 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1a23bdeb-b2fc-418a-b2f3-409afc2b89b7 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:40.148003 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1a23bdeb-b2fc-418a-b2f3-409afc2b89b7 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:40.148461 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1a23bdeb-b2fc-418a-b2f3-409afc2b89b7 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:40.278039 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-1a23bdeb-b2fc-418a-b2f3-409afc2b89b7 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:12:40.286261 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-1a23bdeb-b2fc-418a-b2f3-409afc2b89b7 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:12:40.287733 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-1a23bdeb-b2fc-418a-b2f3-409afc2b89b7 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:12:40.288901 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-1a23bdeb-b2fc-418a-b2f3-409afc2b89b7 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1753 microversion: 2.20 time: 0.152486 Nov 09 20:12:40.289447 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 327/659] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:12:40 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1753 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:12:40.530731 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-fab40c49-d4df-48bc-8f18-1ef57fac1b01 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:12:40.531568 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-fab40c49-d4df-48bc-8f18-1ef57fac1b01 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:12:40.538451 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-fab40c49-d4df-48bc-8f18-1ef57fac1b01 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:40.538901 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-fab40c49-d4df-48bc-8f18-1ef57fac1b01 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:40.539673 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-fab40c49-d4df-48bc-8f18-1ef57fac1b01 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:40.540107 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-fab40c49-d4df-48bc-8f18-1ef57fac1b01 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:40.569113 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-fab40c49-d4df-48bc-8f18-1ef57fac1b01 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042181 Nov 09 20:12:40.569659 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 333/660] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:12:40 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:12:41.307436 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-5c161fdd-d1f9-4192-b104-0aaed05dd384 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:12:41.308048 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-5c161fdd-d1f9-4192-b104-0aaed05dd384 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:12:41.314071 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5c161fdd-d1f9-4192-b104-0aaed05dd384 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:41.314525 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5c161fdd-d1f9-4192-b104-0aaed05dd384 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:41.315396 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5c161fdd-d1f9-4192-b104-0aaed05dd384 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:41.315834 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5c161fdd-d1f9-4192-b104-0aaed05dd384 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:41.442369 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-5c161fdd-d1f9-4192-b104-0aaed05dd384 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:12:41.450476 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-5c161fdd-d1f9-4192-b104-0aaed05dd384 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:12:41.451963 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-5c161fdd-d1f9-4192-b104-0aaed05dd384 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:12:41.453140 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-5c161fdd-d1f9-4192-b104-0aaed05dd384 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1753 microversion: 2.20 time: 0.149407 Nov 09 20:12:41.453702 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 328/661] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:12:41 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1753 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:12:41.580272 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-ae5530d9-5dcb-41e0-9dbe-33bcc388b007 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:12:41.581187 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-ae5530d9-5dcb-41e0-9dbe-33bcc388b007 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:12:41.587874 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ae5530d9-5dcb-41e0-9dbe-33bcc388b007 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:41.588322 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ae5530d9-5dcb-41e0-9dbe-33bcc388b007 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:41.589128 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ae5530d9-5dcb-41e0-9dbe-33bcc388b007 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:41.589561 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ae5530d9-5dcb-41e0-9dbe-33bcc388b007 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:41.618415 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-ae5530d9-5dcb-41e0-9dbe-33bcc388b007 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041962 Nov 09 20:12:41.618962 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 334/662] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:12:41 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:12:42.471174 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-bab45d2c-144c-45d9-9e54-c31dee04cc02 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:12:42.471782 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-bab45d2c-144c-45d9-9e54-c31dee04cc02 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:12:42.478738 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bab45d2c-144c-45d9-9e54-c31dee04cc02 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:42.479181 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bab45d2c-144c-45d9-9e54-c31dee04cc02 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:42.480206 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bab45d2c-144c-45d9-9e54-c31dee04cc02 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:42.480668 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bab45d2c-144c-45d9-9e54-c31dee04cc02 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:42.614056 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-bab45d2c-144c-45d9-9e54-c31dee04cc02 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:12:42.622219 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-bab45d2c-144c-45d9-9e54-c31dee04cc02 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:12:42.623731 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-bab45d2c-144c-45d9-9e54-c31dee04cc02 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:12:42.624905 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-bab45d2c-144c-45d9-9e54-c31dee04cc02 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1753 microversion: 2.20 time: 0.157485 Nov 09 20:12:42.625452 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 329/663] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:12:42 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1753 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:12:42.629695 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-c5c5b209-7134-44c2-bfb8-e15c98497f9c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:12:42.631049 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-c5c5b209-7134-44c2-bfb8-e15c98497f9c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:12:42.637243 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c5c5b209-7134-44c2-bfb8-e15c98497f9c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:42.637685 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c5c5b209-7134-44c2-bfb8-e15c98497f9c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:42.638453 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c5c5b209-7134-44c2-bfb8-e15c98497f9c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:42.638885 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c5c5b209-7134-44c2-bfb8-e15c98497f9c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:42.668664 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-c5c5b209-7134-44c2-bfb8-e15c98497f9c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042679 Nov 09 20:12:42.669212 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 335/664] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:12:42 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:12:43.642633 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-21e6595f-e3d8-4e7b-a3d4-c8e2a7cab45a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:12:43.643229 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-21e6595f-e3d8-4e7b-a3d4-c8e2a7cab45a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:12:43.649494 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-21e6595f-e3d8-4e7b-a3d4-c8e2a7cab45a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:43.649933 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-21e6595f-e3d8-4e7b-a3d4-c8e2a7cab45a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:43.650697 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-21e6595f-e3d8-4e7b-a3d4-c8e2a7cab45a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:43.651123 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-21e6595f-e3d8-4e7b-a3d4-c8e2a7cab45a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:43.680131 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-8a58b12e-ee34-457c-ba37-1cb7cc149853 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:12:43.681140 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-8a58b12e-ee34-457c-ba37-1cb7cc149853 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:12:43.687388 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-8a58b12e-ee34-457c-ba37-1cb7cc149853 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:43.687837 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-8a58b12e-ee34-457c-ba37-1cb7cc149853 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:43.688652 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-8a58b12e-ee34-457c-ba37-1cb7cc149853 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:43.689093 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-8a58b12e-ee34-457c-ba37-1cb7cc149853 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:43.717849 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-8a58b12e-ee34-457c-ba37-1cb7cc149853 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041943 Nov 09 20:12:43.718406 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 336/665] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:12:43 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 20:12:43.779802 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-21e6595f-e3d8-4e7b-a3d4-c8e2a7cab45a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:12:43.788286 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-21e6595f-e3d8-4e7b-a3d4-c8e2a7cab45a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:12:43.789807 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-21e6595f-e3d8-4e7b-a3d4-c8e2a7cab45a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:12:43.790922 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-21e6595f-e3d8-4e7b-a3d4-c8e2a7cab45a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1753 microversion: 2.20 time: 0.152022 Nov 09 20:12:43.791478 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 330/666] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:12:43 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1753 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:12:44.728930 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-4b060879-a1cd-4ec9-8105-601b93348d0c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:12:44.730117 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-4b060879-a1cd-4ec9-8105-601b93348d0c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:12:44.736472 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-4b060879-a1cd-4ec9-8105-601b93348d0c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:44.736922 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-4b060879-a1cd-4ec9-8105-601b93348d0c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:44.737698 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-4b060879-a1cd-4ec9-8105-601b93348d0c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:44.738131 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-4b060879-a1cd-4ec9-8105-601b93348d0c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:44.768091 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-4b060879-a1cd-4ec9-8105-601b93348d0c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042830 Nov 09 20:12:44.768697 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 337/667] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:12:44 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:12:44.913429 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-32f6313d-18e8-404d-8fb6-4ca5a93fe4bf tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:12:44.914155 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-32f6313d-18e8-404d-8fb6-4ca5a93fe4bf tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:12:44.920255 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-32f6313d-18e8-404d-8fb6-4ca5a93fe4bf tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:44.920742 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-32f6313d-18e8-404d-8fb6-4ca5a93fe4bf tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:44.921523 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-32f6313d-18e8-404d-8fb6-4ca5a93fe4bf tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:44.921957 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-32f6313d-18e8-404d-8fb6-4ca5a93fe4bf tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:45.068778 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-32f6313d-18e8-404d-8fb6-4ca5a93fe4bf tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:12:45.077767 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-32f6313d-18e8-404d-8fb6-4ca5a93fe4bf tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:12:45.079256 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-32f6313d-18e8-404d-8fb6-4ca5a93fe4bf tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:12:45.080430 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-32f6313d-18e8-404d-8fb6-4ca5a93fe4bf tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1753 microversion: 2.20 time: 0.275055 Nov 09 20:12:45.080992 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 331/668] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:12:44 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1753 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:12:45.778931 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-4694d6fc-d4bd-43b3-8453-6a0c278af793 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:12:45.779871 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-4694d6fc-d4bd-43b3-8453-6a0c278af793 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:12:45.785794 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-4694d6fc-d4bd-43b3-8453-6a0c278af793 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:45.786300 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-4694d6fc-d4bd-43b3-8453-6a0c278af793 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:45.787083 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-4694d6fc-d4bd-43b3-8453-6a0c278af793 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:45.787515 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-4694d6fc-d4bd-43b3-8453-6a0c278af793 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:45.816085 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-4694d6fc-d4bd-43b3-8453-6a0c278af793 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040835 Nov 09 20:12:45.816679 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 338/669] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:12:45 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:12:46.101045 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-b018da60-bbb5-4cbb-a6ea-8d5afcfe0a9c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:12:46.101640 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-b018da60-bbb5-4cbb-a6ea-8d5afcfe0a9c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:12:46.107965 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b018da60-bbb5-4cbb-a6ea-8d5afcfe0a9c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:46.108432 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b018da60-bbb5-4cbb-a6ea-8d5afcfe0a9c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:46.109198 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b018da60-bbb5-4cbb-a6ea-8d5afcfe0a9c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:46.109621 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b018da60-bbb5-4cbb-a6ea-8d5afcfe0a9c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:46.253403 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-b018da60-bbb5-4cbb-a6ea-8d5afcfe0a9c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:12:46.265937 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-b018da60-bbb5-4cbb-a6ea-8d5afcfe0a9c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:12:46.267428 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-b018da60-bbb5-4cbb-a6ea-8d5afcfe0a9c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:12:46.268614 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-b018da60-bbb5-4cbb-a6ea-8d5afcfe0a9c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1753 microversion: 2.20 time: 0.171557 Nov 09 20:12:46.269193 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 332/670] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:12:46 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1753 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:12:46.828264 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-b2c47859-6896-48af-a532-474dce357958 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:12:46.829177 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-b2c47859-6896-48af-a532-474dce357958 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:12:46.835905 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b2c47859-6896-48af-a532-474dce357958 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:46.836348 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b2c47859-6896-48af-a532-474dce357958 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:46.837165 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b2c47859-6896-48af-a532-474dce357958 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:46.837597 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b2c47859-6896-48af-a532-474dce357958 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:46.868202 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-b2c47859-6896-48af-a532-474dce357958 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043737 Nov 09 20:12:46.868779 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 339/671] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:12:46 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:12:47.286569 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-570053d3-2c1b-49b5-b946-9a75ed5677fe tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:12:47.287494 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-570053d3-2c1b-49b5-b946-9a75ed5677fe tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:12:47.294024 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-570053d3-2c1b-49b5-b946-9a75ed5677fe tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:47.294469 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-570053d3-2c1b-49b5-b946-9a75ed5677fe tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:47.295286 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-570053d3-2c1b-49b5-b946-9a75ed5677fe tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:47.295859 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-570053d3-2c1b-49b5-b946-9a75ed5677fe tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:47.425986 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-570053d3-2c1b-49b5-b946-9a75ed5677fe tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:12:47.435059 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-570053d3-2c1b-49b5-b946-9a75ed5677fe tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:12:47.436581 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-570053d3-2c1b-49b5-b946-9a75ed5677fe tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:12:47.437737 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-570053d3-2c1b-49b5-b946-9a75ed5677fe tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1753 microversion: 2.20 time: 0.155674 Nov 09 20:12:47.438294 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 333/672] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:12:47 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1753 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:12:47.976972 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-d1f0ce16-00e8-44aa-b5c8-b56f0ed11941 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:12:47.977934 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-d1f0ce16-00e8-44aa-b5c8-b56f0ed11941 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:12:47.984032 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d1f0ce16-00e8-44aa-b5c8-b56f0ed11941 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:47.984514 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d1f0ce16-00e8-44aa-b5c8-b56f0ed11941 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:47.985289 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d1f0ce16-00e8-44aa-b5c8-b56f0ed11941 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:47.985720 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d1f0ce16-00e8-44aa-b5c8-b56f0ed11941 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:48.015326 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-d1f0ce16-00e8-44aa-b5c8-b56f0ed11941 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.139420 Nov 09 20:12:48.015887 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 340/673] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:12:47 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:12:48.456299 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-73d05566-342a-4933-b18d-53ae858f411e tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:12:48.457007 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-73d05566-342a-4933-b18d-53ae858f411e tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:12:48.464024 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-73d05566-342a-4933-b18d-53ae858f411e tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:48.464509 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-73d05566-342a-4933-b18d-53ae858f411e tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:48.465281 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-73d05566-342a-4933-b18d-53ae858f411e tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:48.465716 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-73d05566-342a-4933-b18d-53ae858f411e tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:48.599212 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-73d05566-342a-4933-b18d-53ae858f411e tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:12:48.607534 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-73d05566-342a-4933-b18d-53ae858f411e tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:12:48.609060 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-73d05566-342a-4933-b18d-53ae858f411e tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:12:48.610208 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-73d05566-342a-4933-b18d-53ae858f411e tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1753 microversion: 2.20 time: 0.157579 Nov 09 20:12:48.610762 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 334/674] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:12:48 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1753 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:12:49.026663 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-c1c230bc-b38c-4f45-93f1-762f549d558f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:12:49.027596 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-c1c230bc-b38c-4f45-93f1-762f549d558f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:12:49.033893 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c1c230bc-b38c-4f45-93f1-762f549d558f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:49.034336 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c1c230bc-b38c-4f45-93f1-762f549d558f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:49.035104 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c1c230bc-b38c-4f45-93f1-762f549d558f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:49.035533 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c1c230bc-b38c-4f45-93f1-762f549d558f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:49.064376 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-c1c230bc-b38c-4f45-93f1-762f549d558f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041464 Nov 09 20:12:49.064939 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 341/675] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:12:49 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:12:49.628634 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-22bd6e2a-30f0-43ef-ac14-b5dc758005fa tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:12:49.629229 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-22bd6e2a-30f0-43ef-ac14-b5dc758005fa tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:12:49.635934 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-22bd6e2a-30f0-43ef-ac14-b5dc758005fa tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:49.636371 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-22bd6e2a-30f0-43ef-ac14-b5dc758005fa tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:49.637154 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-22bd6e2a-30f0-43ef-ac14-b5dc758005fa tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:49.637575 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-22bd6e2a-30f0-43ef-ac14-b5dc758005fa tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:49.764590 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-22bd6e2a-30f0-43ef-ac14-b5dc758005fa tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:12:49.773491 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-22bd6e2a-30f0-43ef-ac14-b5dc758005fa tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:12:49.774985 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-22bd6e2a-30f0-43ef-ac14-b5dc758005fa tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:12:49.776128 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-22bd6e2a-30f0-43ef-ac14-b5dc758005fa tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1753 microversion: 2.20 time: 0.151128 Nov 09 20:12:49.776727 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 335/676] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:12:49 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1753 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:12:50.075627 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-0b4039ed-163f-43f0-b277-138256f801cc tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:12:50.076471 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-0b4039ed-163f-43f0-b277-138256f801cc tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:12:50.082592 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-0b4039ed-163f-43f0-b277-138256f801cc tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:50.083604 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-0b4039ed-163f-43f0-b277-138256f801cc tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:50.084365 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-0b4039ed-163f-43f0-b277-138256f801cc tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:50.084812 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-0b4039ed-163f-43f0-b277-138256f801cc tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:50.113160 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-0b4039ed-163f-43f0-b277-138256f801cc tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041322 Nov 09 20:12:50.113689 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 342/677] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:12:50 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:12:50.794862 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-3c263484-08ec-4bb3-bc9c-c687cd2b58b4 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:12:50.795470 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-3c263484-08ec-4bb3-bc9c-c687cd2b58b4 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:12:50.802313 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3c263484-08ec-4bb3-bc9c-c687cd2b58b4 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:50.802755 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3c263484-08ec-4bb3-bc9c-c687cd2b58b4 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:50.803526 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3c263484-08ec-4bb3-bc9c-c687cd2b58b4 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:50.803960 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3c263484-08ec-4bb3-bc9c-c687cd2b58b4 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:50.931691 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-3c263484-08ec-4bb3-bc9c-c687cd2b58b4 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:12:50.940197 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-3c263484-08ec-4bb3-bc9c-c687cd2b58b4 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:12:50.941743 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-3c263484-08ec-4bb3-bc9c-c687cd2b58b4 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:12:50.943834 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-3c263484-08ec-4bb3-bc9c-c687cd2b58b4 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1753 microversion: 2.20 time: 0.152666 Nov 09 20:12:50.944424 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 336/678] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:12:50 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1753 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:12:51.124751 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-15dd21dc-4944-4f50-a0a7-1baaa45eb95e tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:12:51.125977 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-15dd21dc-4944-4f50-a0a7-1baaa45eb95e tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:12:51.132099 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-15dd21dc-4944-4f50-a0a7-1baaa45eb95e tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:51.132584 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-15dd21dc-4944-4f50-a0a7-1baaa45eb95e tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:51.133356 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-15dd21dc-4944-4f50-a0a7-1baaa45eb95e tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:51.133792 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-15dd21dc-4944-4f50-a0a7-1baaa45eb95e tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:51.162374 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-15dd21dc-4944-4f50-a0a7-1baaa45eb95e tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041332 Nov 09 20:12:51.163164 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 343/679] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:12:51 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:12:51.962243 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-1f363890-59d4-48ea-8cf1-63d9618a4bbd tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:12:51.962837 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-1f363890-59d4-48ea-8cf1-63d9618a4bbd tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:12:51.969026 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1f363890-59d4-48ea-8cf1-63d9618a4bbd tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:51.969466 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1f363890-59d4-48ea-8cf1-63d9618a4bbd tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:51.970221 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1f363890-59d4-48ea-8cf1-63d9618a4bbd tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:51.970647 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1f363890-59d4-48ea-8cf1-63d9618a4bbd tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:52.103038 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-1f363890-59d4-48ea-8cf1-63d9618a4bbd tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:12:52.111364 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-1f363890-59d4-48ea-8cf1-63d9618a4bbd tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:12:52.112868 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-1f363890-59d4-48ea-8cf1-63d9618a4bbd tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:12:52.114515 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-1f363890-59d4-48ea-8cf1-63d9618a4bbd tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1753 microversion: 2.20 time: 0.156070 Nov 09 20:12:52.115065 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 337/680] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:12:51 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1753 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:12:52.173396 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-b8e940d7-19a4-4a5a-8bcc-c8081db2a1b6 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:12:52.174294 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-b8e940d7-19a4-4a5a-8bcc-c8081db2a1b6 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:12:52.181019 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b8e940d7-19a4-4a5a-8bcc-c8081db2a1b6 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:52.181460 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b8e940d7-19a4-4a5a-8bcc-c8081db2a1b6 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:52.182223 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b8e940d7-19a4-4a5a-8bcc-c8081db2a1b6 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:52.182650 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b8e940d7-19a4-4a5a-8bcc-c8081db2a1b6 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:52.210923 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-b8e940d7-19a4-4a5a-8bcc-c8081db2a1b6 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041164 Nov 09 20:12:52.211454 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 344/681] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:12:52 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:12:53.132752 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-9fd038d7-e3a9-48e2-b02f-70ecd4cd7bf7 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:12:53.133353 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-9fd038d7-e3a9-48e2-b02f-70ecd4cd7bf7 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:12:53.139610 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9fd038d7-e3a9-48e2-b02f-70ecd4cd7bf7 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:53.140066 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9fd038d7-e3a9-48e2-b02f-70ecd4cd7bf7 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:53.140861 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9fd038d7-e3a9-48e2-b02f-70ecd4cd7bf7 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:53.141297 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9fd038d7-e3a9-48e2-b02f-70ecd4cd7bf7 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:53.221871 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-fae43fb3-03a5-4e7b-9dc0-0ec0dd395cb1 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:12:53.222778 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-fae43fb3-03a5-4e7b-9dc0-0ec0dd395cb1 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:12:53.229256 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-fae43fb3-03a5-4e7b-9dc0-0ec0dd395cb1 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:53.229956 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-fae43fb3-03a5-4e7b-9dc0-0ec0dd395cb1 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:53.230734 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-fae43fb3-03a5-4e7b-9dc0-0ec0dd395cb1 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:53.231162 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-fae43fb3-03a5-4e7b-9dc0-0ec0dd395cb1 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:53.261318 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-fae43fb3-03a5-4e7b-9dc0-0ec0dd395cb1 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043052 Nov 09 20:12:53.265044 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 345/682] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:12:53 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 20:12:53.269109 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-9fd038d7-e3a9-48e2-b02f-70ecd4cd7bf7 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:12:53.278010 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-9fd038d7-e3a9-48e2-b02f-70ecd4cd7bf7 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:12:53.279522 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-9fd038d7-e3a9-48e2-b02f-70ecd4cd7bf7 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:12:53.280889 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-9fd038d7-e3a9-48e2-b02f-70ecd4cd7bf7 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1747 microversion: 2.20 time: 0.151809 Nov 09 20:12:53.281443 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 338/683] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:12:53 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1747 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 09 20:12:54.272841 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-fba361cf-1485-4c6a-be68-43c690b695a0 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:12:54.273841 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-fba361cf-1485-4c6a-be68-43c690b695a0 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:12:54.280253 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-fba361cf-1485-4c6a-be68-43c690b695a0 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:54.280735 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-fba361cf-1485-4c6a-be68-43c690b695a0 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:54.281512 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-fba361cf-1485-4c6a-be68-43c690b695a0 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:54.281946 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-fba361cf-1485-4c6a-be68-43c690b695a0 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:54.298835 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-bc3dc67b-2710-4055-ab46-ed200a5cdb9d tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:12:54.299440 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-bc3dc67b-2710-4055-ab46-ed200a5cdb9d tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:12:54.306450 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bc3dc67b-2710-4055-ab46-ed200a5cdb9d tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:54.306896 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bc3dc67b-2710-4055-ab46-ed200a5cdb9d tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:54.307698 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bc3dc67b-2710-4055-ab46-ed200a5cdb9d tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:54.308128 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bc3dc67b-2710-4055-ab46-ed200a5cdb9d tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:54.311773 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-fba361cf-1485-4c6a-be68-43c690b695a0 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042940 Nov 09 20:12:54.312333 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 346/684] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:12:54 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:12:54.439109 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-bc3dc67b-2710-4055-ab46-ed200a5cdb9d tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:12:54.447200 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-bc3dc67b-2710-4055-ab46-ed200a5cdb9d tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:12:54.448724 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-bc3dc67b-2710-4055-ab46-ed200a5cdb9d tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:12:54.449971 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-bc3dc67b-2710-4055-ab46-ed200a5cdb9d tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1747 microversion: 2.20 time: 0.154828 Nov 09 20:12:54.450534 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 339/685] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:12:54 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1747 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 09 20:12:55.323156 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-2eaef7cf-96f8-4cd4-8b2b-8073d743163a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:12:55.324065 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-2eaef7cf-96f8-4cd4-8b2b-8073d743163a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:12:55.330290 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-2eaef7cf-96f8-4cd4-8b2b-8073d743163a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:55.330734 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-2eaef7cf-96f8-4cd4-8b2b-8073d743163a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:55.331504 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-2eaef7cf-96f8-4cd4-8b2b-8073d743163a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:55.331933 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-2eaef7cf-96f8-4cd4-8b2b-8073d743163a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:55.361651 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-2eaef7cf-96f8-4cd4-8b2b-8073d743163a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042231 Nov 09 20:12:55.362196 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 347/686] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:12:55 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:12:55.468550 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-740fcd7d-6812-43dd-a427-388d14b1b4b9 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:12:55.469149 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-740fcd7d-6812-43dd-a427-388d14b1b4b9 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:12:55.475319 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-740fcd7d-6812-43dd-a427-388d14b1b4b9 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:55.475771 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-740fcd7d-6812-43dd-a427-388d14b1b4b9 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:55.476595 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-740fcd7d-6812-43dd-a427-388d14b1b4b9 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:55.477019 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-740fcd7d-6812-43dd-a427-388d14b1b4b9 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:55.605022 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-740fcd7d-6812-43dd-a427-388d14b1b4b9 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:12:55.613033 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-740fcd7d-6812-43dd-a427-388d14b1b4b9 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:12:55.614618 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-740fcd7d-6812-43dd-a427-388d14b1b4b9 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:12:55.615764 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-740fcd7d-6812-43dd-a427-388d14b1b4b9 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1747 microversion: 2.20 time: 0.150995 Nov 09 20:12:55.616323 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 340/687] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:12:55 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1747 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:12:56.373335 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-62fa6e2e-c5d4-4f7d-b1bd-008c7bd8c0a8 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:12:56.374243 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-62fa6e2e-c5d4-4f7d-b1bd-008c7bd8c0a8 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:12:56.381105 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-62fa6e2e-c5d4-4f7d-b1bd-008c7bd8c0a8 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:56.381553 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-62fa6e2e-c5d4-4f7d-b1bd-008c7bd8c0a8 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:56.382329 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-62fa6e2e-c5d4-4f7d-b1bd-008c7bd8c0a8 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:56.382763 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-62fa6e2e-c5d4-4f7d-b1bd-008c7bd8c0a8 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:56.411319 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-62fa6e2e-c5d4-4f7d-b1bd-008c7bd8c0a8 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041468 Nov 09 20:12:56.411876 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 348/688] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:12:56 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:12:56.635118 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-a5ed5b22-98c8-4e62-ad2b-df66d10143c6 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:12:56.635737 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-a5ed5b22-98c8-4e62-ad2b-df66d10143c6 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:12:56.641563 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a5ed5b22-98c8-4e62-ad2b-df66d10143c6 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:56.641997 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a5ed5b22-98c8-4e62-ad2b-df66d10143c6 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:56.642751 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a5ed5b22-98c8-4e62-ad2b-df66d10143c6 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:56.643175 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a5ed5b22-98c8-4e62-ad2b-df66d10143c6 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:56.778736 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-a5ed5b22-98c8-4e62-ad2b-df66d10143c6 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:12:56.787146 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-a5ed5b22-98c8-4e62-ad2b-df66d10143c6 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:12:56.788650 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-a5ed5b22-98c8-4e62-ad2b-df66d10143c6 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:12:56.789789 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-a5ed5b22-98c8-4e62-ad2b-df66d10143c6 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1747 microversion: 2.20 time: 0.158490 Nov 09 20:12:56.790341 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 341/689] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:12:56 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1747 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 09 20:12:57.422564 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-3b5882f3-1a9b-4a9a-a8ac-5bd3e79f47cc tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:12:57.423459 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-3b5882f3-1a9b-4a9a-a8ac-5bd3e79f47cc tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:12:57.430120 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-3b5882f3-1a9b-4a9a-a8ac-5bd3e79f47cc tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:57.430595 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-3b5882f3-1a9b-4a9a-a8ac-5bd3e79f47cc tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:57.431356 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-3b5882f3-1a9b-4a9a-a8ac-5bd3e79f47cc tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:57.431781 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-3b5882f3-1a9b-4a9a-a8ac-5bd3e79f47cc tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:57.460268 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-3b5882f3-1a9b-4a9a-a8ac-5bd3e79f47cc tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041392 Nov 09 20:12:57.460913 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 349/690] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:12:57 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:12:57.810154 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-73e6a4d8-da15-4029-92b3-d8396beb4901 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:12:57.810753 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-73e6a4d8-da15-4029-92b3-d8396beb4901 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:12:57.818111 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-73e6a4d8-da15-4029-92b3-d8396beb4901 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:57.818851 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-73e6a4d8-da15-4029-92b3-d8396beb4901 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:57.820307 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-73e6a4d8-da15-4029-92b3-d8396beb4901 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:57.820806 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-73e6a4d8-da15-4029-92b3-d8396beb4901 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:57.954405 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-73e6a4d8-da15-4029-92b3-d8396beb4901 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:12:57.963662 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-73e6a4d8-da15-4029-92b3-d8396beb4901 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:12:57.965179 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-73e6a4d8-da15-4029-92b3-d8396beb4901 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:12:57.966310 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-73e6a4d8-da15-4029-92b3-d8396beb4901 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1747 microversion: 2.20 time: 0.159837 Nov 09 20:12:57.966852 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 342/691] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:12:57 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1747 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:12:58.471737 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-68534f40-d7b2-4148-bbf8-1605a211d446 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:12:58.472655 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-68534f40-d7b2-4148-bbf8-1605a211d446 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:12:58.479860 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-68534f40-d7b2-4148-bbf8-1605a211d446 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:58.480297 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-68534f40-d7b2-4148-bbf8-1605a211d446 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:58.481084 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-68534f40-d7b2-4148-bbf8-1605a211d446 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:58.481511 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-68534f40-d7b2-4148-bbf8-1605a211d446 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:58.510195 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-68534f40-d7b2-4148-bbf8-1605a211d446 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042155 Nov 09 20:12:58.510768 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 350/692] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:12:58 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:12:58.984022 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-cc819dab-c04b-4503-8ea1-912c2d30811a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:12:58.984655 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-cc819dab-c04b-4503-8ea1-912c2d30811a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:12:58.991372 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cc819dab-c04b-4503-8ea1-912c2d30811a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:58.991820 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cc819dab-c04b-4503-8ea1-912c2d30811a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:58.992623 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cc819dab-c04b-4503-8ea1-912c2d30811a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:58.993049 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cc819dab-c04b-4503-8ea1-912c2d30811a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:59.135367 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-cc819dab-c04b-4503-8ea1-912c2d30811a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:12:59.144332 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-cc819dab-c04b-4503-8ea1-912c2d30811a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:12:59.145870 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-cc819dab-c04b-4503-8ea1-912c2d30811a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:12:59.147075 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-cc819dab-c04b-4503-8ea1-912c2d30811a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1747 microversion: 2.20 time: 0.166629 Nov 09 20:12:59.148548 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 343/693] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:12:58 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1747 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:12:59.521692 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-0c288d66-1d3a-49c1-ab0e-cb727115b6ab tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:12:59.522506 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-0c288d66-1d3a-49c1-ab0e-cb727115b6ab tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:12:59.528840 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-0c288d66-1d3a-49c1-ab0e-cb727115b6ab tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:59.529287 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-0c288d66-1d3a-49c1-ab0e-cb727115b6ab tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:59.530063 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-0c288d66-1d3a-49c1-ab0e-cb727115b6ab tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:12:59.530490 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-0c288d66-1d3a-49c1-ab0e-cb727115b6ab tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:12:59.560446 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-0c288d66-1d3a-49c1-ab0e-cb727115b6ab tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043360 Nov 09 20:12:59.561014 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 351/694] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:12:59 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:13:00.167800 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-97aa8ac0-eb93-4017-9f6b-50dedcdf8b4f tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:13:00.168388 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-97aa8ac0-eb93-4017-9f6b-50dedcdf8b4f tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:13:00.174519 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-97aa8ac0-eb93-4017-9f6b-50dedcdf8b4f tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:00.174954 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-97aa8ac0-eb93-4017-9f6b-50dedcdf8b4f tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:00.175765 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-97aa8ac0-eb93-4017-9f6b-50dedcdf8b4f tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:00.176130 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-97aa8ac0-eb93-4017-9f6b-50dedcdf8b4f tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:00.312694 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-97aa8ac0-eb93-4017-9f6b-50dedcdf8b4f tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:13:00.320796 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-97aa8ac0-eb93-4017-9f6b-50dedcdf8b4f tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:13:00.322268 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-97aa8ac0-eb93-4017-9f6b-50dedcdf8b4f tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:13:00.323401 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-97aa8ac0-eb93-4017-9f6b-50dedcdf8b4f tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1747 microversion: 2.20 time: 0.159400 Nov 09 20:13:00.323950 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 344/695] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:13:00 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1747 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:13:00.571662 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-cef7eddb-d944-42b0-a860-0ab8cb2ca406 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:13:00.572498 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-cef7eddb-d944-42b0-a860-0ab8cb2ca406 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:13:00.578652 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-cef7eddb-d944-42b0-a860-0ab8cb2ca406 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:00.579091 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-cef7eddb-d944-42b0-a860-0ab8cb2ca406 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:00.579858 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-cef7eddb-d944-42b0-a860-0ab8cb2ca406 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:00.580277 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-cef7eddb-d944-42b0-a860-0ab8cb2ca406 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:00.610247 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-cef7eddb-d944-42b0-a860-0ab8cb2ca406 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042480 Nov 09 20:13:00.610791 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 352/696] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:13:00 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:13:01.342109 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-9809300f-40bd-4c25-a6ed-247c4a668e90 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:13:01.342734 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-9809300f-40bd-4c25-a6ed-247c4a668e90 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:13:01.348882 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9809300f-40bd-4c25-a6ed-247c4a668e90 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:01.349322 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9809300f-40bd-4c25-a6ed-247c4a668e90 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:01.350078 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9809300f-40bd-4c25-a6ed-247c4a668e90 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:01.350499 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9809300f-40bd-4c25-a6ed-247c4a668e90 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:01.477229 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-9809300f-40bd-4c25-a6ed-247c4a668e90 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:13:01.485460 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-9809300f-40bd-4c25-a6ed-247c4a668e90 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:13:01.486924 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-9809300f-40bd-4c25-a6ed-247c4a668e90 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:13:01.488044 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-9809300f-40bd-4c25-a6ed-247c4a668e90 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1747 microversion: 2.20 time: 0.149596 Nov 09 20:13:01.488639 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 345/697] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:13:01 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1747 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:13:01.621646 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-55430dac-c2ac-4c6a-b5e3-4d959defb47f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:13:01.622618 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-55430dac-c2ac-4c6a-b5e3-4d959defb47f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:13:01.628933 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-55430dac-c2ac-4c6a-b5e3-4d959defb47f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:01.629383 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-55430dac-c2ac-4c6a-b5e3-4d959defb47f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:01.630157 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-55430dac-c2ac-4c6a-b5e3-4d959defb47f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:01.630591 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-55430dac-c2ac-4c6a-b5e3-4d959defb47f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:01.658129 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-55430dac-c2ac-4c6a-b5e3-4d959defb47f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040284 Nov 09 20:13:01.658672 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 353/698] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:13:01 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:13:02.507365 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-1b277b44-60f9-4c29-910f-ed0ecd77e552 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:13:02.507957 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-1b277b44-60f9-4c29-910f-ed0ecd77e552 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:13:02.514273 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1b277b44-60f9-4c29-910f-ed0ecd77e552 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:02.514711 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1b277b44-60f9-4c29-910f-ed0ecd77e552 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:02.515473 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1b277b44-60f9-4c29-910f-ed0ecd77e552 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:02.515900 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1b277b44-60f9-4c29-910f-ed0ecd77e552 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:02.655387 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-1b277b44-60f9-4c29-910f-ed0ecd77e552 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:13:02.666136 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-1b277b44-60f9-4c29-910f-ed0ecd77e552 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:13:02.667628 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-1b277b44-60f9-4c29-910f-ed0ecd77e552 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:13:02.668829 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-1b277b44-60f9-4c29-910f-ed0ecd77e552 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1747 microversion: 2.20 time: 0.165925 Nov 09 20:13:02.669139 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-46882dab-64f2-4ea9-96b0-33c8e9acda22 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:13:02.670039 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-46882dab-64f2-4ea9-96b0-33c8e9acda22 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:13:02.672569 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 346/699] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:13:02 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1747 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:13:02.677200 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-46882dab-64f2-4ea9-96b0-33c8e9acda22 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:02.677753 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-46882dab-64f2-4ea9-96b0-33c8e9acda22 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:02.678628 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-46882dab-64f2-4ea9-96b0-33c8e9acda22 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:02.679144 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-46882dab-64f2-4ea9-96b0-33c8e9acda22 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:02.709568 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-46882dab-64f2-4ea9-96b0-33c8e9acda22 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044133 Nov 09 20:13:02.710140 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 354/700] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:13:02 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:13:03.688287 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-8cf63429-633c-4d63-9e17-b22bdec4d89c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:13:03.688910 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-8cf63429-633c-4d63-9e17-b22bdec4d89c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:13:03.695593 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8cf63429-633c-4d63-9e17-b22bdec4d89c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:03.696028 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8cf63429-633c-4d63-9e17-b22bdec4d89c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:03.696814 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8cf63429-633c-4d63-9e17-b22bdec4d89c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:03.697239 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8cf63429-633c-4d63-9e17-b22bdec4d89c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:03.719761 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-44fc86ed-983b-45d4-ac89-ba0f9de3250f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:13:03.720750 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-44fc86ed-983b-45d4-ac89-ba0f9de3250f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:13:03.727372 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-44fc86ed-983b-45d4-ac89-ba0f9de3250f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:03.727813 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-44fc86ed-983b-45d4-ac89-ba0f9de3250f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:03.728616 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-44fc86ed-983b-45d4-ac89-ba0f9de3250f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:03.729045 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-44fc86ed-983b-45d4-ac89-ba0f9de3250f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:03.758363 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-44fc86ed-983b-45d4-ac89-ba0f9de3250f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042234 Nov 09 20:13:03.758926 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 355/701] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:13:03 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 20:13:03.825461 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-8cf63429-633c-4d63-9e17-b22bdec4d89c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:13:03.833700 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-8cf63429-633c-4d63-9e17-b22bdec4d89c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:13:03.835200 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-8cf63429-633c-4d63-9e17-b22bdec4d89c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:13:03.836354 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-8cf63429-633c-4d63-9e17-b22bdec4d89c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1747 microversion: 2.20 time: 0.151761 Nov 09 20:13:03.836943 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 347/702] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:13:03 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1747 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:13:04.769535 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-5a78c587-4b2f-4fde-b394-5558bdf07f1c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:13:04.771061 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-5a78c587-4b2f-4fde-b394-5558bdf07f1c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:13:04.777214 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-5a78c587-4b2f-4fde-b394-5558bdf07f1c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:04.777656 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-5a78c587-4b2f-4fde-b394-5558bdf07f1c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:04.778415 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-5a78c587-4b2f-4fde-b394-5558bdf07f1c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:04.778840 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-5a78c587-4b2f-4fde-b394-5558bdf07f1c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:04.807202 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-5a78c587-4b2f-4fde-b394-5558bdf07f1c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041337 Nov 09 20:13:04.807742 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 356/703] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:13:04 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:13:04.855237 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-54293c9e-17ef-48f7-8269-e9b3f90e3d6f tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:13:04.855840 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-54293c9e-17ef-48f7-8269-e9b3f90e3d6f tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:13:04.862053 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-54293c9e-17ef-48f7-8269-e9b3f90e3d6f tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:04.862507 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-54293c9e-17ef-48f7-8269-e9b3f90e3d6f tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:04.863282 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-54293c9e-17ef-48f7-8269-e9b3f90e3d6f tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:04.864300 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-54293c9e-17ef-48f7-8269-e9b3f90e3d6f tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:04.990679 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-54293c9e-17ef-48f7-8269-e9b3f90e3d6f tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:13:04.998728 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-54293c9e-17ef-48f7-8269-e9b3f90e3d6f tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:13:05.000221 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-54293c9e-17ef-48f7-8269-e9b3f90e3d6f tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:13:05.001403 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-54293c9e-17ef-48f7-8269-e9b3f90e3d6f tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1747 microversion: 2.20 time: 0.150331 Nov 09 20:13:05.001964 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 348/704] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:13:04 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1747 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:13:05.818733 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-e741b444-a104-4f96-952e-3ecf6c43c891 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:13:05.819639 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-e741b444-a104-4f96-952e-3ecf6c43c891 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:13:05.825806 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e741b444-a104-4f96-952e-3ecf6c43c891 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:05.826246 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e741b444-a104-4f96-952e-3ecf6c43c891 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:05.827012 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e741b444-a104-4f96-952e-3ecf6c43c891 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:05.827436 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e741b444-a104-4f96-952e-3ecf6c43c891 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:05.855887 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-e741b444-a104-4f96-952e-3ecf6c43c891 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041523 Nov 09 20:13:05.856442 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 357/705] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:13:05 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:13:06.020263 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-c8be7eb9-4c21-4917-8a07-ca709b0500ba tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:13:06.020855 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-c8be7eb9-4c21-4917-8a07-ca709b0500ba tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:13:06.026940 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c8be7eb9-4c21-4917-8a07-ca709b0500ba tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:06.027375 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c8be7eb9-4c21-4917-8a07-ca709b0500ba tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:06.028135 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c8be7eb9-4c21-4917-8a07-ca709b0500ba tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:06.028593 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c8be7eb9-4c21-4917-8a07-ca709b0500ba tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:06.157891 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-c8be7eb9-4c21-4917-8a07-ca709b0500ba tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:13:06.166574 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-c8be7eb9-4c21-4917-8a07-ca709b0500ba tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:13:06.168056 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-c8be7eb9-4c21-4917-8a07-ca709b0500ba tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:13:06.169222 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-c8be7eb9-4c21-4917-8a07-ca709b0500ba tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1747 microversion: 2.20 time: 0.152721 Nov 09 20:13:06.169778 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 349/706] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:13:06 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1747 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:13:06.867716 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-c6feac34-4dd0-43bd-b50b-16422ecfa552 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:13:06.868681 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-c6feac34-4dd0-43bd-b50b-16422ecfa552 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:13:06.874970 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c6feac34-4dd0-43bd-b50b-16422ecfa552 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:06.875423 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c6feac34-4dd0-43bd-b50b-16422ecfa552 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:06.876194 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c6feac34-4dd0-43bd-b50b-16422ecfa552 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:06.876661 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c6feac34-4dd0-43bd-b50b-16422ecfa552 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:06.905852 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-c6feac34-4dd0-43bd-b50b-16422ecfa552 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042703 Nov 09 20:13:06.906391 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 358/707] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:13:06 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:13:07.186954 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-756716cc-818d-4dc3-8fc6-408462bf06ec tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:13:07.187468 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-756716cc-818d-4dc3-8fc6-408462bf06ec tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:13:07.193756 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-756716cc-818d-4dc3-8fc6-408462bf06ec tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:07.194204 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-756716cc-818d-4dc3-8fc6-408462bf06ec tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:07.194992 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-756716cc-818d-4dc3-8fc6-408462bf06ec tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:07.195407 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-756716cc-818d-4dc3-8fc6-408462bf06ec tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:07.324650 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-756716cc-818d-4dc3-8fc6-408462bf06ec tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:13:07.333360 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-756716cc-818d-4dc3-8fc6-408462bf06ec tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:13:07.334861 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-756716cc-818d-4dc3-8fc6-408462bf06ec tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:13:07.335998 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-756716cc-818d-4dc3-8fc6-408462bf06ec tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1747 microversion: 2.20 time: 0.152879 Nov 09 20:13:07.336576 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 350/708] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:13:07 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1747 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:13:07.917778 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-c7d32f08-dd12-4d93-bfd0-a5a922987cd6 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:13:07.918691 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-c7d32f08-dd12-4d93-bfd0-a5a922987cd6 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:13:07.924630 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c7d32f08-dd12-4d93-bfd0-a5a922987cd6 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:07.925080 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c7d32f08-dd12-4d93-bfd0-a5a922987cd6 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:07.925848 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c7d32f08-dd12-4d93-bfd0-a5a922987cd6 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:07.926418 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c7d32f08-dd12-4d93-bfd0-a5a922987cd6 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:07.954366 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-c7d32f08-dd12-4d93-bfd0-a5a922987cd6 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040227 Nov 09 20:13:07.954845 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 359/709] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:13:07 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:13:08.354183 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-5d7169f4-61e0-4849-bf8a-3e7ef22469fd tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:13:08.355104 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-5d7169f4-61e0-4849-bf8a-3e7ef22469fd tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:13:08.363141 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5d7169f4-61e0-4849-bf8a-3e7ef22469fd tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:08.363738 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5d7169f4-61e0-4849-bf8a-3e7ef22469fd tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:08.364769 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5d7169f4-61e0-4849-bf8a-3e7ef22469fd tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:08.365201 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5d7169f4-61e0-4849-bf8a-3e7ef22469fd tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:08.499952 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-5d7169f4-61e0-4849-bf8a-3e7ef22469fd tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:13:08.508074 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-5d7169f4-61e0-4849-bf8a-3e7ef22469fd tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:13:08.509595 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-5d7169f4-61e0-4849-bf8a-3e7ef22469fd tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:13:08.510726 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-5d7169f4-61e0-4849-bf8a-3e7ef22469fd tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1747 microversion: 2.20 time: 0.160143 Nov 09 20:13:08.511279 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 351/710] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:13:08 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1747 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:13:08.966497 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-a298d32a-4268-485b-9c8c-e2c655bf5bf5 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:13:08.967402 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-a298d32a-4268-485b-9c8c-e2c655bf5bf5 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:13:08.974258 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a298d32a-4268-485b-9c8c-e2c655bf5bf5 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:08.974707 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a298d32a-4268-485b-9c8c-e2c655bf5bf5 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:08.975484 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a298d32a-4268-485b-9c8c-e2c655bf5bf5 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:08.975914 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a298d32a-4268-485b-9c8c-e2c655bf5bf5 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:09.003816 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-a298d32a-4268-485b-9c8c-e2c655bf5bf5 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041060 Nov 09 20:13:09.005015 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 360/711] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:13:08 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 20:13:09.528706 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-61f7d7ad-6950-42e8-a972-33daf22c5319 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:13:09.529307 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-61f7d7ad-6950-42e8-a972-33daf22c5319 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:13:09.535502 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-61f7d7ad-6950-42e8-a972-33daf22c5319 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:09.535896 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-61f7d7ad-6950-42e8-a972-33daf22c5319 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:09.536697 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-61f7d7ad-6950-42e8-a972-33daf22c5319 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:09.537130 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-61f7d7ad-6950-42e8-a972-33daf22c5319 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:09.662335 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-61f7d7ad-6950-42e8-a972-33daf22c5319 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:13:09.670330 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-61f7d7ad-6950-42e8-a972-33daf22c5319 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:13:09.671803 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-61f7d7ad-6950-42e8-a972-33daf22c5319 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:13:09.672978 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-61f7d7ad-6950-42e8-a972-33daf22c5319 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1747 microversion: 2.20 time: 0.147985 Nov 09 20:13:09.673524 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 352/712] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:13:09 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1747 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:13:10.016054 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-dfd8ec23-4400-4268-8c4f-63f825632dc4 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:13:10.016982 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-dfd8ec23-4400-4268-8c4f-63f825632dc4 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:13:10.023967 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-dfd8ec23-4400-4268-8c4f-63f825632dc4 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:10.024470 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-dfd8ec23-4400-4268-8c4f-63f825632dc4 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:10.025250 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-dfd8ec23-4400-4268-8c4f-63f825632dc4 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:10.025684 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-dfd8ec23-4400-4268-8c4f-63f825632dc4 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:10.054337 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-dfd8ec23-4400-4268-8c4f-63f825632dc4 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042523 Nov 09 20:13:10.054876 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 361/713] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:13:10 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:13:10.691398 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-de4d846b-e9d7-45ec-8e17-07cd9c3dda31 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:13:10.692144 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-de4d846b-e9d7-45ec-8e17-07cd9c3dda31 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:13:10.698351 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-de4d846b-e9d7-45ec-8e17-07cd9c3dda31 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:10.698796 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-de4d846b-e9d7-45ec-8e17-07cd9c3dda31 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:10.699576 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-de4d846b-e9d7-45ec-8e17-07cd9c3dda31 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:10.700008 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-de4d846b-e9d7-45ec-8e17-07cd9c3dda31 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:10.829220 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-de4d846b-e9d7-45ec-8e17-07cd9c3dda31 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:13:10.837908 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-de4d846b-e9d7-45ec-8e17-07cd9c3dda31 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:13:10.839399 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-de4d846b-e9d7-45ec-8e17-07cd9c3dda31 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:13:10.840581 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-de4d846b-e9d7-45ec-8e17-07cd9c3dda31 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1747 microversion: 2.20 time: 0.152778 Nov 09 20:13:10.841139 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 353/714] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:13:10 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1747 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:13:11.065594 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-bb7a7f72-eea4-4606-a006-f15cbb69f7fd tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:13:11.066474 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-bb7a7f72-eea4-4606-a006-f15cbb69f7fd tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:13:11.072621 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-bb7a7f72-eea4-4606-a006-f15cbb69f7fd tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:11.073063 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-bb7a7f72-eea4-4606-a006-f15cbb69f7fd tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:11.073826 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-bb7a7f72-eea4-4606-a006-f15cbb69f7fd tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:11.074253 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-bb7a7f72-eea4-4606-a006-f15cbb69f7fd tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:11.102910 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-bb7a7f72-eea4-4606-a006-f15cbb69f7fd tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041078 Nov 09 20:13:11.103449 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 362/715] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:13:11 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:13:11.858993 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-a2a9dbef-7334-451d-b320-69b4f96baa9a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:13:11.859589 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-a2a9dbef-7334-451d-b320-69b4f96baa9a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:13:11.866628 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a2a9dbef-7334-451d-b320-69b4f96baa9a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:11.867063 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a2a9dbef-7334-451d-b320-69b4f96baa9a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:11.867816 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a2a9dbef-7334-451d-b320-69b4f96baa9a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:11.868237 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a2a9dbef-7334-451d-b320-69b4f96baa9a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:11.994467 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-a2a9dbef-7334-451d-b320-69b4f96baa9a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:13:12.002488 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-a2a9dbef-7334-451d-b320-69b4f96baa9a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:13:12.003982 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-a2a9dbef-7334-451d-b320-69b4f96baa9a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:13:12.005340 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-a2a9dbef-7334-451d-b320-69b4f96baa9a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1747 microversion: 2.20 time: 0.149983 Nov 09 20:13:12.005892 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 354/716] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:13:11 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1747 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:13:12.115103 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-41561262-d4ee-414f-852a-97be47738294 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:13:12.115927 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-41561262-d4ee-414f-852a-97be47738294 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:13:12.122067 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-41561262-d4ee-414f-852a-97be47738294 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:12.122517 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-41561262-d4ee-414f-852a-97be47738294 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:12.123283 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-41561262-d4ee-414f-852a-97be47738294 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:12.123735 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-41561262-d4ee-414f-852a-97be47738294 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:12.152409 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-41561262-d4ee-414f-852a-97be47738294 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041849 Nov 09 20:13:12.152989 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 363/717] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:13:12 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:13:13.023942 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-0c4876a8-0c01-4144-9af4-f1dd35b5b44b tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:13:13.024564 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-0c4876a8-0c01-4144-9af4-f1dd35b5b44b tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:13:13.030777 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0c4876a8-0c01-4144-9af4-f1dd35b5b44b tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:13.031212 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0c4876a8-0c01-4144-9af4-f1dd35b5b44b tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:13.031966 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0c4876a8-0c01-4144-9af4-f1dd35b5b44b tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:13.032391 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0c4876a8-0c01-4144-9af4-f1dd35b5b44b tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:13.157616 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-0c4876a8-0c01-4144-9af4-f1dd35b5b44b tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:13:13.164525 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-de9c43c5-1295-4ad3-a584-fdc129c2070f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:13:13.165443 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-de9c43c5-1295-4ad3-a584-fdc129c2070f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:13:13.166061 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-0c4876a8-0c01-4144-9af4-f1dd35b5b44b tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:13:13.167843 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-0c4876a8-0c01-4144-9af4-f1dd35b5b44b tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:13:13.169015 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-0c4876a8-0c01-4144-9af4-f1dd35b5b44b tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1747 microversion: 2.20 time: 0.149317 Nov 09 20:13:13.169570 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 355/718] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:13:13 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1747 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:13:13.171670 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-de9c43c5-1295-4ad3-a584-fdc129c2070f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:13.172122 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-de9c43c5-1295-4ad3-a584-fdc129c2070f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:13.173046 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-de9c43c5-1295-4ad3-a584-fdc129c2070f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:13.173483 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-de9c43c5-1295-4ad3-a584-fdc129c2070f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:13.203295 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-de9c43c5-1295-4ad3-a584-fdc129c2070f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042778 Nov 09 20:13:13.203835 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 364/719] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:13:13 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 20:13:14.186861 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-74f14060-2db8-4bcc-9893-b14a5b96a5c3 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:13:14.187431 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-74f14060-2db8-4bcc-9893-b14a5b96a5c3 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:13:14.194143 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-74f14060-2db8-4bcc-9893-b14a5b96a5c3 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:14.194582 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-74f14060-2db8-4bcc-9893-b14a5b96a5c3 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:14.195335 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-74f14060-2db8-4bcc-9893-b14a5b96a5c3 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:14.195758 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-74f14060-2db8-4bcc-9893-b14a5b96a5c3 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:14.214592 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-40742007-b359-4e27-a231-5c283c41243a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:13:14.215482 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-40742007-b359-4e27-a231-5c283c41243a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:13:14.221615 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-40742007-b359-4e27-a231-5c283c41243a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:14.222056 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-40742007-b359-4e27-a231-5c283c41243a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:14.223070 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-40742007-b359-4e27-a231-5c283c41243a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:14.223520 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-40742007-b359-4e27-a231-5c283c41243a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:14.252387 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-40742007-b359-4e27-a231-5c283c41243a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041420 Nov 09 20:13:14.253247 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 365/720] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:13:14 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 20:13:14.327676 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-74f14060-2db8-4bcc-9893-b14a5b96a5c3 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:13:14.336549 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-74f14060-2db8-4bcc-9893-b14a5b96a5c3 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:13:14.338032 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-74f14060-2db8-4bcc-9893-b14a5b96a5c3 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:13:14.339172 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-74f14060-2db8-4bcc-9893-b14a5b96a5c3 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1747 microversion: 2.20 time: 0.156017 Nov 09 20:13:14.339728 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 356/721] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:13:14 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1747 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:13:15.264483 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-d68b46cf-ed6a-4215-a0f1-6783c200585a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:13:15.265378 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-d68b46cf-ed6a-4215-a0f1-6783c200585a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:13:15.271115 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d68b46cf-ed6a-4215-a0f1-6783c200585a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:15.271556 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d68b46cf-ed6a-4215-a0f1-6783c200585a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:15.272314 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d68b46cf-ed6a-4215-a0f1-6783c200585a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:15.272768 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d68b46cf-ed6a-4215-a0f1-6783c200585a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:15.302646 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-d68b46cf-ed6a-4215-a0f1-6783c200585a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041929 Nov 09 20:13:15.303208 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 366/722] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:13:15 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:13:15.357490 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-2969a4a9-a81e-4afd-8529-6c9500f3ee5e tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:13:15.358087 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-2969a4a9-a81e-4afd-8529-6c9500f3ee5e tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:13:15.364207 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2969a4a9-a81e-4afd-8529-6c9500f3ee5e tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:15.364688 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2969a4a9-a81e-4afd-8529-6c9500f3ee5e tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:15.365457 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2969a4a9-a81e-4afd-8529-6c9500f3ee5e tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:15.365883 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2969a4a9-a81e-4afd-8529-6c9500f3ee5e tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:15.492508 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-2969a4a9-a81e-4afd-8529-6c9500f3ee5e tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:13:15.500633 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-2969a4a9-a81e-4afd-8529-6c9500f3ee5e tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:13:15.502127 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-2969a4a9-a81e-4afd-8529-6c9500f3ee5e tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:13:15.503271 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-2969a4a9-a81e-4afd-8529-6c9500f3ee5e tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1747 microversion: 2.20 time: 0.149988 Nov 09 20:13:15.503817 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 357/723] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:13:15 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1747 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:13:16.314037 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-1e340286-281b-4911-ac14-e8706ed763b9 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:13:16.314943 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-1e340286-281b-4911-ac14-e8706ed763b9 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:13:16.321136 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-1e340286-281b-4911-ac14-e8706ed763b9 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:16.321585 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-1e340286-281b-4911-ac14-e8706ed763b9 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:16.322354 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-1e340286-281b-4911-ac14-e8706ed763b9 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:16.322783 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-1e340286-281b-4911-ac14-e8706ed763b9 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:16.351647 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-1e340286-281b-4911-ac14-e8706ed763b9 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041325 Nov 09 20:13:16.352189 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 367/724] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:13:16 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:13:16.521929 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-f33558eb-f28f-4c6b-a1b5-fa078aaf188e tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:13:16.522514 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-f33558eb-f28f-4c6b-a1b5-fa078aaf188e tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:13:16.528670 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f33558eb-f28f-4c6b-a1b5-fa078aaf188e tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:16.529107 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f33558eb-f28f-4c6b-a1b5-fa078aaf188e tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:16.529856 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f33558eb-f28f-4c6b-a1b5-fa078aaf188e tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:16.530278 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f33558eb-f28f-4c6b-a1b5-fa078aaf188e tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:16.659354 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-f33558eb-f28f-4c6b-a1b5-fa078aaf188e tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:13:16.667917 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-f33558eb-f28f-4c6b-a1b5-fa078aaf188e tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:13:16.669432 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-f33558eb-f28f-4c6b-a1b5-fa078aaf188e tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:13:16.670567 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-f33558eb-f28f-4c6b-a1b5-fa078aaf188e tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1747 microversion: 2.20 time: 0.153061 Nov 09 20:13:16.671121 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 358/725] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:13:16 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1747 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:13:17.362928 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-3017f276-5746-4af4-bbeb-891975ba7ebd tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:13:17.364036 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-3017f276-5746-4af4-bbeb-891975ba7ebd tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:13:17.370392 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-3017f276-5746-4af4-bbeb-891975ba7ebd tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:17.370875 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-3017f276-5746-4af4-bbeb-891975ba7ebd tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:17.371639 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-3017f276-5746-4af4-bbeb-891975ba7ebd tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:17.372065 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-3017f276-5746-4af4-bbeb-891975ba7ebd tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:17.400892 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-3017f276-5746-4af4-bbeb-891975ba7ebd tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041689 Nov 09 20:13:17.401447 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 368/726] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:13:17 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:13:17.690108 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-071d59ad-3433-4ed1-b3ab-dcd273cd276d tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:13:17.690706 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-071d59ad-3433-4ed1-b3ab-dcd273cd276d tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:13:17.696920 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-071d59ad-3433-4ed1-b3ab-dcd273cd276d tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:17.697363 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-071d59ad-3433-4ed1-b3ab-dcd273cd276d tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:17.698132 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-071d59ad-3433-4ed1-b3ab-dcd273cd276d tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:17.698567 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-071d59ad-3433-4ed1-b3ab-dcd273cd276d tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:17.828462 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-071d59ad-3433-4ed1-b3ab-dcd273cd276d tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:13:17.837177 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-071d59ad-3433-4ed1-b3ab-dcd273cd276d tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:13:17.839732 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-071d59ad-3433-4ed1-b3ab-dcd273cd276d tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:13:17.840034 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-071d59ad-3433-4ed1-b3ab-dcd273cd276d tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1747 microversion: 2.20 time: 0.154427 Nov 09 20:13:17.841349 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 359/727] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:13:17 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1747 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:13:18.411565 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-a0c24ccc-8358-4a71-85d2-2ef3c26466c7 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:13:18.412482 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-a0c24ccc-8358-4a71-85d2-2ef3c26466c7 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:13:18.418644 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a0c24ccc-8358-4a71-85d2-2ef3c26466c7 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:18.419085 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a0c24ccc-8358-4a71-85d2-2ef3c26466c7 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:18.419849 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a0c24ccc-8358-4a71-85d2-2ef3c26466c7 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:18.420278 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a0c24ccc-8358-4a71-85d2-2ef3c26466c7 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:18.449265 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-a0c24ccc-8358-4a71-85d2-2ef3c26466c7 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041322 Nov 09 20:13:18.449937 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 369/728] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:13:18 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:13:18.858828 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-69eb1a4b-51ec-4d40-b459-1ffe0237055e tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:13:18.859430 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-69eb1a4b-51ec-4d40-b459-1ffe0237055e tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:13:18.866513 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-69eb1a4b-51ec-4d40-b459-1ffe0237055e tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:18.866961 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-69eb1a4b-51ec-4d40-b459-1ffe0237055e tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:18.867739 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-69eb1a4b-51ec-4d40-b459-1ffe0237055e tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:18.868168 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-69eb1a4b-51ec-4d40-b459-1ffe0237055e tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:18.997226 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-69eb1a4b-51ec-4d40-b459-1ffe0237055e tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:13:19.005315 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-69eb1a4b-51ec-4d40-b459-1ffe0237055e tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:13:19.006786 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-69eb1a4b-51ec-4d40-b459-1ffe0237055e tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:13:19.007917 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-69eb1a4b-51ec-4d40-b459-1ffe0237055e tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1747 microversion: 2.20 time: 0.153017 Nov 09 20:13:19.008498 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 360/729] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:13:18 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1747 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 09 20:13:19.461575 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-ea722278-b69e-41f6-8efe-0965cd367931 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:13:19.462540 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-ea722278-b69e-41f6-8efe-0965cd367931 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:13:19.468707 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ea722278-b69e-41f6-8efe-0965cd367931 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:19.469146 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ea722278-b69e-41f6-8efe-0965cd367931 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:19.469906 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ea722278-b69e-41f6-8efe-0965cd367931 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:19.470332 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ea722278-b69e-41f6-8efe-0965cd367931 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:19.499430 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-ea722278-b69e-41f6-8efe-0965cd367931 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042376 Nov 09 20:13:19.500185 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 370/730] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:13:19 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:13:20.027075 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-accb683e-59f6-4c41-91c9-ad671e6e658b tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:13:20.027675 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-accb683e-59f6-4c41-91c9-ad671e6e658b tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:13:20.033825 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-accb683e-59f6-4c41-91c9-ad671e6e658b tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:20.034260 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-accb683e-59f6-4c41-91c9-ad671e6e658b tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:20.035031 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-accb683e-59f6-4c41-91c9-ad671e6e658b tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:20.035557 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-accb683e-59f6-4c41-91c9-ad671e6e658b tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:20.165924 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-accb683e-59f6-4c41-91c9-ad671e6e658b tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:13:20.174164 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-accb683e-59f6-4c41-91c9-ad671e6e658b tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:13:20.175640 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-accb683e-59f6-4c41-91c9-ad671e6e658b tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:13:20.177393 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-accb683e-59f6-4c41-91c9-ad671e6e658b tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1747 microversion: 2.20 time: 0.154385 Nov 09 20:13:20.177951 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 361/731] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:13:20 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1747 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:13:20.510944 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-4a91bd71-0fb8-4ed4-9397-2e73783279ca tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:13:20.511847 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-4a91bd71-0fb8-4ed4-9397-2e73783279ca tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:13:20.518005 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-4a91bd71-0fb8-4ed4-9397-2e73783279ca tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:20.518446 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-4a91bd71-0fb8-4ed4-9397-2e73783279ca tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:20.519210 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-4a91bd71-0fb8-4ed4-9397-2e73783279ca tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:20.519642 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-4a91bd71-0fb8-4ed4-9397-2e73783279ca tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:20.548357 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-4a91bd71-0fb8-4ed4-9397-2e73783279ca tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041122 Nov 09 20:13:20.548867 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 371/732] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:13:20 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:13:21.195097 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-d43213aa-71cb-4476-8934-36da584ff3b4 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:13:21.195612 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-d43213aa-71cb-4476-8934-36da584ff3b4 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:13:21.201810 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d43213aa-71cb-4476-8934-36da584ff3b4 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:21.202247 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d43213aa-71cb-4476-8934-36da584ff3b4 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:21.203000 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d43213aa-71cb-4476-8934-36da584ff3b4 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:21.203422 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d43213aa-71cb-4476-8934-36da584ff3b4 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:21.332227 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-d43213aa-71cb-4476-8934-36da584ff3b4 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:13:21.340636 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-d43213aa-71cb-4476-8934-36da584ff3b4 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:13:21.342125 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-d43213aa-71cb-4476-8934-36da584ff3b4 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:13:21.343262 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-d43213aa-71cb-4476-8934-36da584ff3b4 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1747 microversion: 2.20 time: 0.152388 Nov 09 20:13:21.343815 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 362/733] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:13:21 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1747 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:13:21.560135 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-cfe68bef-30e0-45dc-9964-0036e22f2a2d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:13:21.560991 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-cfe68bef-30e0-45dc-9964-0036e22f2a2d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:13:21.567087 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-cfe68bef-30e0-45dc-9964-0036e22f2a2d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:21.567524 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-cfe68bef-30e0-45dc-9964-0036e22f2a2d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:21.568280 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-cfe68bef-30e0-45dc-9964-0036e22f2a2d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:21.568737 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-cfe68bef-30e0-45dc-9964-0036e22f2a2d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:21.597054 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-cfe68bef-30e0-45dc-9964-0036e22f2a2d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040703 Nov 09 20:13:21.597596 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 372/734] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:13:21 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:13:22.361439 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-ad7378d4-2854-4348-a600-578198e47b7c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:13:22.362057 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-ad7378d4-2854-4348-a600-578198e47b7c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:13:22.368860 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ad7378d4-2854-4348-a600-578198e47b7c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:22.369306 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ad7378d4-2854-4348-a600-578198e47b7c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:22.370072 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ad7378d4-2854-4348-a600-578198e47b7c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:22.370505 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ad7378d4-2854-4348-a600-578198e47b7c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:22.502866 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-ad7378d4-2854-4348-a600-578198e47b7c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:13:22.511021 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-ad7378d4-2854-4348-a600-578198e47b7c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:13:22.512509 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-ad7378d4-2854-4348-a600-578198e47b7c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:13:22.513673 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-ad7378d4-2854-4348-a600-578198e47b7c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1747 microversion: 2.20 time: 0.155928 Nov 09 20:13:22.514222 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 363/735] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:13:22 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1747 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:13:22.608121 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-5b8db663-4836-40ad-9119-989c524ba3ae tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:13:22.609078 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-5b8db663-4836-40ad-9119-989c524ba3ae tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:13:22.615382 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-5b8db663-4836-40ad-9119-989c524ba3ae tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:22.615827 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-5b8db663-4836-40ad-9119-989c524ba3ae tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:22.616629 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-5b8db663-4836-40ad-9119-989c524ba3ae tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:22.617061 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-5b8db663-4836-40ad-9119-989c524ba3ae tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:22.646076 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-5b8db663-4836-40ad-9119-989c524ba3ae tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041939 Nov 09 20:13:22.646625 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 373/736] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:13:22 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:13:23.532102 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-18a1de76-e75b-4c34-b115-4ad3f8c8e85d tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:13:23.532730 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-18a1de76-e75b-4c34-b115-4ad3f8c8e85d tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:13:23.539118 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-18a1de76-e75b-4c34-b115-4ad3f8c8e85d tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:23.539518 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-18a1de76-e75b-4c34-b115-4ad3f8c8e85d tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:23.540292 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-18a1de76-e75b-4c34-b115-4ad3f8c8e85d tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:23.540751 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-18a1de76-e75b-4c34-b115-4ad3f8c8e85d tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:23.657479 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-483eb9d8-c76f-4b25-bc69-a27c18c28dca tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:13:23.658474 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-483eb9d8-c76f-4b25-bc69-a27c18c28dca tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:13:23.664881 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-483eb9d8-c76f-4b25-bc69-a27c18c28dca tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:23.665335 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-483eb9d8-c76f-4b25-bc69-a27c18c28dca tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:23.666114 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-483eb9d8-c76f-4b25-bc69-a27c18c28dca tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:23.666569 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-483eb9d8-c76f-4b25-bc69-a27c18c28dca tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:23.668390 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-18a1de76-e75b-4c34-b115-4ad3f8c8e85d tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:13:23.677171 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-18a1de76-e75b-4c34-b115-4ad3f8c8e85d tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:13:23.678641 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-18a1de76-e75b-4c34-b115-4ad3f8c8e85d tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:13:23.679768 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-18a1de76-e75b-4c34-b115-4ad3f8c8e85d tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1747 microversion: 2.20 time: 0.151384 Nov 09 20:13:23.680324 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 364/737] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:13:23 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1747 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:13:23.696914 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-483eb9d8-c76f-4b25-bc69-a27c18c28dca tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043172 Nov 09 20:13:23.697507 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 374/738] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:13:23 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 20:13:24.698416 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-3fd704c2-8024-4905-b8e8-14fb39ea1d69 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:13:24.699010 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-3fd704c2-8024-4905-b8e8-14fb39ea1d69 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:13:24.705213 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3fd704c2-8024-4905-b8e8-14fb39ea1d69 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:24.705662 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3fd704c2-8024-4905-b8e8-14fb39ea1d69 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:24.706431 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3fd704c2-8024-4905-b8e8-14fb39ea1d69 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:24.706860 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3fd704c2-8024-4905-b8e8-14fb39ea1d69 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:24.707857 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-59d5b641-adec-45e5-b314-0adeb67f2b08 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:13:24.708803 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-59d5b641-adec-45e5-b314-0adeb67f2b08 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:13:24.714864 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-59d5b641-adec-45e5-b314-0adeb67f2b08 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:24.715311 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-59d5b641-adec-45e5-b314-0adeb67f2b08 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:24.716094 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-59d5b641-adec-45e5-b314-0adeb67f2b08 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:24.716561 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-59d5b641-adec-45e5-b314-0adeb67f2b08 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:24.746994 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-59d5b641-adec-45e5-b314-0adeb67f2b08 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043074 Nov 09 20:13:24.747565 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 375/739] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:13:24 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 20:13:24.835501 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-3fd704c2-8024-4905-b8e8-14fb39ea1d69 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:13:24.843616 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-3fd704c2-8024-4905-b8e8-14fb39ea1d69 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:13:24.845160 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-3fd704c2-8024-4905-b8e8-14fb39ea1d69 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:13:24.846494 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-3fd704c2-8024-4905-b8e8-14fb39ea1d69 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1747 microversion: 2.20 time: 0.151652 Nov 09 20:13:24.847071 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 365/740] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:13:24 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1747 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:13:25.758204 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-e1a6bebe-6a68-439a-9211-b73909e5bc90 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:13:25.759099 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-e1a6bebe-6a68-439a-9211-b73909e5bc90 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:13:25.766172 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e1a6bebe-6a68-439a-9211-b73909e5bc90 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:25.766628 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e1a6bebe-6a68-439a-9211-b73909e5bc90 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:25.767419 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e1a6bebe-6a68-439a-9211-b73909e5bc90 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:25.767873 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e1a6bebe-6a68-439a-9211-b73909e5bc90 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:25.797062 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-e1a6bebe-6a68-439a-9211-b73909e5bc90 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042534 Nov 09 20:13:25.797621 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 376/741] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:13:25 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:13:25.866221 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-0b4dbf48-8b24-48df-b055-16e7f968bbec tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:13:25.866817 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-0b4dbf48-8b24-48df-b055-16e7f968bbec tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:13:25.872778 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0b4dbf48-8b24-48df-b055-16e7f968bbec tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:25.873274 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0b4dbf48-8b24-48df-b055-16e7f968bbec tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:25.874057 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0b4dbf48-8b24-48df-b055-16e7f968bbec tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:25.874480 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0b4dbf48-8b24-48df-b055-16e7f968bbec tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:26.000619 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-0b4dbf48-8b24-48df-b055-16e7f968bbec tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:13:26.010209 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-0b4dbf48-8b24-48df-b055-16e7f968bbec tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:13:26.010960 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-0b4dbf48-8b24-48df-b055-16e7f968bbec tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:13:26.012093 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-0b4dbf48-8b24-48df-b055-16e7f968bbec tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1747 microversion: 2.20 time: 0.149780 Nov 09 20:13:26.012832 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 366/742] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:13:25 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1747 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:13:26.808367 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-4bb242ef-7b1a-4df4-8d9d-30136136f623 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:13:26.809237 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-4bb242ef-7b1a-4df4-8d9d-30136136f623 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:13:26.815356 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-4bb242ef-7b1a-4df4-8d9d-30136136f623 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:26.815795 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-4bb242ef-7b1a-4df4-8d9d-30136136f623 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:26.817190 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-4bb242ef-7b1a-4df4-8d9d-30136136f623 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:26.817620 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-4bb242ef-7b1a-4df4-8d9d-30136136f623 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:26.845147 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-4bb242ef-7b1a-4df4-8d9d-30136136f623 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040626 Nov 09 20:13:26.845689 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 377/743] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:13:26 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:13:27.031173 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-56d6edc0-fa87-4e89-a77e-c150fa03e1c4 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:13:27.031766 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-56d6edc0-fa87-4e89-a77e-c150fa03e1c4 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:13:27.038033 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-56d6edc0-fa87-4e89-a77e-c150fa03e1c4 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:27.038476 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-56d6edc0-fa87-4e89-a77e-c150fa03e1c4 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:27.039231 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-56d6edc0-fa87-4e89-a77e-c150fa03e1c4 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:27.039657 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-56d6edc0-fa87-4e89-a77e-c150fa03e1c4 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:27.167947 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-56d6edc0-fa87-4e89-a77e-c150fa03e1c4 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:13:27.176703 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-56d6edc0-fa87-4e89-a77e-c150fa03e1c4 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:13:27.178166 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-56d6edc0-fa87-4e89-a77e-c150fa03e1c4 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:13:27.179295 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-56d6edc0-fa87-4e89-a77e-c150fa03e1c4 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1747 microversion: 2.20 time: 0.151812 Nov 09 20:13:27.179841 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 367/744] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:13:27 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1747 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 09 20:13:27.855798 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-92746ae8-69f4-4f16-8da1-a8ea7fbfa216 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:13:27.856804 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-92746ae8-69f4-4f16-8da1-a8ea7fbfa216 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:13:27.862977 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-92746ae8-69f4-4f16-8da1-a8ea7fbfa216 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:27.863522 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-92746ae8-69f4-4f16-8da1-a8ea7fbfa216 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:27.864296 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-92746ae8-69f4-4f16-8da1-a8ea7fbfa216 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:27.864751 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-92746ae8-69f4-4f16-8da1-a8ea7fbfa216 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:27.892541 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-92746ae8-69f4-4f16-8da1-a8ea7fbfa216 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040767 Nov 09 20:13:27.893079 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 378/745] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:13:27 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:13:28.197912 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-d83f9d1d-e3a5-4bd5-befc-b44a02d50ca7 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:13:28.198508 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-d83f9d1d-e3a5-4bd5-befc-b44a02d50ca7 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:13:28.204696 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d83f9d1d-e3a5-4bd5-befc-b44a02d50ca7 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:28.205136 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d83f9d1d-e3a5-4bd5-befc-b44a02d50ca7 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:28.205893 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d83f9d1d-e3a5-4bd5-befc-b44a02d50ca7 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:28.206318 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d83f9d1d-e3a5-4bd5-befc-b44a02d50ca7 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:28.344877 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-d83f9d1d-e3a5-4bd5-befc-b44a02d50ca7 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:13:28.348290 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-d83f9d1d-e3a5-4bd5-befc-b44a02d50ca7 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:13:28.349988 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-d83f9d1d-e3a5-4bd5-befc-b44a02d50ca7 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:13:28.351135 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-d83f9d1d-e3a5-4bd5-befc-b44a02d50ca7 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1747 microversion: 2.20 time: 0.156869 Nov 09 20:13:28.351863 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 368/746] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:13:28 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1747 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:13:28.904577 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-1a974006-23e5-4a4a-bd22-bfe11356cf0b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:13:28.905514 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-1a974006-23e5-4a4a-bd22-bfe11356cf0b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:13:28.912625 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-1a974006-23e5-4a4a-bd22-bfe11356cf0b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:28.913072 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-1a974006-23e5-4a4a-bd22-bfe11356cf0b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:28.913842 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-1a974006-23e5-4a4a-bd22-bfe11356cf0b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:28.914274 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-1a974006-23e5-4a4a-bd22-bfe11356cf0b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:28.942408 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-1a974006-23e5-4a4a-bd22-bfe11356cf0b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041631 Nov 09 20:13:28.942949 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 379/747] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:13:28 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:13:29.369257 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-e186b70a-4de0-4a2f-acca-1f563b29f3e5 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:13:29.369858 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-e186b70a-4de0-4a2f-acca-1f563b29f3e5 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:13:29.376079 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e186b70a-4de0-4a2f-acca-1f563b29f3e5 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:29.376567 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e186b70a-4de0-4a2f-acca-1f563b29f3e5 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:29.377341 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e186b70a-4de0-4a2f-acca-1f563b29f3e5 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:29.377771 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e186b70a-4de0-4a2f-acca-1f563b29f3e5 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:29.507844 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-e186b70a-4de0-4a2f-acca-1f563b29f3e5 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:13:29.515927 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-e186b70a-4de0-4a2f-acca-1f563b29f3e5 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:13:29.517485 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-e186b70a-4de0-4a2f-acca-1f563b29f3e5 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:13:29.518623 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-e186b70a-4de0-4a2f-acca-1f563b29f3e5 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1747 microversion: 2.20 time: 0.153066 Nov 09 20:13:29.519178 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 369/748] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:13:29 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1747 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:13:29.953727 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-bef68b95-a91a-4519-b3ab-be8aa7b2d436 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:13:29.954564 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-bef68b95-a91a-4519-b3ab-be8aa7b2d436 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:13:29.961727 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-bef68b95-a91a-4519-b3ab-be8aa7b2d436 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:29.962172 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-bef68b95-a91a-4519-b3ab-be8aa7b2d436 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:29.962935 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-bef68b95-a91a-4519-b3ab-be8aa7b2d436 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:29.963365 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-bef68b95-a91a-4519-b3ab-be8aa7b2d436 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:29.992223 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-bef68b95-a91a-4519-b3ab-be8aa7b2d436 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042289 Nov 09 20:13:29.992797 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 380/749] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:13:29 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:13:30.537589 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-8eeaec44-039f-43d4-9018-e3bcc3431051 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:13:30.538112 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-8eeaec44-039f-43d4-9018-e3bcc3431051 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:13:30.544170 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8eeaec44-039f-43d4-9018-e3bcc3431051 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:30.544643 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8eeaec44-039f-43d4-9018-e3bcc3431051 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:30.545399 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8eeaec44-039f-43d4-9018-e3bcc3431051 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:30.545821 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8eeaec44-039f-43d4-9018-e3bcc3431051 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:30.677268 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-8eeaec44-039f-43d4-9018-e3bcc3431051 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:13:30.685170 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-8eeaec44-039f-43d4-9018-e3bcc3431051 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:13:30.686633 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-8eeaec44-039f-43d4-9018-e3bcc3431051 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:13:30.687759 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-8eeaec44-039f-43d4-9018-e3bcc3431051 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1747 microversion: 2.20 time: 0.153898 Nov 09 20:13:30.688314 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 370/750] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:13:30 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1747 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:13:31.003394 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-e1aac1e8-beac-45be-87b0-ff9dae6c7664 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:13:31.004835 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-e1aac1e8-beac-45be-87b0-ff9dae6c7664 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:13:31.011019 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e1aac1e8-beac-45be-87b0-ff9dae6c7664 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:31.011468 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e1aac1e8-beac-45be-87b0-ff9dae6c7664 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:31.012266 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e1aac1e8-beac-45be-87b0-ff9dae6c7664 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:31.012773 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e1aac1e8-beac-45be-87b0-ff9dae6c7664 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:31.041617 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-e1aac1e8-beac-45be-87b0-ff9dae6c7664 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041941 Nov 09 20:13:31.042167 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 381/751] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:13:30 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:13:31.706405 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-ef8c9932-b680-4479-b6ff-cefaf1908207 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:13:31.707039 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-ef8c9932-b680-4479-b6ff-cefaf1908207 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:13:31.713265 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ef8c9932-b680-4479-b6ff-cefaf1908207 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:31.713714 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ef8c9932-b680-4479-b6ff-cefaf1908207 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:31.714477 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ef8c9932-b680-4479-b6ff-cefaf1908207 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:31.714909 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ef8c9932-b680-4479-b6ff-cefaf1908207 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:31.844214 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-ef8c9932-b680-4479-b6ff-cefaf1908207 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:13:31.853077 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-ef8c9932-b680-4479-b6ff-cefaf1908207 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:13:31.854575 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-ef8c9932-b680-4479-b6ff-cefaf1908207 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:13:31.855986 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-ef8c9932-b680-4479-b6ff-cefaf1908207 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1747 microversion: 2.20 time: 0.153250 Nov 09 20:13:31.856574 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 371/752] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:13:31 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1747 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:13:32.053357 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-07fcbead-ca20-4383-9909-ed06e01a93b7 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:13:32.054184 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-07fcbead-ca20-4383-9909-ed06e01a93b7 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:13:32.060361 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-07fcbead-ca20-4383-9909-ed06e01a93b7 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:32.060835 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-07fcbead-ca20-4383-9909-ed06e01a93b7 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:32.061604 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-07fcbead-ca20-4383-9909-ed06e01a93b7 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:32.062033 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-07fcbead-ca20-4383-9909-ed06e01a93b7 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:32.090128 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-07fcbead-ca20-4383-9909-ed06e01a93b7 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041086 Nov 09 20:13:32.090662 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 382/753] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:13:32 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:13:32.874164 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-73fd5a76-b7df-495f-a329-b1a18ebd9c17 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:13:32.874764 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-73fd5a76-b7df-495f-a329-b1a18ebd9c17 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:13:32.881547 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-73fd5a76-b7df-495f-a329-b1a18ebd9c17 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:32.881992 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-73fd5a76-b7df-495f-a329-b1a18ebd9c17 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:32.882758 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-73fd5a76-b7df-495f-a329-b1a18ebd9c17 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:32.883186 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-73fd5a76-b7df-495f-a329-b1a18ebd9c17 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:33.008951 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-73fd5a76-b7df-495f-a329-b1a18ebd9c17 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:13:33.017099 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-73fd5a76-b7df-495f-a329-b1a18ebd9c17 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:13:33.018583 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-73fd5a76-b7df-495f-a329-b1a18ebd9c17 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:13:33.019762 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-73fd5a76-b7df-495f-a329-b1a18ebd9c17 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1747 microversion: 2.20 time: 0.149275 Nov 09 20:13:33.020372 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 372/754] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:13:32 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1747 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:13:33.101815 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-ab273020-3f37-43ef-8556-f4de605505a6 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:13:33.102721 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-ab273020-3f37-43ef-8556-f4de605505a6 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:13:33.109188 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ab273020-3f37-43ef-8556-f4de605505a6 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:33.109638 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ab273020-3f37-43ef-8556-f4de605505a6 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:33.110411 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ab273020-3f37-43ef-8556-f4de605505a6 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:33.110846 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ab273020-3f37-43ef-8556-f4de605505a6 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:33.140768 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-ab273020-3f37-43ef-8556-f4de605505a6 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043117 Nov 09 20:13:33.141243 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 383/755] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:13:33 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:13:34.038347 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-591bfebd-b27c-434c-b97d-e67e626a1c0e tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:13:34.038947 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-591bfebd-b27c-434c-b97d-e67e626a1c0e tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:13:34.045246 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-591bfebd-b27c-434c-b97d-e67e626a1c0e tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:34.045686 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-591bfebd-b27c-434c-b97d-e67e626a1c0e tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:34.046440 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-591bfebd-b27c-434c-b97d-e67e626a1c0e tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:34.046871 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-591bfebd-b27c-434c-b97d-e67e626a1c0e tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:34.151285 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-9dc90bbc-8bed-469c-891a-0c7efce3b958 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:13:34.152185 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-9dc90bbc-8bed-469c-891a-0c7efce3b958 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:13:34.158314 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-9dc90bbc-8bed-469c-891a-0c7efce3b958 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:34.158760 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-9dc90bbc-8bed-469c-891a-0c7efce3b958 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:34.159529 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-9dc90bbc-8bed-469c-891a-0c7efce3b958 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:34.159985 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-9dc90bbc-8bed-469c-891a-0c7efce3b958 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:34.185102 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-591bfebd-b27c-434c-b97d-e67e626a1c0e tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:13:34.188776 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-9dc90bbc-8bed-469c-891a-0c7efce3b958 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041097 Nov 09 20:13:34.189337 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 384/756] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:13:34 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 20:13:34.194057 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-591bfebd-b27c-434c-b97d-e67e626a1c0e tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:13:34.195551 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-591bfebd-b27c-434c-b97d-e67e626a1c0e tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:13:34.196793 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-591bfebd-b27c-434c-b97d-e67e626a1c0e tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1747 microversion: 2.20 time: 0.162439 Nov 09 20:13:34.197359 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 373/757] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:13:34 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1747 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:13:35.201223 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-0c43671a-aad0-4c6e-889c-32769a6d955f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:13:35.202128 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-0c43671a-aad0-4c6e-889c-32769a6d955f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:13:35.208900 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-0c43671a-aad0-4c6e-889c-32769a6d955f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:35.209349 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-0c43671a-aad0-4c6e-889c-32769a6d955f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:35.210120 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-0c43671a-aad0-4c6e-889c-32769a6d955f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:35.210551 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-0c43671a-aad0-4c6e-889c-32769a6d955f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:35.215317 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-311c27a1-7750-4b9e-9baa-d59e43397b68 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:13:35.215946 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-311c27a1-7750-4b9e-9baa-d59e43397b68 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:13:35.222060 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-311c27a1-7750-4b9e-9baa-d59e43397b68 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:35.222526 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-311c27a1-7750-4b9e-9baa-d59e43397b68 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:35.223919 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-311c27a1-7750-4b9e-9baa-d59e43397b68 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:35.224354 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-311c27a1-7750-4b9e-9baa-d59e43397b68 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:35.239529 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-0c43671a-aad0-4c6e-889c-32769a6d955f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042039 Nov 09 20:13:35.240079 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 385/758] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:13:35 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:13:35.352763 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-311c27a1-7750-4b9e-9baa-d59e43397b68 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:13:35.361040 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-311c27a1-7750-4b9e-9baa-d59e43397b68 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:13:35.362512 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-311c27a1-7750-4b9e-9baa-d59e43397b68 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:13:35.363767 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-311c27a1-7750-4b9e-9baa-d59e43397b68 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1747 microversion: 2.20 time: 0.152111 Nov 09 20:13:35.364330 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 374/759] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:13:35 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1747 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 09 20:13:36.251022 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-ee8a4974-da2a-4c3d-804a-dcbf03d9de1c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:13:36.251925 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-ee8a4974-da2a-4c3d-804a-dcbf03d9de1c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:13:36.258615 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ee8a4974-da2a-4c3d-804a-dcbf03d9de1c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:36.259068 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ee8a4974-da2a-4c3d-804a-dcbf03d9de1c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:36.259840 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ee8a4974-da2a-4c3d-804a-dcbf03d9de1c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:36.260270 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ee8a4974-da2a-4c3d-804a-dcbf03d9de1c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:36.289639 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-ee8a4974-da2a-4c3d-804a-dcbf03d9de1c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042359 Nov 09 20:13:36.290201 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 386/760] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:13:36 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:13:36.382331 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-bf7987fd-e62c-4f8d-828c-08a8ba7d64c6 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:13:36.382931 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-bf7987fd-e62c-4f8d-828c-08a8ba7d64c6 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:13:36.389138 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bf7987fd-e62c-4f8d-828c-08a8ba7d64c6 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:36.389582 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bf7987fd-e62c-4f8d-828c-08a8ba7d64c6 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:36.390349 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bf7987fd-e62c-4f8d-828c-08a8ba7d64c6 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:36.390776 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bf7987fd-e62c-4f8d-828c-08a8ba7d64c6 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:36.520571 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-bf7987fd-e62c-4f8d-828c-08a8ba7d64c6 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:13:36.528623 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-bf7987fd-e62c-4f8d-828c-08a8ba7d64c6 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:13:36.530093 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-bf7987fd-e62c-4f8d-828c-08a8ba7d64c6 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:13:36.531220 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-bf7987fd-e62c-4f8d-828c-08a8ba7d64c6 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1747 microversion: 2.20 time: 0.152782 Nov 09 20:13:36.531769 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 375/761] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:13:36 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1747 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:13:37.299926 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-b68ef22f-cfca-44fc-9f0c-4a8286d08add tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:13:37.301356 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-b68ef22f-cfca-44fc-9f0c-4a8286d08add tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:13:37.307465 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b68ef22f-cfca-44fc-9f0c-4a8286d08add tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:37.307905 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b68ef22f-cfca-44fc-9f0c-4a8286d08add tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:37.308686 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b68ef22f-cfca-44fc-9f0c-4a8286d08add tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:37.309111 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b68ef22f-cfca-44fc-9f0c-4a8286d08add tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:37.337582 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-b68ef22f-cfca-44fc-9f0c-4a8286d08add tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041391 Nov 09 20:13:37.338128 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 387/762] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:13:37 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:13:37.549486 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-61bccd15-95cf-4e2b-add2-ef86379643b7 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:13:37.550016 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-61bccd15-95cf-4e2b-add2-ef86379643b7 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:13:37.556859 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-61bccd15-95cf-4e2b-add2-ef86379643b7 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:37.557300 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-61bccd15-95cf-4e2b-add2-ef86379643b7 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:37.558069 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-61bccd15-95cf-4e2b-add2-ef86379643b7 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:37.558497 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-61bccd15-95cf-4e2b-add2-ef86379643b7 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:37.683425 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-61bccd15-95cf-4e2b-add2-ef86379643b7 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:13:37.691571 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-61bccd15-95cf-4e2b-add2-ef86379643b7 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:13:37.693085 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-61bccd15-95cf-4e2b-add2-ef86379643b7 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:13:37.694228 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-61bccd15-95cf-4e2b-add2-ef86379643b7 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1747 microversion: 2.20 time: 0.148517 Nov 09 20:13:37.695092 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 376/763] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:13:37 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1747 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:13:38.349403 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-592e46f1-2ab9-4f95-8341-cc4977d4965e tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:13:38.350315 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-592e46f1-2ab9-4f95-8341-cc4977d4965e tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:13:38.356892 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-592e46f1-2ab9-4f95-8341-cc4977d4965e tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:38.357344 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-592e46f1-2ab9-4f95-8341-cc4977d4965e tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:38.358125 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-592e46f1-2ab9-4f95-8341-cc4977d4965e tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:38.358561 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-592e46f1-2ab9-4f95-8341-cc4977d4965e tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:38.386996 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-592e46f1-2ab9-4f95-8341-cc4977d4965e tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041867 Nov 09 20:13:38.387540 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 388/764] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:13:38 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:13:38.711827 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-dbf351f8-d3b2-4e69-ab8e-be834808be6e tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:13:38.712498 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-dbf351f8-d3b2-4e69-ab8e-be834808be6e tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:13:38.718669 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-dbf351f8-d3b2-4e69-ab8e-be834808be6e tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:38.719107 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-dbf351f8-d3b2-4e69-ab8e-be834808be6e tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:38.719858 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-dbf351f8-d3b2-4e69-ab8e-be834808be6e tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:38.720282 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-dbf351f8-d3b2-4e69-ab8e-be834808be6e tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:38.861889 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-dbf351f8-d3b2-4e69-ab8e-be834808be6e tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:13:38.870128 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-dbf351f8-d3b2-4e69-ab8e-be834808be6e tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:13:38.871620 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-dbf351f8-d3b2-4e69-ab8e-be834808be6e tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:13:38.872810 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-dbf351f8-d3b2-4e69-ab8e-be834808be6e tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1747 microversion: 2.20 time: 0.164573 Nov 09 20:13:38.882085 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 377/765] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:13:38 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1747 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:13:39.398257 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-02e44a2d-b5f6-4e79-8eeb-ca7dbe4c527a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:13:39.399165 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-02e44a2d-b5f6-4e79-8eeb-ca7dbe4c527a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:13:39.405427 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-02e44a2d-b5f6-4e79-8eeb-ca7dbe4c527a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:39.405879 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-02e44a2d-b5f6-4e79-8eeb-ca7dbe4c527a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:39.406678 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-02e44a2d-b5f6-4e79-8eeb-ca7dbe4c527a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:39.407109 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-02e44a2d-b5f6-4e79-8eeb-ca7dbe4c527a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:39.435618 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-02e44a2d-b5f6-4e79-8eeb-ca7dbe4c527a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041116 Nov 09 20:13:39.436148 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 389/766] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:13:39 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:13:39.890508 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-b39b727b-7989-4e2c-97fe-d53c1c2062da tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:13:39.891100 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-b39b727b-7989-4e2c-97fe-d53c1c2062da tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:13:39.897369 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b39b727b-7989-4e2c-97fe-d53c1c2062da tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:39.897816 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b39b727b-7989-4e2c-97fe-d53c1c2062da tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:39.898581 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b39b727b-7989-4e2c-97fe-d53c1c2062da tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:39.899001 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b39b727b-7989-4e2c-97fe-d53c1c2062da tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:40.028777 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-b39b727b-7989-4e2c-97fe-d53c1c2062da tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:13:40.037869 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-b39b727b-7989-4e2c-97fe-d53c1c2062da tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:13:40.039365 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-b39b727b-7989-4e2c-97fe-d53c1c2062da tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:13:40.040538 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-b39b727b-7989-4e2c-97fe-d53c1c2062da tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1747 microversion: 2.20 time: 0.153629 Nov 09 20:13:40.041099 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 378/767] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:13:39 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1747 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:13:40.447443 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-6cf9c3ff-fe3c-4d79-88dc-7c6cba31e454 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:13:40.448363 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-6cf9c3ff-fe3c-4d79-88dc-7c6cba31e454 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:13:40.454524 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6cf9c3ff-fe3c-4d79-88dc-7c6cba31e454 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:40.454965 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6cf9c3ff-fe3c-4d79-88dc-7c6cba31e454 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:40.455729 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6cf9c3ff-fe3c-4d79-88dc-7c6cba31e454 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:40.456155 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6cf9c3ff-fe3c-4d79-88dc-7c6cba31e454 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:40.484760 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-6cf9c3ff-fe3c-4d79-88dc-7c6cba31e454 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040979 Nov 09 20:13:40.485295 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 390/768] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:13:40 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:13:41.060056 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-fc8e04c8-0848-4542-9a9f-fa789824a00c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:13:41.060675 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-fc8e04c8-0848-4542-9a9f-fa789824a00c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:13:41.067415 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fc8e04c8-0848-4542-9a9f-fa789824a00c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:41.067849 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fc8e04c8-0848-4542-9a9f-fa789824a00c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:41.068639 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fc8e04c8-0848-4542-9a9f-fa789824a00c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:41.069066 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fc8e04c8-0848-4542-9a9f-fa789824a00c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:41.195577 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-fc8e04c8-0848-4542-9a9f-fa789824a00c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:13:41.203533 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-fc8e04c8-0848-4542-9a9f-fa789824a00c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:13:41.205028 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-fc8e04c8-0848-4542-9a9f-fa789824a00c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:13:41.206154 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-fc8e04c8-0848-4542-9a9f-fa789824a00c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1747 microversion: 2.20 time: 0.149744 Nov 09 20:13:41.206707 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 379/769] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:13:41 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1747 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:13:41.496115 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-a45d814a-49ad-482b-bab4-6f4b3a537c19 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:13:41.496969 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-a45d814a-49ad-482b-bab4-6f4b3a537c19 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:13:41.503049 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a45d814a-49ad-482b-bab4-6f4b3a537c19 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:41.503537 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a45d814a-49ad-482b-bab4-6f4b3a537c19 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:41.504344 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a45d814a-49ad-482b-bab4-6f4b3a537c19 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:41.504789 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a45d814a-49ad-482b-bab4-6f4b3a537c19 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:41.532214 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-a45d814a-49ad-482b-bab4-6f4b3a537c19 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039895 Nov 09 20:13:41.532778 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 391/770] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:13:41 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:13:42.224248 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-31096adf-f0fa-4c29-9e16-e1f42aaead81 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:13:42.224809 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-31096adf-f0fa-4c29-9e16-e1f42aaead81 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:13:42.231315 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-31096adf-f0fa-4c29-9e16-e1f42aaead81 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:42.231821 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-31096adf-f0fa-4c29-9e16-e1f42aaead81 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:42.232563 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-31096adf-f0fa-4c29-9e16-e1f42aaead81 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:42.232998 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-31096adf-f0fa-4c29-9e16-e1f42aaead81 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:42.363098 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-31096adf-f0fa-4c29-9e16-e1f42aaead81 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:13:42.371409 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-31096adf-f0fa-4c29-9e16-e1f42aaead81 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:13:42.372987 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-31096adf-f0fa-4c29-9e16-e1f42aaead81 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:13:42.374128 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-31096adf-f0fa-4c29-9e16-e1f42aaead81 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1747 microversion: 2.20 time: 0.154044 Nov 09 20:13:42.374685 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 380/771] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:13:42 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1747 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:13:42.543017 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-f70bd987-0263-4c2e-8044-716cf618c278 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:13:42.543843 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-f70bd987-0263-4c2e-8044-716cf618c278 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:13:42.550043 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f70bd987-0263-4c2e-8044-716cf618c278 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:42.550638 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f70bd987-0263-4c2e-8044-716cf618c278 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:42.551440 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f70bd987-0263-4c2e-8044-716cf618c278 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:42.551881 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f70bd987-0263-4c2e-8044-716cf618c278 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:42.579613 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-f70bd987-0263-4c2e-8044-716cf618c278 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040488 Nov 09 20:13:42.580165 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 392/772] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:13:42 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:13:43.392081 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-a53da32e-b417-4b90-bafe-500eb5bd557c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:13:43.392697 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-a53da32e-b417-4b90-bafe-500eb5bd557c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:13:43.398843 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a53da32e-b417-4b90-bafe-500eb5bd557c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:43.399301 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a53da32e-b417-4b90-bafe-500eb5bd557c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:43.400035 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a53da32e-b417-4b90-bafe-500eb5bd557c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:43.400480 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a53da32e-b417-4b90-bafe-500eb5bd557c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:43.526578 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-a53da32e-b417-4b90-bafe-500eb5bd557c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:13:43.534630 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-a53da32e-b417-4b90-bafe-500eb5bd557c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:13:43.536827 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-a53da32e-b417-4b90-bafe-500eb5bd557c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:13:43.537893 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-a53da32e-b417-4b90-bafe-500eb5bd557c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1747 microversion: 2.20 time: 0.149529 Nov 09 20:13:43.538444 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 381/773] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:13:43 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1747 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:13:43.591255 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-05e666db-6f34-41e2-bcbf-e266f89c9a84 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:13:43.592153 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-05e666db-6f34-41e2-bcbf-e266f89c9a84 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:13:43.599608 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-05e666db-6f34-41e2-bcbf-e266f89c9a84 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:43.600136 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-05e666db-6f34-41e2-bcbf-e266f89c9a84 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:43.601151 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-05e666db-6f34-41e2-bcbf-e266f89c9a84 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:43.601608 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-05e666db-6f34-41e2-bcbf-e266f89c9a84 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:43.632001 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-05e666db-6f34-41e2-bcbf-e266f89c9a84 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044450 Nov 09 20:13:43.632577 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 393/774] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:13:43 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:13:44.556517 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-16c7f0d1-2884-4eee-8daa-b349c56d5a6e tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:13:44.557061 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-16c7f0d1-2884-4eee-8daa-b349c56d5a6e tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:13:44.563612 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-16c7f0d1-2884-4eee-8daa-b349c56d5a6e tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:44.564051 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-16c7f0d1-2884-4eee-8daa-b349c56d5a6e tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:44.564838 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-16c7f0d1-2884-4eee-8daa-b349c56d5a6e tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:44.565261 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-16c7f0d1-2884-4eee-8daa-b349c56d5a6e tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:44.643366 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-617f22a8-b838-436b-9165-fc3d0508d86c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:13:44.644282 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-617f22a8-b838-436b-9165-fc3d0508d86c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:13:44.651598 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-617f22a8-b838-436b-9165-fc3d0508d86c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:44.652046 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-617f22a8-b838-436b-9165-fc3d0508d86c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:44.652884 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-617f22a8-b838-436b-9165-fc3d0508d86c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:44.653317 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-617f22a8-b838-436b-9165-fc3d0508d86c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:44.683327 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-617f22a8-b838-436b-9165-fc3d0508d86c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043715 Nov 09 20:13:44.683893 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 394/775] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:13:44 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 20:13:44.696534 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-16c7f0d1-2884-4eee-8daa-b349c56d5a6e tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:13:44.704678 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-16c7f0d1-2884-4eee-8daa-b349c56d5a6e tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:13:44.706170 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-16c7f0d1-2884-4eee-8daa-b349c56d5a6e tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:13:44.707307 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-16c7f0d1-2884-4eee-8daa-b349c56d5a6e tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1747 microversion: 2.20 time: 0.155008 Nov 09 20:13:44.707857 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 382/776] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:13:44 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1747 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:13:45.694927 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-80e6c57c-bbc1-4d25-a120-7b221fc66b53 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:13:45.695867 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-80e6c57c-bbc1-4d25-a120-7b221fc66b53 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:13:45.702013 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-80e6c57c-bbc1-4d25-a120-7b221fc66b53 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:45.702467 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-80e6c57c-bbc1-4d25-a120-7b221fc66b53 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:45.703255 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-80e6c57c-bbc1-4d25-a120-7b221fc66b53 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:45.703687 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-80e6c57c-bbc1-4d25-a120-7b221fc66b53 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:45.728952 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-b2288613-e629-4695-ac78-cb3e988d8c19 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:13:45.729563 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-b2288613-e629-4695-ac78-cb3e988d8c19 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:13:45.735676 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-80e6c57c-bbc1-4d25-a120-7b221fc66b53 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044612 Nov 09 20:13:45.735968 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b2288613-e629-4695-ac78-cb3e988d8c19 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:45.736431 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b2288613-e629-4695-ac78-cb3e988d8c19 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:45.736566 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 395/777] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:13:45 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:13:45.738324 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b2288613-e629-4695-ac78-cb3e988d8c19 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:45.738760 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b2288613-e629-4695-ac78-cb3e988d8c19 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:45.890642 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-b2288613-e629-4695-ac78-cb3e988d8c19 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:13:45.899429 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-b2288613-e629-4695-ac78-cb3e988d8c19 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:13:45.900942 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-b2288613-e629-4695-ac78-cb3e988d8c19 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:13:45.902089 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-b2288613-e629-4695-ac78-cb3e988d8c19 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1747 microversion: 2.20 time: 0.178400 Nov 09 20:13:45.902644 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 383/778] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:13:45 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1747 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:13:46.747579 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-e593007d-556f-4937-97fc-1b5ecae7848c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:13:46.748536 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-e593007d-556f-4937-97fc-1b5ecae7848c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:13:46.754742 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e593007d-556f-4937-97fc-1b5ecae7848c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:46.755189 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e593007d-556f-4937-97fc-1b5ecae7848c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:46.755960 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e593007d-556f-4937-97fc-1b5ecae7848c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:46.756390 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e593007d-556f-4937-97fc-1b5ecae7848c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:46.785382 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-e593007d-556f-4937-97fc-1b5ecae7848c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041512 Nov 09 20:13:46.785927 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 396/779] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:13:46 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:13:46.920008 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-0a78d814-ec04-4fdc-8564-406099a5877d tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:13:46.921220 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-0a78d814-ec04-4fdc-8564-406099a5877d tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:13:46.927328 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0a78d814-ec04-4fdc-8564-406099a5877d tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:46.927790 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0a78d814-ec04-4fdc-8564-406099a5877d tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:46.928588 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0a78d814-ec04-4fdc-8564-406099a5877d tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:46.929237 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0a78d814-ec04-4fdc-8564-406099a5877d tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:47.055569 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-0a78d814-ec04-4fdc-8564-406099a5877d tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:13:47.064379 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-0a78d814-ec04-4fdc-8564-406099a5877d tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:13:47.065969 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-0a78d814-ec04-4fdc-8564-406099a5877d tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:13:47.067101 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-0a78d814-ec04-4fdc-8564-406099a5877d tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1747 microversion: 2.20 time: 0.150779 Nov 09 20:13:47.067654 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 384/780] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:13:46 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1747 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:13:47.798422 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-8aa2cf4d-e58a-4879-aa45-6710605a736c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:13:47.799352 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-8aa2cf4d-e58a-4879-aa45-6710605a736c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:13:47.806215 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-8aa2cf4d-e58a-4879-aa45-6710605a736c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:47.806661 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-8aa2cf4d-e58a-4879-aa45-6710605a736c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:47.807428 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-8aa2cf4d-e58a-4879-aa45-6710605a736c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:47.807853 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-8aa2cf4d-e58a-4879-aa45-6710605a736c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:47.836925 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-8aa2cf4d-e58a-4879-aa45-6710605a736c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043441 Nov 09 20:13:47.837668 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 397/781] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:13:47 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:13:48.085055 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-69db696a-6704-4eda-a272-4b8ca2427b82 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:13:48.086348 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-69db696a-6704-4eda-a272-4b8ca2427b82 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:13:48.092753 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-69db696a-6704-4eda-a272-4b8ca2427b82 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:48.093191 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-69db696a-6704-4eda-a272-4b8ca2427b82 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:48.093957 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-69db696a-6704-4eda-a272-4b8ca2427b82 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:48.094378 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-69db696a-6704-4eda-a272-4b8ca2427b82 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:48.226563 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-69db696a-6704-4eda-a272-4b8ca2427b82 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:13:48.235671 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-69db696a-6704-4eda-a272-4b8ca2427b82 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:13:48.237286 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-69db696a-6704-4eda-a272-4b8ca2427b82 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:13:48.238365 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-69db696a-6704-4eda-a272-4b8ca2427b82 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1747 microversion: 2.20 time: 0.157005 Nov 09 20:13:48.240740 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 385/782] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:13:48 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1747 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:13:48.848012 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-138f0a19-b0c9-4d2a-8f9a-130ea0ecb793 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:13:48.849033 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-138f0a19-b0c9-4d2a-8f9a-130ea0ecb793 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:13:48.857974 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-138f0a19-b0c9-4d2a-8f9a-130ea0ecb793 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:48.858427 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-138f0a19-b0c9-4d2a-8f9a-130ea0ecb793 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:48.859209 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-138f0a19-b0c9-4d2a-8f9a-130ea0ecb793 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:48.859642 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-138f0a19-b0c9-4d2a-8f9a-130ea0ecb793 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:48.888472 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-138f0a19-b0c9-4d2a-8f9a-130ea0ecb793 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044136 Nov 09 20:13:48.889026 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 398/783] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:13:48 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:13:49.257841 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-1d9493c8-8b03-4a56-9839-709ab4f900b8 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:13:49.258264 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-1d9493c8-8b03-4a56-9839-709ab4f900b8 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:13:49.264225 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1d9493c8-8b03-4a56-9839-709ab4f900b8 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:49.264707 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1d9493c8-8b03-4a56-9839-709ab4f900b8 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:49.265494 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1d9493c8-8b03-4a56-9839-709ab4f900b8 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:49.265926 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1d9493c8-8b03-4a56-9839-709ab4f900b8 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:49.401582 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-1d9493c8-8b03-4a56-9839-709ab4f900b8 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:13:49.409610 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-1d9493c8-8b03-4a56-9839-709ab4f900b8 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:13:49.411100 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-1d9493c8-8b03-4a56-9839-709ab4f900b8 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:13:49.412270 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-1d9493c8-8b03-4a56-9839-709ab4f900b8 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1747 microversion: 2.20 time: 0.158659 Nov 09 20:13:49.412862 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 386/784] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:13:49 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1747 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:13:49.899945 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-a84fa52d-0c0e-4bf9-8726-ac287f439990 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:13:49.900872 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-a84fa52d-0c0e-4bf9-8726-ac287f439990 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:13:49.907023 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a84fa52d-0c0e-4bf9-8726-ac287f439990 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:49.907467 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a84fa52d-0c0e-4bf9-8726-ac287f439990 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:49.908607 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a84fa52d-0c0e-4bf9-8726-ac287f439990 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:49.909041 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a84fa52d-0c0e-4bf9-8726-ac287f439990 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:49.938515 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-a84fa52d-0c0e-4bf9-8726-ac287f439990 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042639 Nov 09 20:13:49.939068 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 399/785] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:13:49 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:13:50.430824 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-4f25c58d-e92c-4983-b59d-11d988cf37b9 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:13:50.431432 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-4f25c58d-e92c-4983-b59d-11d988cf37b9 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:13:50.437697 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4f25c58d-e92c-4983-b59d-11d988cf37b9 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:50.438163 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4f25c58d-e92c-4983-b59d-11d988cf37b9 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:50.438921 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4f25c58d-e92c-4983-b59d-11d988cf37b9 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:50.439358 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4f25c58d-e92c-4983-b59d-11d988cf37b9 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:50.569110 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-4f25c58d-e92c-4983-b59d-11d988cf37b9 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:13:50.577202 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-4f25c58d-e92c-4983-b59d-11d988cf37b9 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:13:50.578706 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-4f25c58d-e92c-4983-b59d-11d988cf37b9 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:13:50.579841 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-4f25c58d-e92c-4983-b59d-11d988cf37b9 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1747 microversion: 2.20 time: 0.153229 Nov 09 20:13:50.580429 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 387/786] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:13:50 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1747 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:13:50.950194 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-3e030fe6-828d-4471-b7db-e6f83d1e03cc tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:13:50.951093 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-3e030fe6-828d-4471-b7db-e6f83d1e03cc tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:13:50.957296 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-3e030fe6-828d-4471-b7db-e6f83d1e03cc tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:50.957734 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-3e030fe6-828d-4471-b7db-e6f83d1e03cc tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:50.958500 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-3e030fe6-828d-4471-b7db-e6f83d1e03cc tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:50.958928 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-3e030fe6-828d-4471-b7db-e6f83d1e03cc tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:50.987710 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-3e030fe6-828d-4471-b7db-e6f83d1e03cc tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041214 Nov 09 20:13:50.988258 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 400/787] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:13:50 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:13:51.598287 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-cc1c73cc-0fab-4b4c-be45-a20a5b0ae451 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:13:51.598914 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-cc1c73cc-0fab-4b4c-be45-a20a5b0ae451 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:13:51.605845 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cc1c73cc-0fab-4b4c-be45-a20a5b0ae451 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:51.606285 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cc1c73cc-0fab-4b4c-be45-a20a5b0ae451 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:51.607047 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cc1c73cc-0fab-4b4c-be45-a20a5b0ae451 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:51.607474 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cc1c73cc-0fab-4b4c-be45-a20a5b0ae451 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:51.732820 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-cc1c73cc-0fab-4b4c-be45-a20a5b0ae451 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:13:51.740848 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-cc1c73cc-0fab-4b4c-be45-a20a5b0ae451 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:13:51.742962 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-cc1c73cc-0fab-4b4c-be45-a20a5b0ae451 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:13:51.744096 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-cc1c73cc-0fab-4b4c-be45-a20a5b0ae451 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1747 microversion: 2.20 time: 0.149541 Nov 09 20:13:51.744683 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 388/788] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:13:51 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1747 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:13:51.999218 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-27700e43-43b0-48fa-a9e7-80864bad7d0d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:13:52.000110 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-27700e43-43b0-48fa-a9e7-80864bad7d0d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:13:52.006279 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-27700e43-43b0-48fa-a9e7-80864bad7d0d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:52.006767 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-27700e43-43b0-48fa-a9e7-80864bad7d0d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:52.007649 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-27700e43-43b0-48fa-a9e7-80864bad7d0d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:52.008057 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-27700e43-43b0-48fa-a9e7-80864bad7d0d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:52.037464 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-27700e43-43b0-48fa-a9e7-80864bad7d0d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041935 Nov 09 20:13:52.038096 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 401/789] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:13:51 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:13:52.762154 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-d3d4c334-21ec-4ba2-8fa4-eb6f4c8b935c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:13:52.762747 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-d3d4c334-21ec-4ba2-8fa4-eb6f4c8b935c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:13:52.768896 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d3d4c334-21ec-4ba2-8fa4-eb6f4c8b935c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:52.769335 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d3d4c334-21ec-4ba2-8fa4-eb6f4c8b935c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:52.770090 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d3d4c334-21ec-4ba2-8fa4-eb6f4c8b935c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:52.770511 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d3d4c334-21ec-4ba2-8fa4-eb6f4c8b935c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:52.900105 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-d3d4c334-21ec-4ba2-8fa4-eb6f4c8b935c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:13:52.908075 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-d3d4c334-21ec-4ba2-8fa4-eb6f4c8b935c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:13:52.909578 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-d3d4c334-21ec-4ba2-8fa4-eb6f4c8b935c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:13:52.910708 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-d3d4c334-21ec-4ba2-8fa4-eb6f4c8b935c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1747 microversion: 2.20 time: 0.152265 Nov 09 20:13:52.911258 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 389/790] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:13:52 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1747 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:13:53.049319 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-ed505de9-0485-4d15-b5eb-c9c4424865f1 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:13:53.050146 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-ed505de9-0485-4d15-b5eb-c9c4424865f1 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:13:53.057031 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ed505de9-0485-4d15-b5eb-c9c4424865f1 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:53.057484 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ed505de9-0485-4d15-b5eb-c9c4424865f1 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:53.058253 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ed505de9-0485-4d15-b5eb-c9c4424865f1 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:53.058683 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ed505de9-0485-4d15-b5eb-c9c4424865f1 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:53.086680 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-ed505de9-0485-4d15-b5eb-c9c4424865f1 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041148 Nov 09 20:13:53.087256 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 402/791] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:13:53 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:13:53.929210 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-b376ee1c-25f1-4bbc-9043-a2893ee22a34 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:13:53.929801 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-b376ee1c-25f1-4bbc-9043-a2893ee22a34 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:13:53.935895 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b376ee1c-25f1-4bbc-9043-a2893ee22a34 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:53.936334 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b376ee1c-25f1-4bbc-9043-a2893ee22a34 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:53.937124 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b376ee1c-25f1-4bbc-9043-a2893ee22a34 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:53.937550 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b376ee1c-25f1-4bbc-9043-a2893ee22a34 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:54.068367 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-b376ee1c-25f1-4bbc-9043-a2893ee22a34 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:13:54.077014 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-b376ee1c-25f1-4bbc-9043-a2893ee22a34 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:13:54.078489 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-b376ee1c-25f1-4bbc-9043-a2893ee22a34 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:13:54.079618 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-b376ee1c-25f1-4bbc-9043-a2893ee22a34 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1747 microversion: 2.20 time: 0.154067 Nov 09 20:13:54.080166 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 390/792] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:13:53 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1747 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:13:54.097729 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-9408376e-7707-4f1d-bfa1-de3ff41e2a50 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:13:54.098681 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-9408376e-7707-4f1d-bfa1-de3ff41e2a50 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:13:54.105007 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-9408376e-7707-4f1d-bfa1-de3ff41e2a50 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:54.105729 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-9408376e-7707-4f1d-bfa1-de3ff41e2a50 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:54.106513 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-9408376e-7707-4f1d-bfa1-de3ff41e2a50 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:54.106946 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-9408376e-7707-4f1d-bfa1-de3ff41e2a50 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:54.136568 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-9408376e-7707-4f1d-bfa1-de3ff41e2a50 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042472 Nov 09 20:13:54.137117 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 403/793] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:13:54 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:13:55.098414 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-995effc5-8aae-4312-8c74-c03cbbcbc9cc tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:13:55.099005 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-995effc5-8aae-4312-8c74-c03cbbcbc9cc tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:13:55.106073 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-995effc5-8aae-4312-8c74-c03cbbcbc9cc tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:55.106514 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-995effc5-8aae-4312-8c74-c03cbbcbc9cc tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:55.107266 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-995effc5-8aae-4312-8c74-c03cbbcbc9cc tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:55.107691 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-995effc5-8aae-4312-8c74-c03cbbcbc9cc tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:55.146860 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-56047ea7-7c5d-4383-881a-9706eb47b1ba tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:13:55.148531 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-56047ea7-7c5d-4383-881a-9706eb47b1ba tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:13:55.154580 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-56047ea7-7c5d-4383-881a-9706eb47b1ba tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:55.155033 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-56047ea7-7c5d-4383-881a-9706eb47b1ba tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:55.155851 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-56047ea7-7c5d-4383-881a-9706eb47b1ba tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:55.156287 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-56047ea7-7c5d-4383-881a-9706eb47b1ba tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:55.185751 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-56047ea7-7c5d-4383-881a-9706eb47b1ba tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042525 Nov 09 20:13:55.186275 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 404/794] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:13:55 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 20:13:55.234446 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-995effc5-8aae-4312-8c74-c03cbbcbc9cc tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:13:55.243061 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-995effc5-8aae-4312-8c74-c03cbbcbc9cc tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:13:55.244562 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-995effc5-8aae-4312-8c74-c03cbbcbc9cc tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:13:55.245691 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-995effc5-8aae-4312-8c74-c03cbbcbc9cc tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1747 microversion: 2.20 time: 0.150977 Nov 09 20:13:55.246239 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 391/795] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:13:55 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1747 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:13:56.197882 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-970902f7-23f6-40d1-9fd8-a45f59730160 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:13:56.198784 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-970902f7-23f6-40d1-9fd8-a45f59730160 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:13:56.204941 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-970902f7-23f6-40d1-9fd8-a45f59730160 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:56.205384 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-970902f7-23f6-40d1-9fd8-a45f59730160 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:56.206165 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-970902f7-23f6-40d1-9fd8-a45f59730160 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:56.206584 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-970902f7-23f6-40d1-9fd8-a45f59730160 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:56.235635 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-970902f7-23f6-40d1-9fd8-a45f59730160 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042491 Nov 09 20:13:56.236174 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 405/796] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:13:56 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:13:56.263495 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-09572cf8-8a4b-47a9-aa79-0a0ca8d82345 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:13:56.264009 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-09572cf8-8a4b-47a9-aa79-0a0ca8d82345 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:13:56.269740 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-09572cf8-8a4b-47a9-aa79-0a0ca8d82345 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:56.270177 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-09572cf8-8a4b-47a9-aa79-0a0ca8d82345 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:56.270939 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-09572cf8-8a4b-47a9-aa79-0a0ca8d82345 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:56.271363 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-09572cf8-8a4b-47a9-aa79-0a0ca8d82345 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:56.400851 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-09572cf8-8a4b-47a9-aa79-0a0ca8d82345 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:13:56.408820 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-09572cf8-8a4b-47a9-aa79-0a0ca8d82345 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:13:56.410287 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-09572cf8-8a4b-47a9-aa79-0a0ca8d82345 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:13:56.411451 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-09572cf8-8a4b-47a9-aa79-0a0ca8d82345 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1747 microversion: 2.20 time: 0.151843 Nov 09 20:13:56.412001 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 392/797] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:13:56 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1747 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:13:57.247650 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-76021673-f847-4fe7-b0b2-85af4b871d2e tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:13:57.248585 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-76021673-f847-4fe7-b0b2-85af4b871d2e tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:13:57.254838 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-76021673-f847-4fe7-b0b2-85af4b871d2e tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:57.255286 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-76021673-f847-4fe7-b0b2-85af4b871d2e tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:57.256059 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-76021673-f847-4fe7-b0b2-85af4b871d2e tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:57.256518 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-76021673-f847-4fe7-b0b2-85af4b871d2e tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:57.285035 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-76021673-f847-4fe7-b0b2-85af4b871d2e tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041055 Nov 09 20:13:57.285970 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 406/798] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:13:57 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:13:57.429594 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-b340eded-265a-46e8-8dcc-9a07a60cecb4 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:13:57.430189 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-b340eded-265a-46e8-8dcc-9a07a60cecb4 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:13:57.436286 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b340eded-265a-46e8-8dcc-9a07a60cecb4 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:57.436757 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b340eded-265a-46e8-8dcc-9a07a60cecb4 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:57.437515 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b340eded-265a-46e8-8dcc-9a07a60cecb4 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:57.437938 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b340eded-265a-46e8-8dcc-9a07a60cecb4 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:57.563205 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-b340eded-265a-46e8-8dcc-9a07a60cecb4 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:13:57.571414 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-b340eded-265a-46e8-8dcc-9a07a60cecb4 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:13:57.572945 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-b340eded-265a-46e8-8dcc-9a07a60cecb4 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:13:57.574075 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-b340eded-265a-46e8-8dcc-9a07a60cecb4 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1747 microversion: 2.20 time: 0.148351 Nov 09 20:13:57.574621 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 393/799] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:13:57 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1747 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:13:58.296953 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-9b58cfc1-a109-4313-890b-e98d73afdddf tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:13:58.297856 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-9b58cfc1-a109-4313-890b-e98d73afdddf tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:13:58.305195 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-9b58cfc1-a109-4313-890b-e98d73afdddf tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:58.305642 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-9b58cfc1-a109-4313-890b-e98d73afdddf tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:58.306413 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-9b58cfc1-a109-4313-890b-e98d73afdddf tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:58.306845 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-9b58cfc1-a109-4313-890b-e98d73afdddf tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:58.335559 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-9b58cfc1-a109-4313-890b-e98d73afdddf tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041867 Nov 09 20:13:58.336111 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 407/800] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:13:58 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:13:58.592862 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-89863812-7f3a-41cd-87f0-5352f40356d4 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:13:58.593458 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-89863812-7f3a-41cd-87f0-5352f40356d4 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:13:58.599654 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-89863812-7f3a-41cd-87f0-5352f40356d4 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:58.600080 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-89863812-7f3a-41cd-87f0-5352f40356d4 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:58.601573 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-89863812-7f3a-41cd-87f0-5352f40356d4 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:58.602000 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-89863812-7f3a-41cd-87f0-5352f40356d4 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:58.734236 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-89863812-7f3a-41cd-87f0-5352f40356d4 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:13:58.743588 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-89863812-7f3a-41cd-87f0-5352f40356d4 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:13:58.745114 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-89863812-7f3a-41cd-87f0-5352f40356d4 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:13:58.746266 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-89863812-7f3a-41cd-87f0-5352f40356d4 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1747 microversion: 2.20 time: 0.157095 Nov 09 20:13:58.746823 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 394/801] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:13:58 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1747 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:13:59.346482 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-3df079dc-032f-4c2b-bef9-c35e0044f6b7 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:13:59.347392 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-3df079dc-032f-4c2b-bef9-c35e0044f6b7 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:13:59.353822 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-3df079dc-032f-4c2b-bef9-c35e0044f6b7 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:59.354268 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-3df079dc-032f-4c2b-bef9-c35e0044f6b7 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:59.355046 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-3df079dc-032f-4c2b-bef9-c35e0044f6b7 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:59.355758 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-3df079dc-032f-4c2b-bef9-c35e0044f6b7 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:59.384799 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-3df079dc-032f-4c2b-bef9-c35e0044f6b7 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042051 Nov 09 20:13:59.385343 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 408/802] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:13:59 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:13:59.764233 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-6fcb9e43-8ea8-43a9-9caf-a964d81c0cb2 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:13:59.764889 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-6fcb9e43-8ea8-43a9-9caf-a964d81c0cb2 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:13:59.771010 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6fcb9e43-8ea8-43a9-9caf-a964d81c0cb2 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:59.771456 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6fcb9e43-8ea8-43a9-9caf-a964d81c0cb2 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:59.772278 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6fcb9e43-8ea8-43a9-9caf-a964d81c0cb2 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:13:59.772767 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6fcb9e43-8ea8-43a9-9caf-a964d81c0cb2 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:13:59.902141 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-6fcb9e43-8ea8-43a9-9caf-a964d81c0cb2 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:13:59.910139 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-6fcb9e43-8ea8-43a9-9caf-a964d81c0cb2 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:13:59.911608 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-6fcb9e43-8ea8-43a9-9caf-a964d81c0cb2 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:13:59.912767 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-6fcb9e43-8ea8-43a9-9caf-a964d81c0cb2 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1747 microversion: 2.20 time: 0.152116 Nov 09 20:13:59.913823 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 395/803] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:13:59 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1747 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:14:00.396031 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-ab5a8c82-4111-450b-9d43-bc0361ffc83f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:14:00.396978 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-ab5a8c82-4111-450b-9d43-bc0361ffc83f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:14:00.403835 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ab5a8c82-4111-450b-9d43-bc0361ffc83f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:00.404285 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ab5a8c82-4111-450b-9d43-bc0361ffc83f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:00.405107 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ab5a8c82-4111-450b-9d43-bc0361ffc83f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:00.405541 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ab5a8c82-4111-450b-9d43-bc0361ffc83f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:00.434579 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-ab5a8c82-4111-450b-9d43-bc0361ffc83f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042292 Nov 09 20:14:00.435125 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 409/804] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:14:00 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:14:00.930944 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-64849e4f-f5ad-4a7e-b7e0-fb89712d0fb0 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:14:00.931529 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-64849e4f-f5ad-4a7e-b7e0-fb89712d0fb0 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:14:00.937610 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-64849e4f-f5ad-4a7e-b7e0-fb89712d0fb0 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:00.938050 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-64849e4f-f5ad-4a7e-b7e0-fb89712d0fb0 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:00.938807 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-64849e4f-f5ad-4a7e-b7e0-fb89712d0fb0 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:00.939231 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-64849e4f-f5ad-4a7e-b7e0-fb89712d0fb0 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:01.064788 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-64849e4f-f5ad-4a7e-b7e0-fb89712d0fb0 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:14:01.073738 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-64849e4f-f5ad-4a7e-b7e0-fb89712d0fb0 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:14:01.075201 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-64849e4f-f5ad-4a7e-b7e0-fb89712d0fb0 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:14:01.076323 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-64849e4f-f5ad-4a7e-b7e0-fb89712d0fb0 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1747 microversion: 2.20 time: 0.149024 Nov 09 20:14:01.076909 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 396/805] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:14:00 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1747 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:14:01.445941 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-8a459241-58c5-4f6c-859a-667150409bf3 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:14:01.446854 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-8a459241-58c5-4f6c-859a-667150409bf3 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:14:01.453129 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-8a459241-58c5-4f6c-859a-667150409bf3 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:01.453578 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-8a459241-58c5-4f6c-859a-667150409bf3 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:01.454356 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-8a459241-58c5-4f6c-859a-667150409bf3 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:01.454792 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-8a459241-58c5-4f6c-859a-667150409bf3 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:01.483796 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-8a459241-58c5-4f6c-859a-667150409bf3 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041714 Nov 09 20:14:01.484343 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 410/806] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:14:01 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:14:02.094130 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-e4b5a2a2-7743-4106-967b-592a70f6efb4 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:14:02.094730 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-e4b5a2a2-7743-4106-967b-592a70f6efb4 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:14:02.101674 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e4b5a2a2-7743-4106-967b-592a70f6efb4 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:02.102116 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e4b5a2a2-7743-4106-967b-592a70f6efb4 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:02.102882 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e4b5a2a2-7743-4106-967b-592a70f6efb4 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:02.103311 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e4b5a2a2-7743-4106-967b-592a70f6efb4 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:02.234632 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-e4b5a2a2-7743-4106-967b-592a70f6efb4 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:14:02.243340 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-e4b5a2a2-7743-4106-967b-592a70f6efb4 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:14:02.244806 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-e4b5a2a2-7743-4106-967b-592a70f6efb4 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:14:02.245943 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-e4b5a2a2-7743-4106-967b-592a70f6efb4 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1747 microversion: 2.20 time: 0.155483 Nov 09 20:14:02.246501 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 397/807] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:14:02 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1747 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:14:02.495017 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-050b0b28-d2d1-42f7-9cef-37d3167b49ef tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:14:02.496538 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-050b0b28-d2d1-42f7-9cef-37d3167b49ef tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:14:02.502735 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-050b0b28-d2d1-42f7-9cef-37d3167b49ef tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:02.503505 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-050b0b28-d2d1-42f7-9cef-37d3167b49ef tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:02.504276 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-050b0b28-d2d1-42f7-9cef-37d3167b49ef tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:02.504732 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-050b0b28-d2d1-42f7-9cef-37d3167b49ef tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:02.533411 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-050b0b28-d2d1-42f7-9cef-37d3167b49ef tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042233 Nov 09 20:14:02.533964 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 411/808] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:14:02 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:14:03.263967 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-861889a2-2663-4ae6-865a-6525d5da9e23 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:14:03.264547 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-861889a2-2663-4ae6-865a-6525d5da9e23 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:14:03.270752 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-861889a2-2663-4ae6-865a-6525d5da9e23 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:03.271196 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-861889a2-2663-4ae6-865a-6525d5da9e23 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:03.271989 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-861889a2-2663-4ae6-865a-6525d5da9e23 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:03.272688 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-861889a2-2663-4ae6-865a-6525d5da9e23 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:03.400057 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-861889a2-2663-4ae6-865a-6525d5da9e23 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:14:03.408163 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-861889a2-2663-4ae6-865a-6525d5da9e23 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:14:03.409672 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-861889a2-2663-4ae6-865a-6525d5da9e23 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:14:03.410814 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-861889a2-2663-4ae6-865a-6525d5da9e23 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1747 microversion: 2.20 time: 0.150576 Nov 09 20:14:03.411376 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 398/809] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:14:03 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1747 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:14:03.544627 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-b0f4dc6e-8162-4526-9a7f-efddb4e29961 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:14:03.545484 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-b0f4dc6e-8162-4526-9a7f-efddb4e29961 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:14:03.551634 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b0f4dc6e-8162-4526-9a7f-efddb4e29961 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:03.552074 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b0f4dc6e-8162-4526-9a7f-efddb4e29961 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:03.552858 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b0f4dc6e-8162-4526-9a7f-efddb4e29961 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:03.553283 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b0f4dc6e-8162-4526-9a7f-efddb4e29961 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:03.585346 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-b0f4dc6e-8162-4526-9a7f-efddb4e29961 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044515 Nov 09 20:14:03.585898 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 412/810] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:14:03 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:14:04.428887 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-6aecf0b7-1469-49a8-a30c-a7e64fc07f64 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:14:04.429475 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-6aecf0b7-1469-49a8-a30c-a7e64fc07f64 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:14:04.435576 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6aecf0b7-1469-49a8-a30c-a7e64fc07f64 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:04.436017 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6aecf0b7-1469-49a8-a30c-a7e64fc07f64 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:04.436810 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6aecf0b7-1469-49a8-a30c-a7e64fc07f64 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:04.437241 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6aecf0b7-1469-49a8-a30c-a7e64fc07f64 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:04.566108 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-6aecf0b7-1469-49a8-a30c-a7e64fc07f64 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:14:04.574645 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-6aecf0b7-1469-49a8-a30c-a7e64fc07f64 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:14:04.576124 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-6aecf0b7-1469-49a8-a30c-a7e64fc07f64 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:14:04.577308 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-6aecf0b7-1469-49a8-a30c-a7e64fc07f64 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1747 microversion: 2.20 time: 0.152165 Nov 09 20:14:04.577863 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 399/811] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:14:04 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1747 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:14:04.596363 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-34fbba0e-4a09-4ee4-a5ae-310d385757b8 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:14:04.597368 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-34fbba0e-4a09-4ee4-a5ae-310d385757b8 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:14:04.603594 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-34fbba0e-4a09-4ee4-a5ae-310d385757b8 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:04.604044 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-34fbba0e-4a09-4ee4-a5ae-310d385757b8 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:04.604851 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-34fbba0e-4a09-4ee4-a5ae-310d385757b8 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:04.605540 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-34fbba0e-4a09-4ee4-a5ae-310d385757b8 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:04.633902 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-34fbba0e-4a09-4ee4-a5ae-310d385757b8 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041212 Nov 09 20:14:04.634448 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 413/812] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:14:04 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:14:05.595844 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-b0c5845c-50e6-406b-9aa1-10856b72d081 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:14:05.596476 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-b0c5845c-50e6-406b-9aa1-10856b72d081 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:14:05.603262 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b0c5845c-50e6-406b-9aa1-10856b72d081 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:05.603707 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b0c5845c-50e6-406b-9aa1-10856b72d081 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:05.604503 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b0c5845c-50e6-406b-9aa1-10856b72d081 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:05.604938 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b0c5845c-50e6-406b-9aa1-10856b72d081 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:05.644993 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-6acc4e40-9f4e-4624-93fc-9582c70224f2 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:14:05.645904 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-6acc4e40-9f4e-4624-93fc-9582c70224f2 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:14:05.652632 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6acc4e40-9f4e-4624-93fc-9582c70224f2 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:05.653080 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6acc4e40-9f4e-4624-93fc-9582c70224f2 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:05.653867 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6acc4e40-9f4e-4624-93fc-9582c70224f2 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:05.654304 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6acc4e40-9f4e-4624-93fc-9582c70224f2 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:05.683530 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-6acc4e40-9f4e-4624-93fc-9582c70224f2 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041995 Nov 09 20:14:05.684136 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 414/813] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:14:05 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 20:14:05.735068 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-b0c5845c-50e6-406b-9aa1-10856b72d081 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:14:05.743125 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-b0c5845c-50e6-406b-9aa1-10856b72d081 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:14:05.744633 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-b0c5845c-50e6-406b-9aa1-10856b72d081 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:14:05.745770 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-b0c5845c-50e6-406b-9aa1-10856b72d081 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1747 microversion: 2.20 time: 0.153616 Nov 09 20:14:05.746325 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 400/814] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:14:05 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1747 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:14:06.695873 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-011651dc-671c-4de5-83bf-1454aecfa12c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:14:06.696839 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-011651dc-671c-4de5-83bf-1454aecfa12c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:14:06.703035 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-011651dc-671c-4de5-83bf-1454aecfa12c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:06.703490 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-011651dc-671c-4de5-83bf-1454aecfa12c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:06.704268 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-011651dc-671c-4de5-83bf-1454aecfa12c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:06.704726 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-011651dc-671c-4de5-83bf-1454aecfa12c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:06.736661 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-011651dc-671c-4de5-83bf-1454aecfa12c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045011 Nov 09 20:14:06.737998 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 415/815] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:14:06 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:14:06.762708 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-6daace59-b970-4270-b5f8-80e602980db2 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:14:06.763337 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-6daace59-b970-4270-b5f8-80e602980db2 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:14:06.769481 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6daace59-b970-4270-b5f8-80e602980db2 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:06.769927 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6daace59-b970-4270-b5f8-80e602980db2 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:06.770690 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6daace59-b970-4270-b5f8-80e602980db2 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:06.771117 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6daace59-b970-4270-b5f8-80e602980db2 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:06.900684 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-6daace59-b970-4270-b5f8-80e602980db2 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:14:06.908665 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-6daace59-b970-4270-b5f8-80e602980db2 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:14:06.910135 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-6daace59-b970-4270-b5f8-80e602980db2 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:14:06.911267 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-6daace59-b970-4270-b5f8-80e602980db2 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1747 microversion: 2.20 time: 0.152191 Nov 09 20:14:06.911812 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 401/816] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:14:06 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1747 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:14:07.749463 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-5667028e-f614-452d-95f7-75ff69959fe5 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:14:07.750393 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-5667028e-f614-452d-95f7-75ff69959fe5 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:14:07.756743 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-5667028e-f614-452d-95f7-75ff69959fe5 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:07.757190 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-5667028e-f614-452d-95f7-75ff69959fe5 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:07.757960 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-5667028e-f614-452d-95f7-75ff69959fe5 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:07.758404 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-5667028e-f614-452d-95f7-75ff69959fe5 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:07.786654 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-5667028e-f614-452d-95f7-75ff69959fe5 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040926 Nov 09 20:14:07.787197 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 416/817] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:14:07 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:14:07.930517 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-5247001e-7271-45da-98b5-1a2ef3f404d6 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:14:07.931105 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-5247001e-7271-45da-98b5-1a2ef3f404d6 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:14:07.937191 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5247001e-7271-45da-98b5-1a2ef3f404d6 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:07.937631 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5247001e-7271-45da-98b5-1a2ef3f404d6 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:07.938384 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5247001e-7271-45da-98b5-1a2ef3f404d6 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:07.938812 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5247001e-7271-45da-98b5-1a2ef3f404d6 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:08.063606 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-5247001e-7271-45da-98b5-1a2ef3f404d6 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:14:08.072681 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-5247001e-7271-45da-98b5-1a2ef3f404d6 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:14:08.074164 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-5247001e-7271-45da-98b5-1a2ef3f404d6 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:14:08.075352 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-5247001e-7271-45da-98b5-1a2ef3f404d6 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1747 microversion: 2.20 time: 0.149023 Nov 09 20:14:08.075908 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 402/818] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:14:07 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1747 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 09 20:14:08.798818 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-3024a8f3-765e-4b55-8ace-40b52c554c44 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:14:08.799752 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-3024a8f3-765e-4b55-8ace-40b52c554c44 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:14:08.806403 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-3024a8f3-765e-4b55-8ace-40b52c554c44 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:08.806848 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-3024a8f3-765e-4b55-8ace-40b52c554c44 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:08.807616 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-3024a8f3-765e-4b55-8ace-40b52c554c44 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:08.808045 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-3024a8f3-765e-4b55-8ace-40b52c554c44 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:08.836657 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-3024a8f3-765e-4b55-8ace-40b52c554c44 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041571 Nov 09 20:14:08.837205 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 417/819] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:14:08 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:14:09.093538 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-9e424b13-7dce-4985-a472-90b501e81559 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:14:09.094145 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-9e424b13-7dce-4985-a472-90b501e81559 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:14:09.100367 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9e424b13-7dce-4985-a472-90b501e81559 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:09.100934 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9e424b13-7dce-4985-a472-90b501e81559 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:09.101708 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9e424b13-7dce-4985-a472-90b501e81559 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:09.102146 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9e424b13-7dce-4985-a472-90b501e81559 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:09.240686 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-9e424b13-7dce-4985-a472-90b501e81559 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:14:09.249597 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-9e424b13-7dce-4985-a472-90b501e81559 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:14:09.251064 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-9e424b13-7dce-4985-a472-90b501e81559 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:14:09.252328 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-9e424b13-7dce-4985-a472-90b501e81559 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1747 microversion: 2.20 time: 0.162522 Nov 09 20:14:09.252922 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 403/820] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:14:09 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1747 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:14:09.847581 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-4e58b900-1d68-47a6-87c8-51e7807c00a8 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:14:09.848544 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-4e58b900-1d68-47a6-87c8-51e7807c00a8 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:14:09.855951 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-4e58b900-1d68-47a6-87c8-51e7807c00a8 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:09.856419 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-4e58b900-1d68-47a6-87c8-51e7807c00a8 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:09.857187 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-4e58b900-1d68-47a6-87c8-51e7807c00a8 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:09.857623 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-4e58b900-1d68-47a6-87c8-51e7807c00a8 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:09.886684 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-4e58b900-1d68-47a6-87c8-51e7807c00a8 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042813 Nov 09 20:14:09.887223 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 418/821] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:14:09 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:14:10.270783 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-b9e0f1b5-13a2-44a2-b493-ce8248d9e6d2 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:14:10.271390 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-b9e0f1b5-13a2-44a2-b493-ce8248d9e6d2 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:14:10.278244 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b9e0f1b5-13a2-44a2-b493-ce8248d9e6d2 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:10.278695 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b9e0f1b5-13a2-44a2-b493-ce8248d9e6d2 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:10.279476 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b9e0f1b5-13a2-44a2-b493-ce8248d9e6d2 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:10.279912 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b9e0f1b5-13a2-44a2-b493-ce8248d9e6d2 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:10.415176 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-b9e0f1b5-13a2-44a2-b493-ce8248d9e6d2 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:14:10.423555 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-b9e0f1b5-13a2-44a2-b493-ce8248d9e6d2 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:14:10.425073 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-b9e0f1b5-13a2-44a2-b493-ce8248d9e6d2 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:14:10.426209 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-b9e0f1b5-13a2-44a2-b493-ce8248d9e6d2 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1747 microversion: 2.20 time: 0.159172 Nov 09 20:14:10.426776 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 404/822] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:14:10 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1747 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:14:10.897892 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-92b683a5-cdcc-4454-ac64-dadda7bd1ec4 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:14:10.898793 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-92b683a5-cdcc-4454-ac64-dadda7bd1ec4 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:14:10.904889 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-92b683a5-cdcc-4454-ac64-dadda7bd1ec4 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:10.905329 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-92b683a5-cdcc-4454-ac64-dadda7bd1ec4 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:10.906094 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-92b683a5-cdcc-4454-ac64-dadda7bd1ec4 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:10.906516 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-92b683a5-cdcc-4454-ac64-dadda7bd1ec4 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:10.934630 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-92b683a5-cdcc-4454-ac64-dadda7bd1ec4 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040573 Nov 09 20:14:10.935164 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 419/823] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:14:10 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:14:11.444851 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-5496d7e2-5238-4ddc-b021-00c8106a9c5d tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:14:11.445449 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-5496d7e2-5238-4ddc-b021-00c8106a9c5d tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:14:11.451629 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5496d7e2-5238-4ddc-b021-00c8106a9c5d tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:11.452073 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5496d7e2-5238-4ddc-b021-00c8106a9c5d tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:11.452875 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5496d7e2-5238-4ddc-b021-00c8106a9c5d tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:11.453300 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5496d7e2-5238-4ddc-b021-00c8106a9c5d tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:11.580987 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-5496d7e2-5238-4ddc-b021-00c8106a9c5d tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:14:11.589308 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-5496d7e2-5238-4ddc-b021-00c8106a9c5d tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:14:11.590963 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-5496d7e2-5238-4ddc-b021-00c8106a9c5d tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:14:11.592129 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-5496d7e2-5238-4ddc-b021-00c8106a9c5d tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1747 microversion: 2.20 time: 0.151582 Nov 09 20:14:11.592720 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 405/824] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:14:11 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1747 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:14:11.945977 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-706dfea7-d46f-4b5e-83b3-c0163b29f388 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:14:11.946880 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-706dfea7-d46f-4b5e-83b3-c0163b29f388 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:14:11.953052 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-706dfea7-d46f-4b5e-83b3-c0163b29f388 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:11.953492 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-706dfea7-d46f-4b5e-83b3-c0163b29f388 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:11.954263 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-706dfea7-d46f-4b5e-83b3-c0163b29f388 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:11.954696 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-706dfea7-d46f-4b5e-83b3-c0163b29f388 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:11.983797 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-706dfea7-d46f-4b5e-83b3-c0163b29f388 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042024 Nov 09 20:14:11.984332 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 420/825] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:14:11 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:14:12.610942 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-0e653b6a-ab69-47d3-9eaf-b2208ea88e16 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:14:12.611556 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-0e653b6a-ab69-47d3-9eaf-b2208ea88e16 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:14:12.618100 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0e653b6a-ab69-47d3-9eaf-b2208ea88e16 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:12.618548 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0e653b6a-ab69-47d3-9eaf-b2208ea88e16 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:12.619318 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0e653b6a-ab69-47d3-9eaf-b2208ea88e16 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:12.619753 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0e653b6a-ab69-47d3-9eaf-b2208ea88e16 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:12.748105 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-0e653b6a-ab69-47d3-9eaf-b2208ea88e16 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:14:12.756108 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-0e653b6a-ab69-47d3-9eaf-b2208ea88e16 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:14:12.758537 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-0e653b6a-ab69-47d3-9eaf-b2208ea88e16 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:14:12.759671 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-0e653b6a-ab69-47d3-9eaf-b2208ea88e16 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1747 microversion: 2.20 time: 0.152589 Nov 09 20:14:12.760224 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 406/826] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:14:12 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1747 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:14:12.995606 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-810c0c73-32a3-496a-a4fb-6bd7a289a804 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:14:12.996442 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-810c0c73-32a3-496a-a4fb-6bd7a289a804 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:14:13.002364 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-810c0c73-32a3-496a-a4fb-6bd7a289a804 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:13.002807 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-810c0c73-32a3-496a-a4fb-6bd7a289a804 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:13.003566 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-810c0c73-32a3-496a-a4fb-6bd7a289a804 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:13.003991 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-810c0c73-32a3-496a-a4fb-6bd7a289a804 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:13.032388 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-810c0c73-32a3-496a-a4fb-6bd7a289a804 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040636 Nov 09 20:14:13.032953 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 421/827] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:14:12 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:14:13.778228 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-66b73d3c-4aaf-4b2a-a448-c8b5811a8eba tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:14:13.778827 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-66b73d3c-4aaf-4b2a-a448-c8b5811a8eba tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:14:13.785081 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-66b73d3c-4aaf-4b2a-a448-c8b5811a8eba tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:13.785521 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-66b73d3c-4aaf-4b2a-a448-c8b5811a8eba tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:13.786280 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-66b73d3c-4aaf-4b2a-a448-c8b5811a8eba tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:13.786706 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-66b73d3c-4aaf-4b2a-a448-c8b5811a8eba tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:13.913698 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-66b73d3c-4aaf-4b2a-a448-c8b5811a8eba tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:14:13.922034 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-66b73d3c-4aaf-4b2a-a448-c8b5811a8eba tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:14:13.923618 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-66b73d3c-4aaf-4b2a-a448-c8b5811a8eba tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:14:13.924829 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-66b73d3c-4aaf-4b2a-a448-c8b5811a8eba tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1747 microversion: 2.20 time: 0.150234 Nov 09 20:14:13.925377 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 407/828] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:14:13 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1747 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:14:14.044138 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-23ab6920-605b-40ee-9069-0bceba127cce tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:14:14.044979 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-23ab6920-605b-40ee-9069-0bceba127cce tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:14:14.051347 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-23ab6920-605b-40ee-9069-0bceba127cce tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:14.051789 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-23ab6920-605b-40ee-9069-0bceba127cce tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:14.052581 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-23ab6920-605b-40ee-9069-0bceba127cce tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:14.053008 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-23ab6920-605b-40ee-9069-0bceba127cce tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:14.083266 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-23ab6920-605b-40ee-9069-0bceba127cce tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042840 Nov 09 20:14:14.083824 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 422/829] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:14:14 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:14:14.943058 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-ee9428a4-f9da-464d-9b76-0c5266c52822 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:14:14.943661 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-ee9428a4-f9da-464d-9b76-0c5266c52822 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:14:14.950660 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ee9428a4-f9da-464d-9b76-0c5266c52822 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:14.951107 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ee9428a4-f9da-464d-9b76-0c5266c52822 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:14.951917 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ee9428a4-f9da-464d-9b76-0c5266c52822 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:14.952352 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ee9428a4-f9da-464d-9b76-0c5266c52822 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:15.077998 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-ee9428a4-f9da-464d-9b76-0c5266c52822 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:14:15.087275 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-ee9428a4-f9da-464d-9b76-0c5266c52822 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:14:15.088819 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-ee9428a4-f9da-464d-9b76-0c5266c52822 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:14:15.089964 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-ee9428a4-f9da-464d-9b76-0c5266c52822 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1747 microversion: 2.20 time: 0.150554 Nov 09 20:14:15.090519 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 408/830] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:14:14 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1747 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:14:15.094579 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-7547e437-68e0-4336-9135-e00437ecc903 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:14:15.095544 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-7547e437-68e0-4336-9135-e00437ecc903 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:14:15.101746 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-7547e437-68e0-4336-9135-e00437ecc903 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:15.102190 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-7547e437-68e0-4336-9135-e00437ecc903 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:15.102973 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-7547e437-68e0-4336-9135-e00437ecc903 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:15.103398 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-7547e437-68e0-4336-9135-e00437ecc903 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:15.133366 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-7547e437-68e0-4336-9135-e00437ecc903 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042497 Nov 09 20:14:15.133949 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 423/831] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:14:15 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 20:14:16.108611 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-b349801f-acd2-4751-a0aa-91c34cc10560 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:14:16.109210 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-b349801f-acd2-4751-a0aa-91c34cc10560 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:14:16.115428 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b349801f-acd2-4751-a0aa-91c34cc10560 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:16.115879 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b349801f-acd2-4751-a0aa-91c34cc10560 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:16.116835 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b349801f-acd2-4751-a0aa-91c34cc10560 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:16.117268 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b349801f-acd2-4751-a0aa-91c34cc10560 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:16.143848 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-6cb23ab2-ac04-4489-8df3-7d5156f0ff06 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:14:16.144787 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-6cb23ab2-ac04-4489-8df3-7d5156f0ff06 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:14:16.151251 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6cb23ab2-ac04-4489-8df3-7d5156f0ff06 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:16.151694 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6cb23ab2-ac04-4489-8df3-7d5156f0ff06 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:16.152500 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6cb23ab2-ac04-4489-8df3-7d5156f0ff06 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:16.152930 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6cb23ab2-ac04-4489-8df3-7d5156f0ff06 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:16.182572 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-6cb23ab2-ac04-4489-8df3-7d5156f0ff06 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042382 Nov 09 20:14:16.183334 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 424/832] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:14:16 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 20:14:16.248806 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-b349801f-acd2-4751-a0aa-91c34cc10560 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:14:16.257330 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-b349801f-acd2-4751-a0aa-91c34cc10560 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:14:16.258846 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-b349801f-acd2-4751-a0aa-91c34cc10560 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:14:16.260001 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-b349801f-acd2-4751-a0aa-91c34cc10560 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1747 microversion: 2.20 time: 0.155559 Nov 09 20:14:16.260585 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 409/833] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:14:16 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1747 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:14:17.193471 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-b75c1d80-67a2-4673-a3c8-9fa0644aa753 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:14:17.194372 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-b75c1d80-67a2-4673-a3c8-9fa0644aa753 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:14:17.200829 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b75c1d80-67a2-4673-a3c8-9fa0644aa753 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:17.201269 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b75c1d80-67a2-4673-a3c8-9fa0644aa753 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:17.202025 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b75c1d80-67a2-4673-a3c8-9fa0644aa753 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:17.202450 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b75c1d80-67a2-4673-a3c8-9fa0644aa753 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:17.230945 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-b75c1d80-67a2-4673-a3c8-9fa0644aa753 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040981 Nov 09 20:14:17.231486 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 425/834] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:14:17 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:14:17.278263 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-461ec338-4a6f-49df-8819-2b3456bdda7f tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:14:17.278867 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-461ec338-4a6f-49df-8819-2b3456bdda7f tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:14:17.285149 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-461ec338-4a6f-49df-8819-2b3456bdda7f tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:17.285818 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-461ec338-4a6f-49df-8819-2b3456bdda7f tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:17.286385 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-461ec338-4a6f-49df-8819-2b3456bdda7f tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:17.286816 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-461ec338-4a6f-49df-8819-2b3456bdda7f tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:17.415111 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-461ec338-4a6f-49df-8819-2b3456bdda7f tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:14:17.423055 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-461ec338-4a6f-49df-8819-2b3456bdda7f tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:14:17.424547 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-461ec338-4a6f-49df-8819-2b3456bdda7f tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:14:17.425672 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-461ec338-4a6f-49df-8819-2b3456bdda7f tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1747 microversion: 2.20 time: 0.151117 Nov 09 20:14:17.426221 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 410/835] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:14:17 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1747 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:14:18.242733 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-07a4c0ea-78e2-456d-862d-290f4f0fc17c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:14:18.243649 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-07a4c0ea-78e2-456d-862d-290f4f0fc17c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:14:18.249791 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-07a4c0ea-78e2-456d-862d-290f4f0fc17c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:18.250233 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-07a4c0ea-78e2-456d-862d-290f4f0fc17c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:18.250988 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-07a4c0ea-78e2-456d-862d-290f4f0fc17c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:18.251413 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-07a4c0ea-78e2-456d-862d-290f4f0fc17c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:18.280205 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-07a4c0ea-78e2-456d-862d-290f4f0fc17c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041685 Nov 09 20:14:18.280776 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 426/836] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:14:18 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:14:18.444890 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-73671513-eb34-4fd2-852d-539d6890b1c3 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:14:18.445516 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-73671513-eb34-4fd2-852d-539d6890b1c3 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:14:18.451662 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-73671513-eb34-4fd2-852d-539d6890b1c3 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:18.452106 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-73671513-eb34-4fd2-852d-539d6890b1c3 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:18.452895 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-73671513-eb34-4fd2-852d-539d6890b1c3 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:18.453324 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-73671513-eb34-4fd2-852d-539d6890b1c3 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:18.582173 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-73671513-eb34-4fd2-852d-539d6890b1c3 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:14:18.590390 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-73671513-eb34-4fd2-852d-539d6890b1c3 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:14:18.591874 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-73671513-eb34-4fd2-852d-539d6890b1c3 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:14:18.593027 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-73671513-eb34-4fd2-852d-539d6890b1c3 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1747 microversion: 2.20 time: 0.152571 Nov 09 20:14:18.593586 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 411/837] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:14:18 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1747 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:14:19.291599 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-10e210eb-1048-445b-8c25-acbf272ef4cb tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:14:19.292553 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-10e210eb-1048-445b-8c25-acbf272ef4cb tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:14:19.298847 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-10e210eb-1048-445b-8c25-acbf272ef4cb tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:19.299295 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-10e210eb-1048-445b-8c25-acbf272ef4cb tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:19.300062 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-10e210eb-1048-445b-8c25-acbf272ef4cb tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:19.300519 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-10e210eb-1048-445b-8c25-acbf272ef4cb tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:19.328505 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-10e210eb-1048-445b-8c25-acbf272ef4cb tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041251 Nov 09 20:14:19.329053 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 427/838] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:14:19 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:14:19.611906 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-bb43325c-53c0-4ee7-b6f3-33b81f78f5b5 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:14:19.612535 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-bb43325c-53c0-4ee7-b6f3-33b81f78f5b5 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:14:19.618950 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bb43325c-53c0-4ee7-b6f3-33b81f78f5b5 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:19.619393 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bb43325c-53c0-4ee7-b6f3-33b81f78f5b5 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:19.620190 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bb43325c-53c0-4ee7-b6f3-33b81f78f5b5 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:19.620646 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bb43325c-53c0-4ee7-b6f3-33b81f78f5b5 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:19.748910 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-bb43325c-53c0-4ee7-b6f3-33b81f78f5b5 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:14:19.757816 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-bb43325c-53c0-4ee7-b6f3-33b81f78f5b5 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:14:19.759350 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-bb43325c-53c0-4ee7-b6f3-33b81f78f5b5 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:14:19.760534 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-bb43325c-53c0-4ee7-b6f3-33b81f78f5b5 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1747 microversion: 2.20 time: 0.152272 Nov 09 20:14:19.761478 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 412/839] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:14:19 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1747 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:14:20.339938 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-1683607b-52d5-478c-a0e4-97de3c373bbb tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:14:20.340877 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-1683607b-52d5-478c-a0e4-97de3c373bbb tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:14:20.347082 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-1683607b-52d5-478c-a0e4-97de3c373bbb tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:20.347531 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-1683607b-52d5-478c-a0e4-97de3c373bbb tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:20.348307 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-1683607b-52d5-478c-a0e4-97de3c373bbb tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:20.348767 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-1683607b-52d5-478c-a0e4-97de3c373bbb tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:20.377890 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-1683607b-52d5-478c-a0e4-97de3c373bbb tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041679 Nov 09 20:14:20.378437 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 428/840] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:14:20 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:14:20.784443 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-e36827c9-4dbe-4b03-92b1-69e6ad8fca57 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:14:20.785134 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-e36827c9-4dbe-4b03-92b1-69e6ad8fca57 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:14:20.792748 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e36827c9-4dbe-4b03-92b1-69e6ad8fca57 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:20.793198 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e36827c9-4dbe-4b03-92b1-69e6ad8fca57 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:20.793979 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e36827c9-4dbe-4b03-92b1-69e6ad8fca57 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:20.794415 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e36827c9-4dbe-4b03-92b1-69e6ad8fca57 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:20.934122 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-e36827c9-4dbe-4b03-92b1-69e6ad8fca57 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:14:20.942089 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-e36827c9-4dbe-4b03-92b1-69e6ad8fca57 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:14:20.943549 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-e36827c9-4dbe-4b03-92b1-69e6ad8fca57 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:14:20.945191 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-e36827c9-4dbe-4b03-92b1-69e6ad8fca57 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1747 microversion: 2.20 time: 0.164600 Nov 09 20:14:20.945737 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 413/841] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:14:20 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1747 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:14:21.389528 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-f6e233ab-0674-4708-b000-7a499108e676 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:14:21.390428 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-f6e233ab-0674-4708-b000-7a499108e676 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:14:21.396622 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f6e233ab-0674-4708-b000-7a499108e676 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:21.397304 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f6e233ab-0674-4708-b000-7a499108e676 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:21.398077 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f6e233ab-0674-4708-b000-7a499108e676 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:21.398515 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f6e233ab-0674-4708-b000-7a499108e676 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:21.425652 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-f6e233ab-0674-4708-b000-7a499108e676 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039926 Nov 09 20:14:21.426190 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 429/842] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:14:21 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:14:21.963054 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-c47af591-c213-41a6-913e-b695cc39b167 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:14:21.963670 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-c47af591-c213-41a6-913e-b695cc39b167 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:14:21.969868 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c47af591-c213-41a6-913e-b695cc39b167 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:21.970249 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c47af591-c213-41a6-913e-b695cc39b167 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:21.971002 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c47af591-c213-41a6-913e-b695cc39b167 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:21.971426 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c47af591-c213-41a6-913e-b695cc39b167 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:22.096684 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-c47af591-c213-41a6-913e-b695cc39b167 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:14:22.106237 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-c47af591-c213-41a6-913e-b695cc39b167 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:14:22.108057 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-c47af591-c213-41a6-913e-b695cc39b167 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:14:22.109248 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-c47af591-c213-41a6-913e-b695cc39b167 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1747 microversion: 2.20 time: 0.150033 Nov 09 20:14:22.109806 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 414/843] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:14:21 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1747 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:14:22.437440 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-533b2e46-e415-47db-808e-1a5c50995cce tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:14:22.438374 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-533b2e46-e415-47db-808e-1a5c50995cce tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:14:22.445208 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-533b2e46-e415-47db-808e-1a5c50995cce tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:22.445657 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-533b2e46-e415-47db-808e-1a5c50995cce tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:22.446431 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-533b2e46-e415-47db-808e-1a5c50995cce tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:22.446863 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-533b2e46-e415-47db-808e-1a5c50995cce tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:22.477202 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-533b2e46-e415-47db-808e-1a5c50995cce tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043545 Nov 09 20:14:22.477755 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 430/844] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:14:22 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 20:14:23.127965 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-502a17d6-269d-4299-8c4c-0c609d6e6462 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:14:23.128590 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-502a17d6-269d-4299-8c4c-0c609d6e6462 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:14:23.135234 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-502a17d6-269d-4299-8c4c-0c609d6e6462 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:23.135690 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-502a17d6-269d-4299-8c4c-0c609d6e6462 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:23.136442 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-502a17d6-269d-4299-8c4c-0c609d6e6462 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:23.136872 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-502a17d6-269d-4299-8c4c-0c609d6e6462 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:23.261366 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-502a17d6-269d-4299-8c4c-0c609d6e6462 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:14:23.269406 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-502a17d6-269d-4299-8c4c-0c609d6e6462 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:14:23.270849 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-502a17d6-269d-4299-8c4c-0c609d6e6462 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:14:23.272709 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-502a17d6-269d-4299-8c4c-0c609d6e6462 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1747 microversion: 2.20 time: 0.147692 Nov 09 20:14:23.273259 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 415/845] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:14:23 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1747 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:14:23.488794 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-568691cc-fb67-418e-ab51-ec2ad9b6d964 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:14:23.489695 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-568691cc-fb67-418e-ab51-ec2ad9b6d964 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:14:23.496333 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-568691cc-fb67-418e-ab51-ec2ad9b6d964 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:23.496807 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-568691cc-fb67-418e-ab51-ec2ad9b6d964 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:23.497569 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-568691cc-fb67-418e-ab51-ec2ad9b6d964 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:23.497995 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-568691cc-fb67-418e-ab51-ec2ad9b6d964 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:23.526380 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-568691cc-fb67-418e-ab51-ec2ad9b6d964 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041290 Nov 09 20:14:23.526852 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 431/846] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:14:23 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 20:14:24.291250 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-9eacaa5e-79d3-48ab-a315-13c99cabe0f5 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:14:24.291854 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-9eacaa5e-79d3-48ab-a315-13c99cabe0f5 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:14:24.298065 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9eacaa5e-79d3-48ab-a315-13c99cabe0f5 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:24.298515 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9eacaa5e-79d3-48ab-a315-13c99cabe0f5 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:24.299282 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9eacaa5e-79d3-48ab-a315-13c99cabe0f5 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:24.299715 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9eacaa5e-79d3-48ab-a315-13c99cabe0f5 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:24.430319 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-9eacaa5e-79d3-48ab-a315-13c99cabe0f5 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:14:24.438455 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-9eacaa5e-79d3-48ab-a315-13c99cabe0f5 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:14:24.439882 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-9eacaa5e-79d3-48ab-a315-13c99cabe0f5 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:14:24.441029 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-9eacaa5e-79d3-48ab-a315-13c99cabe0f5 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1747 microversion: 2.20 time: 0.154085 Nov 09 20:14:24.441578 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 416/847] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:14:24 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1747 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:14:24.538004 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-daed4360-4b2d-4e38-b209-583cb59bb60b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:14:24.538993 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-daed4360-4b2d-4e38-b209-583cb59bb60b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:14:24.545425 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-daed4360-4b2d-4e38-b209-583cb59bb60b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:24.545933 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-daed4360-4b2d-4e38-b209-583cb59bb60b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:24.546708 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-daed4360-4b2d-4e38-b209-583cb59bb60b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:24.547142 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-daed4360-4b2d-4e38-b209-583cb59bb60b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:24.575842 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-daed4360-4b2d-4e38-b209-583cb59bb60b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042377 Nov 09 20:14:24.576417 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 432/848] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:14:24 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:14:25.458745 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-c70e61dc-9bdd-4ff7-88d4-d27ea0f460fd tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:14:25.459937 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-c70e61dc-9bdd-4ff7-88d4-d27ea0f460fd tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:14:25.466234 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c70e61dc-9bdd-4ff7-88d4-d27ea0f460fd tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:25.466680 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c70e61dc-9bdd-4ff7-88d4-d27ea0f460fd tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:25.467452 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c70e61dc-9bdd-4ff7-88d4-d27ea0f460fd tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:25.467884 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c70e61dc-9bdd-4ff7-88d4-d27ea0f460fd tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:25.553687 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 09 20:14:25.554177 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: Tue Nov 9 20:14:25 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 09 20:14:25.587454 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-0fd267aa-e502-4e98-ba56-9473345f3fa9 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:14:25.588351 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-0fd267aa-e502-4e98-ba56-9473345f3fa9 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:14:25.594840 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-0fd267aa-e502-4e98-ba56-9473345f3fa9 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:25.595669 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-0fd267aa-e502-4e98-ba56-9473345f3fa9 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:25.596509 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-0fd267aa-e502-4e98-ba56-9473345f3fa9 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:25.596943 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-0fd267aa-e502-4e98-ba56-9473345f3fa9 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:25.598063 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-c70e61dc-9bdd-4ff7-88d4-d27ea0f460fd tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:14:25.606661 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-c70e61dc-9bdd-4ff7-88d4-d27ea0f460fd tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:14:25.608241 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-c70e61dc-9bdd-4ff7-88d4-d27ea0f460fd tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:14:25.609522 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-c70e61dc-9bdd-4ff7-88d4-d27ea0f460fd tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1747 microversion: 2.20 time: 0.154438 Nov 09 20:14:25.610083 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 417/849] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:14:25 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1747 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:14:25.626372 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-0fd267aa-e502-4e98-ba56-9473345f3fa9 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043215 Nov 09 20:14:25.626912 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 433/850] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:14:25 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 20:14:26.628147 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-68a16839-c2cd-4691-94ca-4a2b6c5da90e tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:14:26.628803 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-68a16839-c2cd-4691-94ca-4a2b6c5da90e tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:14:26.635480 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-68a16839-c2cd-4691-94ca-4a2b6c5da90e tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:26.635922 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-68a16839-c2cd-4691-94ca-4a2b6c5da90e tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:26.636716 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-68a16839-c2cd-4691-94ca-4a2b6c5da90e tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:26.637053 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-37716f40-697e-4c79-bb39-25dc495a498b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:14:26.637483 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-68a16839-c2cd-4691-94ca-4a2b6c5da90e tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:26.637951 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-37716f40-697e-4c79-bb39-25dc495a498b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:14:26.644019 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-37716f40-697e-4c79-bb39-25dc495a498b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:26.644554 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-37716f40-697e-4c79-bb39-25dc495a498b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:26.645328 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-37716f40-697e-4c79-bb39-25dc495a498b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:26.645754 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-37716f40-697e-4c79-bb39-25dc495a498b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:26.674973 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-37716f40-697e-4c79-bb39-25dc495a498b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041562 Nov 09 20:14:26.675542 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 434/851] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:14:26 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 20:14:26.767029 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-68a16839-c2cd-4691-94ca-4a2b6c5da90e tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:14:26.775293 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-68a16839-c2cd-4691-94ca-4a2b6c5da90e tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:14:26.776962 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-68a16839-c2cd-4691-94ca-4a2b6c5da90e tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:14:26.778090 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-68a16839-c2cd-4691-94ca-4a2b6c5da90e tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1747 microversion: 2.20 time: 0.153775 Nov 09 20:14:26.778642 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 418/852] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:14:26 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1747 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:14:27.686507 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-38cae58c-5cf1-415e-ba2a-960f0c5d9738 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:14:27.687416 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-38cae58c-5cf1-415e-ba2a-960f0c5d9738 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:14:27.694120 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-38cae58c-5cf1-415e-ba2a-960f0c5d9738 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:27.694576 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-38cae58c-5cf1-415e-ba2a-960f0c5d9738 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:27.695459 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-38cae58c-5cf1-415e-ba2a-960f0c5d9738 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:27.695898 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-38cae58c-5cf1-415e-ba2a-960f0c5d9738 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:27.724298 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-38cae58c-5cf1-415e-ba2a-960f0c5d9738 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041549 Nov 09 20:14:27.724970 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 435/853] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:14:27 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:14:27.796001 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-87c46294-21d8-460f-94c2-3301b2237a5b tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:14:27.796679 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-87c46294-21d8-460f-94c2-3301b2237a5b tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:14:27.802776 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-87c46294-21d8-460f-94c2-3301b2237a5b tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:27.803348 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-87c46294-21d8-460f-94c2-3301b2237a5b tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:27.804107 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-87c46294-21d8-460f-94c2-3301b2237a5b tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:27.804565 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-87c46294-21d8-460f-94c2-3301b2237a5b tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:27.930101 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-87c46294-21d8-460f-94c2-3301b2237a5b tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:14:27.938234 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-87c46294-21d8-460f-94c2-3301b2237a5b tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:14:27.939644 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-87c46294-21d8-460f-94c2-3301b2237a5b tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:14:27.940810 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-87c46294-21d8-460f-94c2-3301b2237a5b tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1747 microversion: 2.20 time: 0.148448 Nov 09 20:14:27.941366 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 419/854] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:14:27 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1747 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:14:28.735849 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-4a6a139e-1aac-4b4c-b6e8-5cc96692de8a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:14:28.736795 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-4a6a139e-1aac-4b4c-b6e8-5cc96692de8a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:14:28.743610 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-4a6a139e-1aac-4b4c-b6e8-5cc96692de8a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:28.744046 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-4a6a139e-1aac-4b4c-b6e8-5cc96692de8a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:28.744838 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-4a6a139e-1aac-4b4c-b6e8-5cc96692de8a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:28.745267 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-4a6a139e-1aac-4b4c-b6e8-5cc96692de8a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:28.772827 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-4a6a139e-1aac-4b4c-b6e8-5cc96692de8a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040654 Nov 09 20:14:28.773355 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 436/855] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:14:28 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:14:28.958882 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-446edc2c-ef19-41fe-91e8-6d5efb8d4357 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:14:28.960123 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-446edc2c-ef19-41fe-91e8-6d5efb8d4357 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:14:28.966204 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-446edc2c-ef19-41fe-91e8-6d5efb8d4357 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:28.966646 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-446edc2c-ef19-41fe-91e8-6d5efb8d4357 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:28.967408 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-446edc2c-ef19-41fe-91e8-6d5efb8d4357 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:28.967835 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-446edc2c-ef19-41fe-91e8-6d5efb8d4357 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:29.093177 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-446edc2c-ef19-41fe-91e8-6d5efb8d4357 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:14:29.101919 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-446edc2c-ef19-41fe-91e8-6d5efb8d4357 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:14:29.103458 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-446edc2c-ef19-41fe-91e8-6d5efb8d4357 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:14:29.104645 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-446edc2c-ef19-41fe-91e8-6d5efb8d4357 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1747 microversion: 2.20 time: 0.149395 Nov 09 20:14:29.105425 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 420/856] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:14:28 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1747 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:14:29.784041 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-264bcdd2-4a3b-4760-a4c7-46e26d24c392 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:14:29.785017 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-264bcdd2-4a3b-4760-a4c7-46e26d24c392 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:14:29.791438 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-264bcdd2-4a3b-4760-a4c7-46e26d24c392 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:29.791868 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-264bcdd2-4a3b-4760-a4c7-46e26d24c392 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:29.792668 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-264bcdd2-4a3b-4760-a4c7-46e26d24c392 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:29.793104 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-264bcdd2-4a3b-4760-a4c7-46e26d24c392 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:29.822234 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-264bcdd2-4a3b-4760-a4c7-46e26d24c392 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041889 Nov 09 20:14:29.822788 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 437/857] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:14:29 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:14:30.122431 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-296f49dd-9610-40dd-a12a-cf83e9f7a14c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:14:30.123036 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-296f49dd-9610-40dd-a12a-cf83e9f7a14c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:14:30.129194 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-296f49dd-9610-40dd-a12a-cf83e9f7a14c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:30.129630 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-296f49dd-9610-40dd-a12a-cf83e9f7a14c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:30.130385 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-296f49dd-9610-40dd-a12a-cf83e9f7a14c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:30.130807 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-296f49dd-9610-40dd-a12a-cf83e9f7a14c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:30.264754 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-296f49dd-9610-40dd-a12a-cf83e9f7a14c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:14:30.273925 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-296f49dd-9610-40dd-a12a-cf83e9f7a14c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:14:30.275412 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-296f49dd-9610-40dd-a12a-cf83e9f7a14c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:14:30.276579 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-296f49dd-9610-40dd-a12a-cf83e9f7a14c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1747 microversion: 2.20 time: 0.157880 Nov 09 20:14:30.277134 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 421/858] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:14:30 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1747 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:14:30.833542 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-5c2762c6-d148-42b5-9b0d-03849cebdc1d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:14:30.835084 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-5c2762c6-d148-42b5-9b0d-03849cebdc1d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:14:30.841273 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-5c2762c6-d148-42b5-9b0d-03849cebdc1d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:30.841722 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-5c2762c6-d148-42b5-9b0d-03849cebdc1d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:30.842497 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-5c2762c6-d148-42b5-9b0d-03849cebdc1d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:30.842925 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-5c2762c6-d148-42b5-9b0d-03849cebdc1d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:30.871137 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-5c2762c6-d148-42b5-9b0d-03849cebdc1d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041312 Nov 09 20:14:30.871684 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 438/859] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:14:30 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:14:31.294508 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-0845dbcd-e340-4866-8086-3fb8795592af tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:14:31.295110 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-0845dbcd-e340-4866-8086-3fb8795592af tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:14:31.301323 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0845dbcd-e340-4866-8086-3fb8795592af tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:31.301763 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0845dbcd-e340-4866-8086-3fb8795592af tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:31.302525 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0845dbcd-e340-4866-8086-3fb8795592af tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:31.302948 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0845dbcd-e340-4866-8086-3fb8795592af tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:31.434596 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-0845dbcd-e340-4866-8086-3fb8795592af tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:14:31.442617 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-0845dbcd-e340-4866-8086-3fb8795592af tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:14:31.444168 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-0845dbcd-e340-4866-8086-3fb8795592af tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:14:31.445464 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-0845dbcd-e340-4866-8086-3fb8795592af tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1747 microversion: 2.20 time: 0.154600 Nov 09 20:14:31.446020 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 422/860] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:14:31 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1747 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:14:31.882796 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-7a82256c-1287-4969-beda-91214462437f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:14:31.883702 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-7a82256c-1287-4969-beda-91214462437f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:14:31.889875 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-7a82256c-1287-4969-beda-91214462437f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:31.890322 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-7a82256c-1287-4969-beda-91214462437f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:31.891092 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-7a82256c-1287-4969-beda-91214462437f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:31.891527 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-7a82256c-1287-4969-beda-91214462437f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:31.920495 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-7a82256c-1287-4969-beda-91214462437f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041881 Nov 09 20:14:31.921046 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 439/861] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:14:31 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:14:32.158576 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 09 20:14:32.158797 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: Tue Nov 9 20:14:32 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 09 20:14:32.463274 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-2dbc5f1a-dfa7-480f-ada3-622f5e539354 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:14:32.463864 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-2dbc5f1a-dfa7-480f-ada3-622f5e539354 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:14:32.470039 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2dbc5f1a-dfa7-480f-ada3-622f5e539354 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:32.470484 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2dbc5f1a-dfa7-480f-ada3-622f5e539354 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:32.471254 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2dbc5f1a-dfa7-480f-ada3-622f5e539354 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:32.471687 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2dbc5f1a-dfa7-480f-ada3-622f5e539354 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:32.603513 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-2dbc5f1a-dfa7-480f-ada3-622f5e539354 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:14:32.612044 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-2dbc5f1a-dfa7-480f-ada3-622f5e539354 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:14:32.613573 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-2dbc5f1a-dfa7-480f-ada3-622f5e539354 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:14:32.614724 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-2dbc5f1a-dfa7-480f-ada3-622f5e539354 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1747 microversion: 2.20 time: 0.155780 Nov 09 20:14:32.615276 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 423/862] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:14:32 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1747 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:14:32.931599 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-965d1da1-b197-410b-816b-5134fb5770fd tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:14:32.932551 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-965d1da1-b197-410b-816b-5134fb5770fd tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:14:32.938644 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-965d1da1-b197-410b-816b-5134fb5770fd tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:32.939083 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-965d1da1-b197-410b-816b-5134fb5770fd tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:32.939843 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-965d1da1-b197-410b-816b-5134fb5770fd tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:32.940266 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-965d1da1-b197-410b-816b-5134fb5770fd tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:32.968102 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-965d1da1-b197-410b-816b-5134fb5770fd tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040857 Nov 09 20:14:32.968665 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 440/863] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:14:32 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:14:33.635272 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-8d952a1c-3969-48fb-88b3-bf8bf2f14971 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:14:33.635864 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-8d952a1c-3969-48fb-88b3-bf8bf2f14971 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:14:33.641930 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8d952a1c-3969-48fb-88b3-bf8bf2f14971 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:33.642363 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8d952a1c-3969-48fb-88b3-bf8bf2f14971 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:33.643115 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8d952a1c-3969-48fb-88b3-bf8bf2f14971 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:33.643537 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8d952a1c-3969-48fb-88b3-bf8bf2f14971 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:33.769249 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-8d952a1c-3969-48fb-88b3-bf8bf2f14971 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:14:33.777940 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-8d952a1c-3969-48fb-88b3-bf8bf2f14971 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:14:33.779423 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-8d952a1c-3969-48fb-88b3-bf8bf2f14971 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:14:33.780618 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-8d952a1c-3969-48fb-88b3-bf8bf2f14971 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1747 microversion: 2.20 time: 0.149505 Nov 09 20:14:33.781168 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 424/864] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:14:33 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1747 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:14:33.978710 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-ddbe838c-c6c9-4810-b745-11e315c2b21d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:14:33.979525 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-ddbe838c-c6c9-4810-b745-11e315c2b21d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:14:33.985852 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ddbe838c-c6c9-4810-b745-11e315c2b21d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:33.986294 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ddbe838c-c6c9-4810-b745-11e315c2b21d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:33.987052 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ddbe838c-c6c9-4810-b745-11e315c2b21d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:33.987475 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ddbe838c-c6c9-4810-b745-11e315c2b21d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:34.016590 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-ddbe838c-c6c9-4810-b745-11e315c2b21d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041882 Nov 09 20:14:34.017129 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 441/865] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:14:33 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:14:34.798591 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-3816b664-2295-4668-a2a8-d9c317f0447c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:14:34.799121 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-3816b664-2295-4668-a2a8-d9c317f0447c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:14:34.806229 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3816b664-2295-4668-a2a8-d9c317f0447c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:34.806704 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3816b664-2295-4668-a2a8-d9c317f0447c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:34.807517 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3816b664-2295-4668-a2a8-d9c317f0447c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:34.807942 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3816b664-2295-4668-a2a8-d9c317f0447c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:34.939176 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-3816b664-2295-4668-a2a8-d9c317f0447c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:14:34.948038 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-3816b664-2295-4668-a2a8-d9c317f0447c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:14:34.949606 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-3816b664-2295-4668-a2a8-d9c317f0447c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:14:34.950756 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-3816b664-2295-4668-a2a8-d9c317f0447c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1747 microversion: 2.20 time: 0.155970 Nov 09 20:14:34.951308 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 425/866] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:14:34 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1747 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:14:35.028154 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-92cdcddd-6b92-433b-93e1-8835efdf6172 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:14:35.029120 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-92cdcddd-6b92-433b-93e1-8835efdf6172 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:14:35.035297 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-92cdcddd-6b92-433b-93e1-8835efdf6172 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:35.035745 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-92cdcddd-6b92-433b-93e1-8835efdf6172 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:35.036551 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-92cdcddd-6b92-433b-93e1-8835efdf6172 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:35.036993 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-92cdcddd-6b92-433b-93e1-8835efdf6172 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:35.065285 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-92cdcddd-6b92-433b-93e1-8835efdf6172 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040796 Nov 09 20:14:35.065759 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 442/867] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:14:35 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:14:35.968937 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-f9320ec8-a61d-4b49-9904-fdf6b5cb0397 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:14:35.969587 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-f9320ec8-a61d-4b49-9904-fdf6b5cb0397 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:14:35.975696 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f9320ec8-a61d-4b49-9904-fdf6b5cb0397 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:35.976078 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f9320ec8-a61d-4b49-9904-fdf6b5cb0397 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:35.976991 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f9320ec8-a61d-4b49-9904-fdf6b5cb0397 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:35.977420 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f9320ec8-a61d-4b49-9904-fdf6b5cb0397 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:36.076866 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-68da8314-b1c5-45a4-946c-f41dcd9f8336 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:14:36.077777 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-68da8314-b1c5-45a4-946c-f41dcd9f8336 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:14:36.084168 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-68da8314-b1c5-45a4-946c-f41dcd9f8336 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:36.084642 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-68da8314-b1c5-45a4-946c-f41dcd9f8336 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:36.086324 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-68da8314-b1c5-45a4-946c-f41dcd9f8336 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:36.086744 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-68da8314-b1c5-45a4-946c-f41dcd9f8336 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:36.117729 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-68da8314-b1c5-45a4-946c-f41dcd9f8336 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044528 Nov 09 20:14:36.118313 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 443/868] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:14:36 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 20:14:36.314446 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-f9320ec8-a61d-4b49-9904-fdf6b5cb0397 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:14:36.323410 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-f9320ec8-a61d-4b49-9904-fdf6b5cb0397 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:14:36.325097 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-f9320ec8-a61d-4b49-9904-fdf6b5cb0397 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:14:36.326312 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-f9320ec8-a61d-4b49-9904-fdf6b5cb0397 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1747 microversion: 2.20 time: 0.360980 Nov 09 20:14:36.326914 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 426/869] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:14:35 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1747 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:14:37.128162 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-8ef0f26f-2496-41a6-b5fe-a8731ed433b1 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:14:37.129100 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-8ef0f26f-2496-41a6-b5fe-a8731ed433b1 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:14:37.135287 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-8ef0f26f-2496-41a6-b5fe-a8731ed433b1 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:37.135727 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-8ef0f26f-2496-41a6-b5fe-a8731ed433b1 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:37.136512 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-8ef0f26f-2496-41a6-b5fe-a8731ed433b1 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:37.136964 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-8ef0f26f-2496-41a6-b5fe-a8731ed433b1 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:37.165819 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-8ef0f26f-2496-41a6-b5fe-a8731ed433b1 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041361 Nov 09 20:14:37.166364 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 444/870] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:14:37 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:14:37.345014 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-5cb7db1b-5ca2-441a-aafe-be0a93a7c451 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:14:37.345624 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-5cb7db1b-5ca2-441a-aafe-be0a93a7c451 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:14:37.352480 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5cb7db1b-5ca2-441a-aafe-be0a93a7c451 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:37.352937 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5cb7db1b-5ca2-441a-aafe-be0a93a7c451 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:37.353737 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5cb7db1b-5ca2-441a-aafe-be0a93a7c451 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:37.354226 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5cb7db1b-5ca2-441a-aafe-be0a93a7c451 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:37.480948 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-5cb7db1b-5ca2-441a-aafe-be0a93a7c451 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:14:37.489265 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-5cb7db1b-5ca2-441a-aafe-be0a93a7c451 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:14:37.490795 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-5cb7db1b-5ca2-441a-aafe-be0a93a7c451 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:14:37.492095 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-5cb7db1b-5ca2-441a-aafe-be0a93a7c451 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1747 microversion: 2.20 time: 0.150837 Nov 09 20:14:37.492674 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 427/871] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:14:37 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1747 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:14:38.177081 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-347da75b-f447-4ccf-a425-a91bb42287ae tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:14:38.177980 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-347da75b-f447-4ccf-a425-a91bb42287ae tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:14:38.184744 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-347da75b-f447-4ccf-a425-a91bb42287ae tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:38.185186 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-347da75b-f447-4ccf-a425-a91bb42287ae tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:38.185941 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-347da75b-f447-4ccf-a425-a91bb42287ae tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:38.186365 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-347da75b-f447-4ccf-a425-a91bb42287ae tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:38.213897 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-347da75b-f447-4ccf-a425-a91bb42287ae tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040552 Nov 09 20:14:38.214436 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 445/872] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:14:38 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:14:38.509946 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-8188e11e-4e8b-4c2c-8e3e-9fd1c7a75341 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:14:38.510492 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-8188e11e-4e8b-4c2c-8e3e-9fd1c7a75341 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:14:38.516698 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8188e11e-4e8b-4c2c-8e3e-9fd1c7a75341 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:38.517137 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8188e11e-4e8b-4c2c-8e3e-9fd1c7a75341 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:38.517954 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8188e11e-4e8b-4c2c-8e3e-9fd1c7a75341 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:38.518377 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8188e11e-4e8b-4c2c-8e3e-9fd1c7a75341 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:38.648253 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-8188e11e-4e8b-4c2c-8e3e-9fd1c7a75341 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:14:38.656447 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-8188e11e-4e8b-4c2c-8e3e-9fd1c7a75341 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:14:38.657951 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-8188e11e-4e8b-4c2c-8e3e-9fd1c7a75341 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:14:38.659100 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-8188e11e-4e8b-4c2c-8e3e-9fd1c7a75341 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1747 microversion: 2.20 time: 0.153571 Nov 09 20:14:38.659654 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 428/873] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:14:38 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1747 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:14:39.225266 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-72fa53fd-a8cc-4f40-83de-5a527f2a1da7 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:14:39.226170 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-72fa53fd-a8cc-4f40-83de-5a527f2a1da7 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:14:39.233382 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-72fa53fd-a8cc-4f40-83de-5a527f2a1da7 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:39.233824 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-72fa53fd-a8cc-4f40-83de-5a527f2a1da7 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:39.234591 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-72fa53fd-a8cc-4f40-83de-5a527f2a1da7 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:39.235023 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-72fa53fd-a8cc-4f40-83de-5a527f2a1da7 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:39.263601 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-72fa53fd-a8cc-4f40-83de-5a527f2a1da7 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041994 Nov 09 20:14:39.264174 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 446/874] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:14:39 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:14:39.677129 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-a51335df-180b-4d0e-bca5-bf2b2f410f07 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:14:39.677735 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-a51335df-180b-4d0e-bca5-bf2b2f410f07 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:14:39.683882 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a51335df-180b-4d0e-bca5-bf2b2f410f07 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:39.684321 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a51335df-180b-4d0e-bca5-bf2b2f410f07 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:39.685123 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a51335df-180b-4d0e-bca5-bf2b2f410f07 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:39.685553 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a51335df-180b-4d0e-bca5-bf2b2f410f07 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:39.813863 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-a51335df-180b-4d0e-bca5-bf2b2f410f07 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:14:39.822579 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-a51335df-180b-4d0e-bca5-bf2b2f410f07 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:14:39.824047 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-a51335df-180b-4d0e-bca5-bf2b2f410f07 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:14:39.825201 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-a51335df-180b-4d0e-bca5-bf2b2f410f07 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1747 microversion: 2.20 time: 0.151755 Nov 09 20:14:39.825766 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 429/875] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:14:39 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1747 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:14:40.275002 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-3a6e4f83-3e9f-446d-baad-6fb00d9c010c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:14:40.275907 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-3a6e4f83-3e9f-446d-baad-6fb00d9c010c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:14:40.282153 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-3a6e4f83-3e9f-446d-baad-6fb00d9c010c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:40.282600 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-3a6e4f83-3e9f-446d-baad-6fb00d9c010c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:40.283374 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-3a6e4f83-3e9f-446d-baad-6fb00d9c010c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:40.283804 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-3a6e4f83-3e9f-446d-baad-6fb00d9c010c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:40.312109 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-3a6e4f83-3e9f-446d-baad-6fb00d9c010c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040871 Nov 09 20:14:40.312686 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 447/876] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:14:40 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:14:40.843815 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-551cb4ec-377f-4ecc-bbb6-55b3fbfb8895 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:14:40.844422 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-551cb4ec-377f-4ecc-bbb6-55b3fbfb8895 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:14:40.851239 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-551cb4ec-377f-4ecc-bbb6-55b3fbfb8895 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:40.851675 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-551cb4ec-377f-4ecc-bbb6-55b3fbfb8895 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:40.852464 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-551cb4ec-377f-4ecc-bbb6-55b3fbfb8895 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:40.852894 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-551cb4ec-377f-4ecc-bbb6-55b3fbfb8895 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:40.981682 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-551cb4ec-377f-4ecc-bbb6-55b3fbfb8895 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:14:40.989670 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-551cb4ec-377f-4ecc-bbb6-55b3fbfb8895 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:14:40.991593 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-551cb4ec-377f-4ecc-bbb6-55b3fbfb8895 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:14:40.992804 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-551cb4ec-377f-4ecc-bbb6-55b3fbfb8895 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1747 microversion: 2.20 time: 0.152563 Nov 09 20:14:40.993356 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 430/877] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:14:40 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1747 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:14:41.323525 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-72d03243-f008-40ed-a9fd-ed009bed34f2 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:14:41.324455 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-72d03243-f008-40ed-a9fd-ed009bed34f2 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:14:41.330566 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-72d03243-f008-40ed-a9fd-ed009bed34f2 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:41.331007 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-72d03243-f008-40ed-a9fd-ed009bed34f2 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:41.331771 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-72d03243-f008-40ed-a9fd-ed009bed34f2 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:41.332202 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-72d03243-f008-40ed-a9fd-ed009bed34f2 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:41.360826 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-72d03243-f008-40ed-a9fd-ed009bed34f2 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041557 Nov 09 20:14:41.361364 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 448/878] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:14:41 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:14:42.011182 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-01d37ce5-f220-4289-ab8f-0d94ce747e87 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:14:42.011738 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-01d37ce5-f220-4289-ab8f-0d94ce747e87 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:14:42.017887 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-01d37ce5-f220-4289-ab8f-0d94ce747e87 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:42.018331 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-01d37ce5-f220-4289-ab8f-0d94ce747e87 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:42.019097 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-01d37ce5-f220-4289-ab8f-0d94ce747e87 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:42.019528 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-01d37ce5-f220-4289-ab8f-0d94ce747e87 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:42.147328 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-01d37ce5-f220-4289-ab8f-0d94ce747e87 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:14:42.155426 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-01d37ce5-f220-4289-ab8f-0d94ce747e87 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:14:42.156957 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-01d37ce5-f220-4289-ab8f-0d94ce747e87 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:14:42.158103 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-01d37ce5-f220-4289-ab8f-0d94ce747e87 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1747 microversion: 2.20 time: 0.150852 Nov 09 20:14:42.158654 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 431/879] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:14:42 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1747 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:14:42.372266 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-ccae62e1-1cce-47a1-bb82-71e20257cb38 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:14:42.373188 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-ccae62e1-1cce-47a1-bb82-71e20257cb38 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:14:42.379338 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ccae62e1-1cce-47a1-bb82-71e20257cb38 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:42.379781 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ccae62e1-1cce-47a1-bb82-71e20257cb38 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:42.380580 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ccae62e1-1cce-47a1-bb82-71e20257cb38 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:42.381006 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ccae62e1-1cce-47a1-bb82-71e20257cb38 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:42.408749 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-ccae62e1-1cce-47a1-bb82-71e20257cb38 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040215 Nov 09 20:14:42.409279 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 449/880] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:14:42 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:14:43.176694 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-a3e93043-ce07-41d5-b373-2f03e712d528 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:14:43.177314 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-a3e93043-ce07-41d5-b373-2f03e712d528 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:14:43.183994 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a3e93043-ce07-41d5-b373-2f03e712d528 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:43.184462 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a3e93043-ce07-41d5-b373-2f03e712d528 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:43.185219 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a3e93043-ce07-41d5-b373-2f03e712d528 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:43.185641 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a3e93043-ce07-41d5-b373-2f03e712d528 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:43.311335 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-a3e93043-ce07-41d5-b373-2f03e712d528 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:14:43.320241 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-a3e93043-ce07-41d5-b373-2f03e712d528 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:14:43.321761 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-a3e93043-ce07-41d5-b373-2f03e712d528 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:14:43.322897 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-a3e93043-ce07-41d5-b373-2f03e712d528 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1747 microversion: 2.20 time: 0.149843 Nov 09 20:14:43.323450 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 432/881] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:14:43 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1747 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:14:43.419845 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-2d3478d7-89ff-4a54-b86f-4a81c5a76a94 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:14:43.420729 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-2d3478d7-89ff-4a54-b86f-4a81c5a76a94 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:14:43.426899 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-2d3478d7-89ff-4a54-b86f-4a81c5a76a94 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:43.427351 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-2d3478d7-89ff-4a54-b86f-4a81c5a76a94 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:43.428126 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-2d3478d7-89ff-4a54-b86f-4a81c5a76a94 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:43.429286 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-2d3478d7-89ff-4a54-b86f-4a81c5a76a94 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:43.457069 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-2d3478d7-89ff-4a54-b86f-4a81c5a76a94 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041045 Nov 09 20:14:43.457635 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 450/882] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:14:43 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:14:44.340811 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-a7232a36-9c26-4867-8a92-b155e108c775 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:14:44.341431 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-a7232a36-9c26-4867-8a92-b155e108c775 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:14:44.347573 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a7232a36-9c26-4867-8a92-b155e108c775 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:44.348011 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a7232a36-9c26-4867-8a92-b155e108c775 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:44.348806 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a7232a36-9c26-4867-8a92-b155e108c775 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:44.349233 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a7232a36-9c26-4867-8a92-b155e108c775 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:44.468325 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-b69d7dbe-608d-4f7b-bcdb-db59aec8b21d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:14:44.469253 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-b69d7dbe-608d-4f7b-bcdb-db59aec8b21d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:14:44.475981 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b69d7dbe-608d-4f7b-bcdb-db59aec8b21d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:44.476297 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b69d7dbe-608d-4f7b-bcdb-db59aec8b21d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:44.477113 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b69d7dbe-608d-4f7b-bcdb-db59aec8b21d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:44.477537 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b69d7dbe-608d-4f7b-bcdb-db59aec8b21d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:44.478647 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-a7232a36-9c26-4867-8a92-b155e108c775 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:14:44.487070 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-a7232a36-9c26-4867-8a92-b155e108c775 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:14:44.488583 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-a7232a36-9c26-4867-8a92-b155e108c775 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:14:44.489722 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-a7232a36-9c26-4867-8a92-b155e108c775 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1747 microversion: 2.20 time: 0.152651 Nov 09 20:14:44.490273 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 433/883] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:14:44 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1747 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:14:44.506428 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-b69d7dbe-608d-4f7b-bcdb-db59aec8b21d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041772 Nov 09 20:14:44.507074 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 451/884] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:14:44 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 20:14:45.508649 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-94995148-f7bc-47e1-9279-67b4efa2ee92 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:14:45.509272 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-94995148-f7bc-47e1-9279-67b4efa2ee92 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:14:45.515507 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-94995148-f7bc-47e1-9279-67b4efa2ee92 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:45.515947 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-94995148-f7bc-47e1-9279-67b4efa2ee92 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:45.516733 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-94995148-f7bc-47e1-9279-67b4efa2ee92 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:45.516859 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-854e30dd-7a8e-4ac0-a624-39bf829ec797 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:14:45.517251 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-94995148-f7bc-47e1-9279-67b4efa2ee92 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:45.517790 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-854e30dd-7a8e-4ac0-a624-39bf829ec797 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:14:45.523771 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-854e30dd-7a8e-4ac0-a624-39bf829ec797 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:45.524215 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-854e30dd-7a8e-4ac0-a624-39bf829ec797 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:45.525047 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-854e30dd-7a8e-4ac0-a624-39bf829ec797 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:45.525481 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-854e30dd-7a8e-4ac0-a624-39bf829ec797 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:45.554355 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-854e30dd-7a8e-4ac0-a624-39bf829ec797 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040442 Nov 09 20:14:45.554931 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 452/885] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:14:45 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 20:14:45.645077 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-94995148-f7bc-47e1-9279-67b4efa2ee92 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:14:45.653529 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-94995148-f7bc-47e1-9279-67b4efa2ee92 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:14:45.655011 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-94995148-f7bc-47e1-9279-67b4efa2ee92 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:14:45.656150 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-94995148-f7bc-47e1-9279-67b4efa2ee92 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1747 microversion: 2.20 time: 0.151839 Nov 09 20:14:45.656733 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 434/886] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:14:45 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1747 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:14:46.565818 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-16c3f3df-e2fb-42ee-bd58-7dc222eba4ac tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:14:46.566653 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-16c3f3df-e2fb-42ee-bd58-7dc222eba4ac tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:14:46.573086 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-16c3f3df-e2fb-42ee-bd58-7dc222eba4ac tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:46.573536 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-16c3f3df-e2fb-42ee-bd58-7dc222eba4ac tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:46.574311 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-16c3f3df-e2fb-42ee-bd58-7dc222eba4ac tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:46.574740 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-16c3f3df-e2fb-42ee-bd58-7dc222eba4ac tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:46.603206 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-16c3f3df-e2fb-42ee-bd58-7dc222eba4ac tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041210 Nov 09 20:14:46.603760 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 453/887] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:14:46 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:14:46.674637 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-9b448fd0-7448-43e0-8521-997a884f265b tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:14:46.675255 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-9b448fd0-7448-43e0-8521-997a884f265b tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:14:46.682159 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9b448fd0-7448-43e0-8521-997a884f265b tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:46.682599 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9b448fd0-7448-43e0-8521-997a884f265b tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:46.683362 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9b448fd0-7448-43e0-8521-997a884f265b tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:46.683786 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9b448fd0-7448-43e0-8521-997a884f265b tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:46.812325 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-9b448fd0-7448-43e0-8521-997a884f265b tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:14:46.820426 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-9b448fd0-7448-43e0-8521-997a884f265b tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:14:46.821899 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-9b448fd0-7448-43e0-8521-997a884f265b tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:14:46.823038 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-9b448fd0-7448-43e0-8521-997a884f265b tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1747 microversion: 2.20 time: 0.152085 Nov 09 20:14:46.823593 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 435/888] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:14:46 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1747 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:14:47.507752 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 09 20:14:47.507994 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: Tue Nov 9 20:14:47 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 09 20:14:47.614855 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-af096857-e9e7-40f2-8e51-b8345f2556be tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:14:47.615764 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-af096857-e9e7-40f2-8e51-b8345f2556be tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:14:47.622004 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-af096857-e9e7-40f2-8e51-b8345f2556be tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:47.622452 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-af096857-e9e7-40f2-8e51-b8345f2556be tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:47.623226 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-af096857-e9e7-40f2-8e51-b8345f2556be tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:47.623660 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-af096857-e9e7-40f2-8e51-b8345f2556be tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:47.653265 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-af096857-e9e7-40f2-8e51-b8345f2556be tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042185 Nov 09 20:14:47.653820 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 454/889] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:14:47 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:14:47.842421 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-d4e21355-4100-4ad5-927e-6b01ce8fbb76 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:14:47.843020 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-d4e21355-4100-4ad5-927e-6b01ce8fbb76 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:14:47.849489 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d4e21355-4100-4ad5-927e-6b01ce8fbb76 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:47.849925 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d4e21355-4100-4ad5-927e-6b01ce8fbb76 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:47.850695 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d4e21355-4100-4ad5-927e-6b01ce8fbb76 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:47.851115 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d4e21355-4100-4ad5-927e-6b01ce8fbb76 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:47.991844 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-d4e21355-4100-4ad5-927e-6b01ce8fbb76 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:14:48.000604 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-d4e21355-4100-4ad5-927e-6b01ce8fbb76 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:14:48.002091 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-d4e21355-4100-4ad5-927e-6b01ce8fbb76 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:14:48.008345 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-d4e21355-4100-4ad5-927e-6b01ce8fbb76 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1747 microversion: 2.20 time: 0.170011 Nov 09 20:14:48.008963 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 436/890] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:14:47 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1747 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:14:48.665356 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-8a1cb8d4-ec63-473c-ab4c-0c2313439406 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:14:48.666395 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-8a1cb8d4-ec63-473c-ab4c-0c2313439406 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:14:48.673050 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-8a1cb8d4-ec63-473c-ab4c-0c2313439406 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:48.673501 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-8a1cb8d4-ec63-473c-ab4c-0c2313439406 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:48.674284 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-8a1cb8d4-ec63-473c-ab4c-0c2313439406 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:48.674718 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-8a1cb8d4-ec63-473c-ab4c-0c2313439406 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:48.704178 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-8a1cb8d4-ec63-473c-ab4c-0c2313439406 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043157 Nov 09 20:14:48.704766 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 455/891] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:14:48 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:14:49.027019 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-af108b6c-2eb9-409a-b9bd-49767f926558 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:14:49.027622 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-af108b6c-2eb9-409a-b9bd-49767f926558 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:14:49.033715 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-af108b6c-2eb9-409a-b9bd-49767f926558 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:49.034246 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-af108b6c-2eb9-409a-b9bd-49767f926558 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:49.035013 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-af108b6c-2eb9-409a-b9bd-49767f926558 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:49.035436 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-af108b6c-2eb9-409a-b9bd-49767f926558 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:49.328382 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-af108b6c-2eb9-409a-b9bd-49767f926558 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:14:49.336921 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-af108b6c-2eb9-409a-b9bd-49767f926558 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:14:49.338397 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-af108b6c-2eb9-409a-b9bd-49767f926558 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:14:49.339514 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-af108b6c-2eb9-409a-b9bd-49767f926558 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1747 microversion: 2.20 time: 0.316332 Nov 09 20:14:49.340047 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 437/892] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:14:49 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1747 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:14:49.715974 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-fa6476fc-cee1-4a18-9822-1e0f729242bd tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:14:49.716908 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-fa6476fc-cee1-4a18-9822-1e0f729242bd tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:14:49.723124 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-fa6476fc-cee1-4a18-9822-1e0f729242bd tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:49.723574 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-fa6476fc-cee1-4a18-9822-1e0f729242bd tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:49.724347 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-fa6476fc-cee1-4a18-9822-1e0f729242bd tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:49.724803 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-fa6476fc-cee1-4a18-9822-1e0f729242bd tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:49.754472 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-fa6476fc-cee1-4a18-9822-1e0f729242bd tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042212 Nov 09 20:14:49.755018 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 456/893] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:14:49 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:14:50.358286 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-16485180-4b4d-4749-b61d-5c1a67785ddb tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:14:50.358878 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-16485180-4b4d-4749-b61d-5c1a67785ddb tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:14:50.365002 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-16485180-4b4d-4749-b61d-5c1a67785ddb tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:50.365441 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-16485180-4b4d-4749-b61d-5c1a67785ddb tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:50.367095 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-16485180-4b4d-4749-b61d-5c1a67785ddb tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:50.367683 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-16485180-4b4d-4749-b61d-5c1a67785ddb tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:50.495393 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-16485180-4b4d-4749-b61d-5c1a67785ddb tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:14:50.503560 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-16485180-4b4d-4749-b61d-5c1a67785ddb tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:14:50.505083 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-16485180-4b4d-4749-b61d-5c1a67785ddb tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:14:50.506220 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-16485180-4b4d-4749-b61d-5c1a67785ddb tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1747 microversion: 2.20 time: 0.151778 Nov 09 20:14:50.506824 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 438/894] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:14:50 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1747 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:14:50.766612 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-6086f8ea-5e16-4c89-b73d-9b1c2ff5ab29 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:14:50.767494 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-6086f8ea-5e16-4c89-b73d-9b1c2ff5ab29 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:14:50.775813 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6086f8ea-5e16-4c89-b73d-9b1c2ff5ab29 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:50.776290 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6086f8ea-5e16-4c89-b73d-9b1c2ff5ab29 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:50.777244 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6086f8ea-5e16-4c89-b73d-9b1c2ff5ab29 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:50.777726 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6086f8ea-5e16-4c89-b73d-9b1c2ff5ab29 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:50.810089 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-6086f8ea-5e16-4c89-b73d-9b1c2ff5ab29 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047359 Nov 09 20:14:50.810638 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 457/895] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:14:50 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:14:51.525026 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-feb3ee7c-c7bf-4303-9fb4-268f2ed969f6 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:14:51.525572 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-feb3ee7c-c7bf-4303-9fb4-268f2ed969f6 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:14:51.531656 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-feb3ee7c-c7bf-4303-9fb4-268f2ed969f6 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:51.532095 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-feb3ee7c-c7bf-4303-9fb4-268f2ed969f6 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:51.532899 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-feb3ee7c-c7bf-4303-9fb4-268f2ed969f6 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:51.533321 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-feb3ee7c-c7bf-4303-9fb4-268f2ed969f6 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:51.660977 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-feb3ee7c-c7bf-4303-9fb4-268f2ed969f6 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:14:51.669622 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-feb3ee7c-c7bf-4303-9fb4-268f2ed969f6 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:14:51.671107 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-feb3ee7c-c7bf-4303-9fb4-268f2ed969f6 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:14:51.672249 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-feb3ee7c-c7bf-4303-9fb4-268f2ed969f6 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1747 microversion: 2.20 time: 0.150956 Nov 09 20:14:51.672823 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 439/896] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:14:51 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1747 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:14:51.821699 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-35eabac6-921b-42cc-acc2-0f6263110367 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:14:51.822538 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-35eabac6-921b-42cc-acc2-0f6263110367 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:14:51.829012 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-35eabac6-921b-42cc-acc2-0f6263110367 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:51.829464 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-35eabac6-921b-42cc-acc2-0f6263110367 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:51.830234 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-35eabac6-921b-42cc-acc2-0f6263110367 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:51.830668 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-35eabac6-921b-42cc-acc2-0f6263110367 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:51.860644 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-35eabac6-921b-42cc-acc2-0f6263110367 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042789 Nov 09 20:14:51.861199 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 458/897] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:14:51 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:14:52.690633 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-71b122b9-264e-4cd6-be97-a42f0c7e1d96 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:14:52.691223 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-71b122b9-264e-4cd6-be97-a42f0c7e1d96 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:14:52.697595 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-71b122b9-264e-4cd6-be97-a42f0c7e1d96 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:52.698032 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-71b122b9-264e-4cd6-be97-a42f0c7e1d96 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:52.698784 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-71b122b9-264e-4cd6-be97-a42f0c7e1d96 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:52.699208 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-71b122b9-264e-4cd6-be97-a42f0c7e1d96 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:52.832783 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-71b122b9-264e-4cd6-be97-a42f0c7e1d96 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:14:52.841236 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-71b122b9-264e-4cd6-be97-a42f0c7e1d96 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:14:52.842697 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-71b122b9-264e-4cd6-be97-a42f0c7e1d96 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:14:52.843826 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-71b122b9-264e-4cd6-be97-a42f0c7e1d96 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1747 microversion: 2.20 time: 0.157012 Nov 09 20:14:52.844364 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 440/898] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:14:52 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1747 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:14:52.870745 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-7e26f141-6352-4603-b7ac-7c2526df20dc tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:14:52.871638 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-7e26f141-6352-4603-b7ac-7c2526df20dc tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:14:52.877750 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-7e26f141-6352-4603-b7ac-7c2526df20dc tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:52.878195 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-7e26f141-6352-4603-b7ac-7c2526df20dc tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:52.878951 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-7e26f141-6352-4603-b7ac-7c2526df20dc tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:52.879375 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-7e26f141-6352-4603-b7ac-7c2526df20dc tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:52.907945 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-7e26f141-6352-4603-b7ac-7c2526df20dc tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040785 Nov 09 20:14:52.909064 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 459/899] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:14:52 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:14:53.862675 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-1462e607-74fd-4014-8cfe-15842c21184b tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:14:53.863268 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-1462e607-74fd-4014-8cfe-15842c21184b tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:14:53.870663 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1462e607-74fd-4014-8cfe-15842c21184b tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:53.871102 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1462e607-74fd-4014-8cfe-15842c21184b tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:53.871861 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1462e607-74fd-4014-8cfe-15842c21184b tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:53.872285 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1462e607-74fd-4014-8cfe-15842c21184b tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:53.919846 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-3e528256-91ce-4506-9ba5-21fe6702dc3e tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:14:53.920774 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-3e528256-91ce-4506-9ba5-21fe6702dc3e tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:14:53.926874 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-3e528256-91ce-4506-9ba5-21fe6702dc3e tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:53.927323 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-3e528256-91ce-4506-9ba5-21fe6702dc3e tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:53.928118 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-3e528256-91ce-4506-9ba5-21fe6702dc3e tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:53.929701 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-3e528256-91ce-4506-9ba5-21fe6702dc3e tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:53.958243 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-3e528256-91ce-4506-9ba5-21fe6702dc3e tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042080 Nov 09 20:14:53.958797 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 460/900] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:14:53 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 20:14:54.001514 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-1462e607-74fd-4014-8cfe-15842c21184b tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:14:54.009918 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-1462e607-74fd-4014-8cfe-15842c21184b tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:14:54.011376 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-1462e607-74fd-4014-8cfe-15842c21184b tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:14:54.012525 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-1462e607-74fd-4014-8cfe-15842c21184b tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1747 microversion: 2.20 time: 0.153553 Nov 09 20:14:54.013240 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 441/901] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:14:53 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1747 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:14:54.969307 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-f506c59c-4ab3-4ac7-97ff-f1843c3d0142 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:14:54.970234 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-f506c59c-4ab3-4ac7-97ff-f1843c3d0142 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:14:54.977026 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f506c59c-4ab3-4ac7-97ff-f1843c3d0142 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:54.977462 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f506c59c-4ab3-4ac7-97ff-f1843c3d0142 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:54.978219 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f506c59c-4ab3-4ac7-97ff-f1843c3d0142 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:54.978644 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f506c59c-4ab3-4ac7-97ff-f1843c3d0142 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:55.006738 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-f506c59c-4ab3-4ac7-97ff-f1843c3d0142 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040957 Nov 09 20:14:55.007296 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 461/902] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:14:54 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:14:55.030716 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-7d7dd400-975e-43ad-be68-51db68a21393 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:14:55.031319 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-7d7dd400-975e-43ad-be68-51db68a21393 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:14:55.038354 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7d7dd400-975e-43ad-be68-51db68a21393 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:55.038985 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7d7dd400-975e-43ad-be68-51db68a21393 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:55.039839 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7d7dd400-975e-43ad-be68-51db68a21393 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:55.040277 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7d7dd400-975e-43ad-be68-51db68a21393 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:55.169850 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-7d7dd400-975e-43ad-be68-51db68a21393 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:14:55.177813 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-7d7dd400-975e-43ad-be68-51db68a21393 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:14:55.179439 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-7d7dd400-975e-43ad-be68-51db68a21393 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:14:55.180596 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-7d7dd400-975e-43ad-be68-51db68a21393 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1747 microversion: 2.20 time: 0.153562 Nov 09 20:14:55.181141 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 442/903] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:14:55 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1747 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:14:56.019562 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-f1925f94-b037-4ae7-a863-bd39a874cd8d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:14:56.020874 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-f1925f94-b037-4ae7-a863-bd39a874cd8d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:14:56.027701 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f1925f94-b037-4ae7-a863-bd39a874cd8d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:56.028209 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f1925f94-b037-4ae7-a863-bd39a874cd8d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:56.029082 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f1925f94-b037-4ae7-a863-bd39a874cd8d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:56.029507 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f1925f94-b037-4ae7-a863-bd39a874cd8d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:56.058845 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-f1925f94-b037-4ae7-a863-bd39a874cd8d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044805 Nov 09 20:14:56.059388 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 462/904] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:14:56 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:14:56.198178 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-2f3e9c75-7dc6-47c8-afb2-37d15ffc9ee0 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:14:56.198881 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-2f3e9c75-7dc6-47c8-afb2-37d15ffc9ee0 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:14:56.204883 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2f3e9c75-7dc6-47c8-afb2-37d15ffc9ee0 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:56.205329 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2f3e9c75-7dc6-47c8-afb2-37d15ffc9ee0 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:56.206091 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2f3e9c75-7dc6-47c8-afb2-37d15ffc9ee0 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:56.206518 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2f3e9c75-7dc6-47c8-afb2-37d15ffc9ee0 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:56.335687 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-2f3e9c75-7dc6-47c8-afb2-37d15ffc9ee0 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:14:56.343724 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-2f3e9c75-7dc6-47c8-afb2-37d15ffc9ee0 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:14:56.345222 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-2f3e9c75-7dc6-47c8-afb2-37d15ffc9ee0 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:14:56.346342 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-2f3e9c75-7dc6-47c8-afb2-37d15ffc9ee0 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1747 microversion: 2.20 time: 0.152209 Nov 09 20:14:56.346881 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 443/905] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:14:56 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1747 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:14:57.071001 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-9a944243-1eec-4a00-9cf7-f53efd43ba06 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:14:57.071925 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-9a944243-1eec-4a00-9cf7-f53efd43ba06 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:14:57.078038 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-9a944243-1eec-4a00-9cf7-f53efd43ba06 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:57.078475 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-9a944243-1eec-4a00-9cf7-f53efd43ba06 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:57.079235 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-9a944243-1eec-4a00-9cf7-f53efd43ba06 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:57.079665 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-9a944243-1eec-4a00-9cf7-f53efd43ba06 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:57.108741 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-9a944243-1eec-4a00-9cf7-f53efd43ba06 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042239 Nov 09 20:14:57.109279 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 463/906] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:14:57 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:14:57.365135 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-262f1832-809c-480f-b2e3-c0fbef719e6a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:14:57.366359 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-262f1832-809c-480f-b2e3-c0fbef719e6a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:14:57.372481 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-262f1832-809c-480f-b2e3-c0fbef719e6a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:57.372923 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-262f1832-809c-480f-b2e3-c0fbef719e6a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:57.373676 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-262f1832-809c-480f-b2e3-c0fbef719e6a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:57.374102 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-262f1832-809c-480f-b2e3-c0fbef719e6a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:57.498627 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-262f1832-809c-480f-b2e3-c0fbef719e6a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:14:57.507334 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-262f1832-809c-480f-b2e3-c0fbef719e6a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:14:57.508852 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-262f1832-809c-480f-b2e3-c0fbef719e6a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:14:57.509988 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-262f1832-809c-480f-b2e3-c0fbef719e6a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1747 microversion: 2.20 time: 0.148505 Nov 09 20:14:57.510538 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 444/907] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:14:57 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1747 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:14:58.119913 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-3c4622cb-1e40-46cc-ae19-63fd46ed81f0 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:14:58.120909 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-3c4622cb-1e40-46cc-ae19-63fd46ed81f0 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:14:58.127167 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-3c4622cb-1e40-46cc-ae19-63fd46ed81f0 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:58.127612 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-3c4622cb-1e40-46cc-ae19-63fd46ed81f0 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:58.128376 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-3c4622cb-1e40-46cc-ae19-63fd46ed81f0 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:58.128827 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-3c4622cb-1e40-46cc-ae19-63fd46ed81f0 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:58.157200 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-3c4622cb-1e40-46cc-ae19-63fd46ed81f0 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040987 Nov 09 20:14:58.157754 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 464/908] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:14:58 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:14:58.533978 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-6b64c4aa-c644-4c95-86a7-7c5e3e26ccbf tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:14:58.534508 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-6b64c4aa-c644-4c95-86a7-7c5e3e26ccbf tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:14:58.540715 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6b64c4aa-c644-4c95-86a7-7c5e3e26ccbf tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:58.541163 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6b64c4aa-c644-4c95-86a7-7c5e3e26ccbf tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:58.541925 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6b64c4aa-c644-4c95-86a7-7c5e3e26ccbf tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:58.542354 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6b64c4aa-c644-4c95-86a7-7c5e3e26ccbf tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:58.673892 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-6b64c4aa-c644-4c95-86a7-7c5e3e26ccbf tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:14:58.682970 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-6b64c4aa-c644-4c95-86a7-7c5e3e26ccbf tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:14:58.684459 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-6b64c4aa-c644-4c95-86a7-7c5e3e26ccbf tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:14:58.685587 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-6b64c4aa-c644-4c95-86a7-7c5e3e26ccbf tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1747 microversion: 2.20 time: 0.155390 Nov 09 20:14:58.686122 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 445/909] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:14:58 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1747 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:14:59.168994 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-da470f5d-9352-4552-973e-80c33853c4c5 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:14:59.169901 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-da470f5d-9352-4552-973e-80c33853c4c5 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:14:59.176089 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-da470f5d-9352-4552-973e-80c33853c4c5 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:59.176576 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-da470f5d-9352-4552-973e-80c33853c4c5 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:59.177348 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-da470f5d-9352-4552-973e-80c33853c4c5 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:59.177777 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-da470f5d-9352-4552-973e-80c33853c4c5 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:59.205757 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-da470f5d-9352-4552-973e-80c33853c4c5 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040565 Nov 09 20:14:59.206300 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 465/910] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:14:59 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:14:59.704008 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-6a9e3141-dfa0-4d90-a1da-02a4ef7bc261 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:14:59.704629 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-6a9e3141-dfa0-4d90-a1da-02a4ef7bc261 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:14:59.711231 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6a9e3141-dfa0-4d90-a1da-02a4ef7bc261 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:59.711670 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6a9e3141-dfa0-4d90-a1da-02a4ef7bc261 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:59.712448 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6a9e3141-dfa0-4d90-a1da-02a4ef7bc261 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:14:59.712876 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6a9e3141-dfa0-4d90-a1da-02a4ef7bc261 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:14:59.839852 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-6a9e3141-dfa0-4d90-a1da-02a4ef7bc261 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:14:59.848040 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-6a9e3141-dfa0-4d90-a1da-02a4ef7bc261 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:14:59.849578 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-6a9e3141-dfa0-4d90-a1da-02a4ef7bc261 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:14:59.850719 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-6a9e3141-dfa0-4d90-a1da-02a4ef7bc261 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1747 microversion: 2.20 time: 0.150324 Nov 09 20:14:59.851266 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 446/911] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:14:59 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1747 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:15:00.216260 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-7d21ac7d-d036-4b55-a1e5-aec542b26a3f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:15:00.217193 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-7d21ac7d-d036-4b55-a1e5-aec542b26a3f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:15:00.223555 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-7d21ac7d-d036-4b55-a1e5-aec542b26a3f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:00.223998 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-7d21ac7d-d036-4b55-a1e5-aec542b26a3f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:00.224787 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-7d21ac7d-d036-4b55-a1e5-aec542b26a3f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:00.225247 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-7d21ac7d-d036-4b55-a1e5-aec542b26a3f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:00.253789 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-7d21ac7d-d036-4b55-a1e5-aec542b26a3f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041291 Nov 09 20:15:00.254324 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 466/912] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:15:00 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:15:00.870313 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-9c277624-dd69-4929-968b-05fbd666000d tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:15:00.870918 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-9c277624-dd69-4929-968b-05fbd666000d tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:15:00.877099 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9c277624-dd69-4929-968b-05fbd666000d tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:00.877544 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9c277624-dd69-4929-968b-05fbd666000d tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:00.878306 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9c277624-dd69-4929-968b-05fbd666000d tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:00.878737 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9c277624-dd69-4929-968b-05fbd666000d tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:01.007622 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-9c277624-dd69-4929-968b-05fbd666000d tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:15:01.015892 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-9c277624-dd69-4929-968b-05fbd666000d tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:15:01.017408 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-9c277624-dd69-4929-968b-05fbd666000d tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:15:01.018546 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-9c277624-dd69-4929-968b-05fbd666000d tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1747 microversion: 2.20 time: 0.152553 Nov 09 20:15:01.019102 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 447/913] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:15:00 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1747 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:15:01.265704 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-41d1c0b9-2202-4660-ba2d-768fe20f47c6 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:15:01.266568 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-41d1c0b9-2202-4660-ba2d-768fe20f47c6 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:15:01.272922 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-41d1c0b9-2202-4660-ba2d-768fe20f47c6 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:01.273368 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-41d1c0b9-2202-4660-ba2d-768fe20f47c6 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:01.274134 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-41d1c0b9-2202-4660-ba2d-768fe20f47c6 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:01.274571 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-41d1c0b9-2202-4660-ba2d-768fe20f47c6 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:01.303069 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-41d1c0b9-2202-4660-ba2d-768fe20f47c6 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041183 Nov 09 20:15:01.303610 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 467/914] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:15:01 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:15:02.037616 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-c34e9ed9-5d83-409c-abb9-9012d7c52d36 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:15:02.038251 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-c34e9ed9-5d83-409c-abb9-9012d7c52d36 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:15:02.045068 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c34e9ed9-5d83-409c-abb9-9012d7c52d36 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:02.045506 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c34e9ed9-5d83-409c-abb9-9012d7c52d36 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:02.046278 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c34e9ed9-5d83-409c-abb9-9012d7c52d36 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:02.046708 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c34e9ed9-5d83-409c-abb9-9012d7c52d36 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:02.173265 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-c34e9ed9-5d83-409c-abb9-9012d7c52d36 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:15:02.182140 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-c34e9ed9-5d83-409c-abb9-9012d7c52d36 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:15:02.183636 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-c34e9ed9-5d83-409c-abb9-9012d7c52d36 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:15:02.184850 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-c34e9ed9-5d83-409c-abb9-9012d7c52d36 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1747 microversion: 2.20 time: 0.150966 Nov 09 20:15:02.185434 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 448/915] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:15:02 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1747 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:15:02.314345 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-e88015a5-b6d0-4092-b427-3c1590f9c86f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:15:02.315193 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-e88015a5-b6d0-4092-b427-3c1590f9c86f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:15:02.321532 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e88015a5-b6d0-4092-b427-3c1590f9c86f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:02.321984 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e88015a5-b6d0-4092-b427-3c1590f9c86f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:02.322769 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e88015a5-b6d0-4092-b427-3c1590f9c86f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:02.323205 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e88015a5-b6d0-4092-b427-3c1590f9c86f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:02.350864 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-e88015a5-b6d0-4092-b427-3c1590f9c86f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040329 Nov 09 20:15:02.351407 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 468/916] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:15:02 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:15:03.203641 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-03154ea0-7665-466f-ae5c-f2fecee41599 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:15:03.204242 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-03154ea0-7665-466f-ae5c-f2fecee41599 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:15:03.210464 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-03154ea0-7665-466f-ae5c-f2fecee41599 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:03.210899 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-03154ea0-7665-466f-ae5c-f2fecee41599 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:03.211663 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-03154ea0-7665-466f-ae5c-f2fecee41599 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:03.212137 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-03154ea0-7665-466f-ae5c-f2fecee41599 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:03.346847 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-03154ea0-7665-466f-ae5c-f2fecee41599 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:15:03.355966 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-03154ea0-7665-466f-ae5c-f2fecee41599 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:15:03.357727 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-03154ea0-7665-466f-ae5c-f2fecee41599 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:15:03.358858 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-03154ea0-7665-466f-ae5c-f2fecee41599 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1747 microversion: 2.20 time: 0.158896 Nov 09 20:15:03.359589 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 449/917] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:15:03 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1747 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:15:03.362928 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-6e154381-e0f8-468c-90f2-a9195499309f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:15:03.363839 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-6e154381-e0f8-468c-90f2-a9195499309f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:15:03.370171 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6e154381-e0f8-468c-90f2-a9195499309f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:03.370617 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6e154381-e0f8-468c-90f2-a9195499309f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:03.371395 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6e154381-e0f8-468c-90f2-a9195499309f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:03.371838 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6e154381-e0f8-468c-90f2-a9195499309f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:03.400342 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-6e154381-e0f8-468c-90f2-a9195499309f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040573 Nov 09 20:15:03.401111 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 469/918] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:15:03 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 20:15:04.377061 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-501d09d5-590e-4d67-a4d6-84f54462968e tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:15:04.377663 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-501d09d5-590e-4d67-a4d6-84f54462968e tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:15:04.383813 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-501d09d5-590e-4d67-a4d6-84f54462968e tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:04.384273 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-501d09d5-590e-4d67-a4d6-84f54462968e tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:04.385083 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-501d09d5-590e-4d67-a4d6-84f54462968e tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:04.385519 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-501d09d5-590e-4d67-a4d6-84f54462968e tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:04.410862 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-275995a3-ffc5-4d05-b1fb-4c3bbe5507d1 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:15:04.411816 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-275995a3-ffc5-4d05-b1fb-4c3bbe5507d1 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:15:04.418626 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-275995a3-ffc5-4d05-b1fb-4c3bbe5507d1 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:04.419074 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-275995a3-ffc5-4d05-b1fb-4c3bbe5507d1 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:04.419849 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-275995a3-ffc5-4d05-b1fb-4c3bbe5507d1 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:04.420279 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-275995a3-ffc5-4d05-b1fb-4c3bbe5507d1 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:04.451002 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-275995a3-ffc5-4d05-b1fb-4c3bbe5507d1 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043746 Nov 09 20:15:04.451585 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 470/919] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:15:04 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 20:15:04.515754 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-501d09d5-590e-4d67-a4d6-84f54462968e tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:15:04.523816 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-501d09d5-590e-4d67-a4d6-84f54462968e tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:15:04.525318 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-501d09d5-590e-4d67-a4d6-84f54462968e tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:15:04.526450 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-501d09d5-590e-4d67-a4d6-84f54462968e tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1747 microversion: 2.20 time: 0.153059 Nov 09 20:15:04.527000 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 450/920] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:15:04 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1747 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:15:05.461372 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-c964a83e-09e1-477c-bb3a-7974e7fcb6c7 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:15:05.462301 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-c964a83e-09e1-477c-bb3a-7974e7fcb6c7 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:15:05.468478 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c964a83e-09e1-477c-bb3a-7974e7fcb6c7 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:05.468924 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c964a83e-09e1-477c-bb3a-7974e7fcb6c7 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:05.469687 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c964a83e-09e1-477c-bb3a-7974e7fcb6c7 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:05.470117 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c964a83e-09e1-477c-bb3a-7974e7fcb6c7 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:05.499134 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-c964a83e-09e1-477c-bb3a-7974e7fcb6c7 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041523 Nov 09 20:15:05.499690 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 471/921] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:15:05 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:15:05.544681 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-0a9dd37f-5dee-447c-83b4-c97887110bbd tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:15:05.545213 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-0a9dd37f-5dee-447c-83b4-c97887110bbd tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:15:05.551373 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0a9dd37f-5dee-447c-83b4-c97887110bbd tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:05.551823 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0a9dd37f-5dee-447c-83b4-c97887110bbd tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:05.552619 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0a9dd37f-5dee-447c-83b4-c97887110bbd tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:05.553048 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0a9dd37f-5dee-447c-83b4-c97887110bbd tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:05.680575 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-0a9dd37f-5dee-447c-83b4-c97887110bbd tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:15:05.689101 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-0a9dd37f-5dee-447c-83b4-c97887110bbd tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:15:05.690579 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-0a9dd37f-5dee-447c-83b4-c97887110bbd tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:15:05.691703 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-0a9dd37f-5dee-447c-83b4-c97887110bbd tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1747 microversion: 2.20 time: 0.150737 Nov 09 20:15:05.692253 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 451/922] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:15:05 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1747 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:15:06.511173 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-61e1af96-1b5e-42b0-94d9-dab50b71314f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:15:06.512063 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-61e1af96-1b5e-42b0-94d9-dab50b71314f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:15:06.518343 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-61e1af96-1b5e-42b0-94d9-dab50b71314f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:06.518786 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-61e1af96-1b5e-42b0-94d9-dab50b71314f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:06.519546 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-61e1af96-1b5e-42b0-94d9-dab50b71314f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:06.519973 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-61e1af96-1b5e-42b0-94d9-dab50b71314f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:06.548092 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-61e1af96-1b5e-42b0-94d9-dab50b71314f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041285 Nov 09 20:15:06.548651 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 472/923] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:15:06 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:15:06.710282 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-4922b7a5-9282-41b3-a710-b7aa33326ed4 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:15:06.710906 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-4922b7a5-9282-41b3-a710-b7aa33326ed4 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:15:06.717263 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4922b7a5-9282-41b3-a710-b7aa33326ed4 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:06.717699 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4922b7a5-9282-41b3-a710-b7aa33326ed4 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:06.718455 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4922b7a5-9282-41b3-a710-b7aa33326ed4 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:06.718876 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4922b7a5-9282-41b3-a710-b7aa33326ed4 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:06.848787 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-4922b7a5-9282-41b3-a710-b7aa33326ed4 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:15:06.857676 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-4922b7a5-9282-41b3-a710-b7aa33326ed4 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:15:06.859139 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-4922b7a5-9282-41b3-a710-b7aa33326ed4 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:15:06.860260 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-4922b7a5-9282-41b3-a710-b7aa33326ed4 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1747 microversion: 2.20 time: 0.153632 Nov 09 20:15:06.860841 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 452/924] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:15:06 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1747 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:15:07.559665 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-c91d7e62-5adf-46ff-8276-80446f9bfccf tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:15:07.560680 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-c91d7e62-5adf-46ff-8276-80446f9bfccf tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:15:07.566932 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c91d7e62-5adf-46ff-8276-80446f9bfccf tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:07.567382 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c91d7e62-5adf-46ff-8276-80446f9bfccf tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:07.568158 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c91d7e62-5adf-46ff-8276-80446f9bfccf tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:07.568624 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c91d7e62-5adf-46ff-8276-80446f9bfccf tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:07.597330 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-c91d7e62-5adf-46ff-8276-80446f9bfccf tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041636 Nov 09 20:15:07.597876 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 473/925] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:15:07 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:15:07.878877 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-4776e7e9-2fb3-4ad8-832a-a16ca679425f tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:15:07.879510 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-4776e7e9-2fb3-4ad8-832a-a16ca679425f tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:15:07.886607 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4776e7e9-2fb3-4ad8-832a-a16ca679425f tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:07.887052 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4776e7e9-2fb3-4ad8-832a-a16ca679425f tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:07.887830 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4776e7e9-2fb3-4ad8-832a-a16ca679425f tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:07.888276 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4776e7e9-2fb3-4ad8-832a-a16ca679425f tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:08.014467 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-4776e7e9-2fb3-4ad8-832a-a16ca679425f tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:15:08.022654 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-4776e7e9-2fb3-4ad8-832a-a16ca679425f tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:15:08.024148 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-4776e7e9-2fb3-4ad8-832a-a16ca679425f tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:15:08.025524 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-4776e7e9-2fb3-4ad8-832a-a16ca679425f tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1747 microversion: 2.20 time: 0.150318 Nov 09 20:15:08.026347 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 453/926] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:15:07 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1747 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:15:08.609540 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-9028e3e4-af81-4bc7-b55f-97a4555555e1 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:15:08.610485 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-9028e3e4-af81-4bc7-b55f-97a4555555e1 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:15:08.616604 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-9028e3e4-af81-4bc7-b55f-97a4555555e1 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:08.617050 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-9028e3e4-af81-4bc7-b55f-97a4555555e1 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:08.617810 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-9028e3e4-af81-4bc7-b55f-97a4555555e1 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:08.618241 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-9028e3e4-af81-4bc7-b55f-97a4555555e1 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:08.645934 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-9028e3e4-af81-4bc7-b55f-97a4555555e1 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040370 Nov 09 20:15:08.646468 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 474/927] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:15:08 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:15:09.044112 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-937dc2b9-d080-4020-8b7b-c7fe1ce383ba tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:15:09.044692 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-937dc2b9-d080-4020-8b7b-c7fe1ce383ba tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:15:09.051037 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-937dc2b9-d080-4020-8b7b-c7fe1ce383ba tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:09.051481 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-937dc2b9-d080-4020-8b7b-c7fe1ce383ba tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:09.052254 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-937dc2b9-d080-4020-8b7b-c7fe1ce383ba tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:09.052714 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-937dc2b9-d080-4020-8b7b-c7fe1ce383ba tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:09.191122 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-937dc2b9-d080-4020-8b7b-c7fe1ce383ba tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:15:09.199947 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-937dc2b9-d080-4020-8b7b-c7fe1ce383ba tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:15:09.201441 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-937dc2b9-d080-4020-8b7b-c7fe1ce383ba tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:15:09.202565 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-937dc2b9-d080-4020-8b7b-c7fe1ce383ba tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1747 microversion: 2.20 time: 0.162187 Nov 09 20:15:09.203117 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 454/928] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:15:09 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1747 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:15:09.657806 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-56147473-9cb8-4cd3-9004-6a5b13f7fc1a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:15:09.658706 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-56147473-9cb8-4cd3-9004-6a5b13f7fc1a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:15:09.664946 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-56147473-9cb8-4cd3-9004-6a5b13f7fc1a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:09.665452 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-56147473-9cb8-4cd3-9004-6a5b13f7fc1a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:09.666197 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-56147473-9cb8-4cd3-9004-6a5b13f7fc1a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:09.666601 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-56147473-9cb8-4cd3-9004-6a5b13f7fc1a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:09.693894 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-56147473-9cb8-4cd3-9004-6a5b13f7fc1a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039846 Nov 09 20:15:09.694427 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 475/929] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:15:09 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:15:10.220377 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-811d2139-106f-4b39-b8b7-5946763e1e77 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:15:10.220993 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-811d2139-106f-4b39-b8b7-5946763e1e77 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:15:10.227187 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-811d2139-106f-4b39-b8b7-5946763e1e77 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:10.228702 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-811d2139-106f-4b39-b8b7-5946763e1e77 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:10.229493 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-811d2139-106f-4b39-b8b7-5946763e1e77 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:10.229920 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-811d2139-106f-4b39-b8b7-5946763e1e77 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:10.358188 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-811d2139-106f-4b39-b8b7-5946763e1e77 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:15:10.366430 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-811d2139-106f-4b39-b8b7-5946763e1e77 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:15:10.367911 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-811d2139-106f-4b39-b8b7-5946763e1e77 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:15:10.369782 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-811d2139-106f-4b39-b8b7-5946763e1e77 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1747 microversion: 2.20 time: 0.153039 Nov 09 20:15:10.370341 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 455/930] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:15:10 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1747 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:15:10.705762 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-accfefd1-9518-4f93-956b-6c047ddab2fd tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:15:10.706658 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-accfefd1-9518-4f93-956b-6c047ddab2fd tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:15:10.713798 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-accfefd1-9518-4f93-956b-6c047ddab2fd tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:10.714252 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-accfefd1-9518-4f93-956b-6c047ddab2fd tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:10.715032 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-accfefd1-9518-4f93-956b-6c047ddab2fd tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:10.715469 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-accfefd1-9518-4f93-956b-6c047ddab2fd tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:10.744244 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-accfefd1-9518-4f93-956b-6c047ddab2fd tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042392 Nov 09 20:15:10.744817 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 476/931] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:15:10 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:15:11.388496 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-02a1c47e-8469-4b65-815e-24a1b30ad493 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:15:11.389118 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-02a1c47e-8469-4b65-815e-24a1b30ad493 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:15:11.395182 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-02a1c47e-8469-4b65-815e-24a1b30ad493 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:11.395612 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-02a1c47e-8469-4b65-815e-24a1b30ad493 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:11.396366 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-02a1c47e-8469-4b65-815e-24a1b30ad493 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:11.396810 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-02a1c47e-8469-4b65-815e-24a1b30ad493 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:11.523896 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-02a1c47e-8469-4b65-815e-24a1b30ad493 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:15:11.532262 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-02a1c47e-8469-4b65-815e-24a1b30ad493 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:15:11.533763 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-02a1c47e-8469-4b65-815e-24a1b30ad493 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:15:11.534893 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-02a1c47e-8469-4b65-815e-24a1b30ad493 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1747 microversion: 2.20 time: 0.150192 Nov 09 20:15:11.535431 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 456/932] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:15:11 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1747 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:15:11.754883 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-15312dd8-e82d-44fd-99be-9a7103d48bb0 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:15:11.755793 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-15312dd8-e82d-44fd-99be-9a7103d48bb0 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:15:11.762880 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-15312dd8-e82d-44fd-99be-9a7103d48bb0 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:11.763324 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-15312dd8-e82d-44fd-99be-9a7103d48bb0 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:11.764094 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-15312dd8-e82d-44fd-99be-9a7103d48bb0 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:11.764551 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-15312dd8-e82d-44fd-99be-9a7103d48bb0 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:11.793269 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-15312dd8-e82d-44fd-99be-9a7103d48bb0 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042108 Nov 09 20:15:11.793806 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 477/933] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:15:11 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:15:12.552940 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-68845c1d-2eee-40bb-bf34-6cf9464fd725 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:15:12.553471 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-68845c1d-2eee-40bb-bf34-6cf9464fd725 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:15:12.559813 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-68845c1d-2eee-40bb-bf34-6cf9464fd725 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:12.560256 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-68845c1d-2eee-40bb-bf34-6cf9464fd725 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:12.561068 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-68845c1d-2eee-40bb-bf34-6cf9464fd725 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:12.561507 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-68845c1d-2eee-40bb-bf34-6cf9464fd725 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:12.692827 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-68845c1d-2eee-40bb-bf34-6cf9464fd725 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:15:12.701525 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-68845c1d-2eee-40bb-bf34-6cf9464fd725 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:15:12.702994 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-68845c1d-2eee-40bb-bf34-6cf9464fd725 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:15:12.704115 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-68845c1d-2eee-40bb-bf34-6cf9464fd725 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1747 microversion: 2.20 time: 0.154920 Nov 09 20:15:12.704695 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 457/934] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:15:12 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1747 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:15:12.804451 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-f260dc49-4f8d-49ba-aa0f-f96bd00f7e8d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:15:12.805299 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-f260dc49-4f8d-49ba-aa0f-f96bd00f7e8d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:15:12.811602 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f260dc49-4f8d-49ba-aa0f-f96bd00f7e8d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:12.812048 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f260dc49-4f8d-49ba-aa0f-f96bd00f7e8d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:12.812847 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f260dc49-4f8d-49ba-aa0f-f96bd00f7e8d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:12.813277 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f260dc49-4f8d-49ba-aa0f-f96bd00f7e8d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:12.842224 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-f260dc49-4f8d-49ba-aa0f-f96bd00f7e8d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041505 Nov 09 20:15:12.842771 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 478/935] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:15:12 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:15:13.722717 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-ff25a118-fa31-4268-a39f-f6cd26927e40 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:15:13.723310 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-ff25a118-fa31-4268-a39f-f6cd26927e40 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:15:13.730119 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ff25a118-fa31-4268-a39f-f6cd26927e40 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:13.730559 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ff25a118-fa31-4268-a39f-f6cd26927e40 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:13.731579 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ff25a118-fa31-4268-a39f-f6cd26927e40 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:13.732007 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ff25a118-fa31-4268-a39f-f6cd26927e40 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:13.853549 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-5d4c205c-d982-4a7d-af0c-b71c7b79e06d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:15:13.854455 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-5d4c205c-d982-4a7d-af0c-b71c7b79e06d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:15:13.858901 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-ff25a118-fa31-4268-a39f-f6cd26927e40 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:15:13.861222 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-5d4c205c-d982-4a7d-af0c-b71c7b79e06d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:13.861677 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-5d4c205c-d982-4a7d-af0c-b71c7b79e06d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:13.862461 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-5d4c205c-d982-4a7d-af0c-b71c7b79e06d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:13.862891 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-5d4c205c-d982-4a7d-af0c-b71c7b79e06d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:13.866817 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-ff25a118-fa31-4268-a39f-f6cd26927e40 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:15:13.868355 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-ff25a118-fa31-4268-a39f-f6cd26927e40 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:15:13.869738 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-ff25a118-fa31-4268-a39f-f6cd26927e40 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1747 microversion: 2.20 time: 0.150650 Nov 09 20:15:13.870284 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 458/936] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:15:13 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1747 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:15:13.892162 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-5d4c205c-d982-4a7d-af0c-b71c7b79e06d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042997 Nov 09 20:15:13.892736 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 479/937] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:15:13 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 20:15:14.886904 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-9050dbb9-ace2-4d1a-9cff-b2c825bcfe94 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:15:14.887485 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-9050dbb9-ace2-4d1a-9cff-b2c825bcfe94 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:15:14.893669 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9050dbb9-ace2-4d1a-9cff-b2c825bcfe94 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:14.894119 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9050dbb9-ace2-4d1a-9cff-b2c825bcfe94 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:14.894891 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9050dbb9-ace2-4d1a-9cff-b2c825bcfe94 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:14.895326 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9050dbb9-ace2-4d1a-9cff-b2c825bcfe94 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:14.903241 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-ae0611f2-3145-4fcb-9d1a-bc7817325b6c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:15:14.904144 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-ae0611f2-3145-4fcb-9d1a-bc7817325b6c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:15:14.910310 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ae0611f2-3145-4fcb-9d1a-bc7817325b6c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:14.910757 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ae0611f2-3145-4fcb-9d1a-bc7817325b6c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:14.911529 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ae0611f2-3145-4fcb-9d1a-bc7817325b6c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:14.911966 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ae0611f2-3145-4fcb-9d1a-bc7817325b6c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:14.942059 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-ae0611f2-3145-4fcb-9d1a-bc7817325b6c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042898 Nov 09 20:15:14.942627 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 480/938] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:15:14 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 20:15:15.026068 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-9050dbb9-ace2-4d1a-9cff-b2c825bcfe94 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:15:15.034347 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-9050dbb9-ace2-4d1a-9cff-b2c825bcfe94 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:15:15.035847 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-9050dbb9-ace2-4d1a-9cff-b2c825bcfe94 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:15:15.037049 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-9050dbb9-ace2-4d1a-9cff-b2c825bcfe94 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1747 microversion: 2.20 time: 0.153988 Nov 09 20:15:15.037606 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 459/939] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:15:14 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1747 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:15:15.954741 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-45bba8df-1e9e-443c-8a30-401ce652c5fa tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:15:15.955770 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-45bba8df-1e9e-443c-8a30-401ce652c5fa tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:15:15.961625 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-45bba8df-1e9e-443c-8a30-401ce652c5fa tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:15.962141 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-45bba8df-1e9e-443c-8a30-401ce652c5fa tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:15.962920 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-45bba8df-1e9e-443c-8a30-401ce652c5fa tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:15.963345 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-45bba8df-1e9e-443c-8a30-401ce652c5fa tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:15.991139 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-45bba8df-1e9e-443c-8a30-401ce652c5fa tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040249 Nov 09 20:15:15.991668 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 481/940] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:15:15 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:15:16.056087 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-28acad86-4379-4e0a-ad7b-92ce214541e5 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:15:16.056621 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-28acad86-4379-4e0a-ad7b-92ce214541e5 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:15:16.062761 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-28acad86-4379-4e0a-ad7b-92ce214541e5 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:16.063202 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-28acad86-4379-4e0a-ad7b-92ce214541e5 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:16.063964 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-28acad86-4379-4e0a-ad7b-92ce214541e5 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:16.064393 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-28acad86-4379-4e0a-ad7b-92ce214541e5 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:16.191732 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-28acad86-4379-4e0a-ad7b-92ce214541e5 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:15:16.200300 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-28acad86-4379-4e0a-ad7b-92ce214541e5 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:15:16.201808 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-28acad86-4379-4e0a-ad7b-92ce214541e5 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:15:16.202935 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-28acad86-4379-4e0a-ad7b-92ce214541e5 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1747 microversion: 2.20 time: 0.151135 Nov 09 20:15:16.203474 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 460/941] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:15:16 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1747 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:15:17.002880 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-c36e0727-fee6-4941-b1ed-82949a5195b3 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:15:17.003788 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-c36e0727-fee6-4941-b1ed-82949a5195b3 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:15:17.010562 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c36e0727-fee6-4941-b1ed-82949a5195b3 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:17.011003 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c36e0727-fee6-4941-b1ed-82949a5195b3 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:17.011775 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c36e0727-fee6-4941-b1ed-82949a5195b3 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:17.012205 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c36e0727-fee6-4941-b1ed-82949a5195b3 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:17.041453 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-c36e0727-fee6-4941-b1ed-82949a5195b3 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042313 Nov 09 20:15:17.041993 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 482/942] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:15:16 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:15:17.220195 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-a692c63a-f894-44d9-acd3-c039e2cfa7fd tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:15:17.220825 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-a692c63a-f894-44d9-acd3-c039e2cfa7fd tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:15:17.227042 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a692c63a-f894-44d9-acd3-c039e2cfa7fd tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:17.227537 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a692c63a-f894-44d9-acd3-c039e2cfa7fd tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:17.228652 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a692c63a-f894-44d9-acd3-c039e2cfa7fd tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:17.229091 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a692c63a-f894-44d9-acd3-c039e2cfa7fd tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:17.358034 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-a692c63a-f894-44d9-acd3-c039e2cfa7fd tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:15:17.366078 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-a692c63a-f894-44d9-acd3-c039e2cfa7fd tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:15:17.367564 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-a692c63a-f894-44d9-acd3-c039e2cfa7fd tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:15:17.368825 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-a692c63a-f894-44d9-acd3-c039e2cfa7fd tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1747 microversion: 2.20 time: 0.152270 Nov 09 20:15:17.369377 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 461/943] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:15:17 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1747 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:15:18.052375 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-428f9b3e-438a-434e-b609-030d09dfffcc tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:15:18.053308 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-428f9b3e-438a-434e-b609-030d09dfffcc tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:15:18.060570 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-428f9b3e-438a-434e-b609-030d09dfffcc tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:18.061018 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-428f9b3e-438a-434e-b609-030d09dfffcc tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:18.061787 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-428f9b3e-438a-434e-b609-030d09dfffcc tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:18.062218 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-428f9b3e-438a-434e-b609-030d09dfffcc tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:18.090703 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-428f9b3e-438a-434e-b609-030d09dfffcc tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042060 Nov 09 20:15:18.091248 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 483/944] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:15:18 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:15:18.387208 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-530bc4ac-aaa5-44e6-9028-3263b63a5e2d tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:15:18.387812 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-530bc4ac-aaa5-44e6-9028-3263b63a5e2d tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:15:18.394084 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-530bc4ac-aaa5-44e6-9028-3263b63a5e2d tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:18.394533 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-530bc4ac-aaa5-44e6-9028-3263b63a5e2d tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:18.395303 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-530bc4ac-aaa5-44e6-9028-3263b63a5e2d tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:18.395764 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-530bc4ac-aaa5-44e6-9028-3263b63a5e2d tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:18.525722 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-530bc4ac-aaa5-44e6-9028-3263b63a5e2d tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:15:18.534072 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-530bc4ac-aaa5-44e6-9028-3263b63a5e2d tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:15:18.535569 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-530bc4ac-aaa5-44e6-9028-3263b63a5e2d tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:15:18.536752 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-530bc4ac-aaa5-44e6-9028-3263b63a5e2d tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1747 microversion: 2.20 time: 0.153527 Nov 09 20:15:18.537296 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 462/945] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:15:18 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1747 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:15:19.101928 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-d988b0bf-59e4-462a-a962-305206cfdf3f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:15:19.103394 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-d988b0bf-59e4-462a-a962-305206cfdf3f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:15:19.109951 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d988b0bf-59e4-462a-a962-305206cfdf3f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:19.110389 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d988b0bf-59e4-462a-a962-305206cfdf3f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:19.111164 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d988b0bf-59e4-462a-a962-305206cfdf3f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:19.111589 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d988b0bf-59e4-462a-a962-305206cfdf3f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:19.142125 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-d988b0bf-59e4-462a-a962-305206cfdf3f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043856 Nov 09 20:15:19.142682 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 484/946] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:15:19 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:15:19.554569 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-a883b4dd-2e85-401b-bc5f-91b9eeba0b2c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:15:19.555172 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-a883b4dd-2e85-401b-bc5f-91b9eeba0b2c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:15:19.562265 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a883b4dd-2e85-401b-bc5f-91b9eeba0b2c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:19.562708 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a883b4dd-2e85-401b-bc5f-91b9eeba0b2c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:19.563472 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a883b4dd-2e85-401b-bc5f-91b9eeba0b2c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:19.563904 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a883b4dd-2e85-401b-bc5f-91b9eeba0b2c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:19.695961 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-a883b4dd-2e85-401b-bc5f-91b9eeba0b2c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:15:19.703958 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-a883b4dd-2e85-401b-bc5f-91b9eeba0b2c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:15:19.705464 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-a883b4dd-2e85-401b-bc5f-91b9eeba0b2c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:15:19.706595 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-a883b4dd-2e85-401b-bc5f-91b9eeba0b2c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1747 microversion: 2.20 time: 0.155658 Nov 09 20:15:19.707145 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 463/947] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:15:19 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1747 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:15:20.153469 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-70ba5f83-fe41-4d6c-9c1f-c35fb2d4d5a4 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:15:20.154390 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-70ba5f83-fe41-4d6c-9c1f-c35fb2d4d5a4 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:15:20.160539 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-70ba5f83-fe41-4d6c-9c1f-c35fb2d4d5a4 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:20.160983 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-70ba5f83-fe41-4d6c-9c1f-c35fb2d4d5a4 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:20.161744 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-70ba5f83-fe41-4d6c-9c1f-c35fb2d4d5a4 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:20.162173 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-70ba5f83-fe41-4d6c-9c1f-c35fb2d4d5a4 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:20.191021 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-70ba5f83-fe41-4d6c-9c1f-c35fb2d4d5a4 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041290 Nov 09 20:15:20.191561 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 485/948] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:15:20 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:15:20.724942 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-05b9a768-b0ff-45c4-a4a2-47ba2cf1f9a2 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:15:20.725534 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-05b9a768-b0ff-45c4-a4a2-47ba2cf1f9a2 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:15:20.732594 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-05b9a768-b0ff-45c4-a4a2-47ba2cf1f9a2 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:20.733036 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-05b9a768-b0ff-45c4-a4a2-47ba2cf1f9a2 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:20.733794 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-05b9a768-b0ff-45c4-a4a2-47ba2cf1f9a2 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:20.734219 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-05b9a768-b0ff-45c4-a4a2-47ba2cf1f9a2 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:20.866622 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-05b9a768-b0ff-45c4-a4a2-47ba2cf1f9a2 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:15:20.874977 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-05b9a768-b0ff-45c4-a4a2-47ba2cf1f9a2 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:15:20.876467 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-05b9a768-b0ff-45c4-a4a2-47ba2cf1f9a2 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:15:20.877673 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-05b9a768-b0ff-45c4-a4a2-47ba2cf1f9a2 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1747 microversion: 2.20 time: 0.156293 Nov 09 20:15:20.878219 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 464/949] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:15:20 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1747 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:15:21.203109 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-f513c796-8969-406c-ae54-c117fa5d1e33 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:15:21.203937 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-f513c796-8969-406c-ae54-c117fa5d1e33 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:15:21.210158 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f513c796-8969-406c-ae54-c117fa5d1e33 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:21.210610 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f513c796-8969-406c-ae54-c117fa5d1e33 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:21.211382 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f513c796-8969-406c-ae54-c117fa5d1e33 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:21.211814 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f513c796-8969-406c-ae54-c117fa5d1e33 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:21.240069 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-f513c796-8969-406c-ae54-c117fa5d1e33 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040827 Nov 09 20:15:21.240644 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 486/950] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:15:21 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:15:21.895798 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-efd1567d-dcee-4687-b1c1-64804113a6ec tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:15:21.896447 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-efd1567d-dcee-4687-b1c1-64804113a6ec tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:15:21.903368 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-efd1567d-dcee-4687-b1c1-64804113a6ec tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:21.903746 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-efd1567d-dcee-4687-b1c1-64804113a6ec tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:21.904533 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-efd1567d-dcee-4687-b1c1-64804113a6ec tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:21.904962 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-efd1567d-dcee-4687-b1c1-64804113a6ec tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:22.032143 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-efd1567d-dcee-4687-b1c1-64804113a6ec tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:15:22.040713 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-efd1567d-dcee-4687-b1c1-64804113a6ec tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:15:22.042185 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-efd1567d-dcee-4687-b1c1-64804113a6ec tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:15:22.043307 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-efd1567d-dcee-4687-b1c1-64804113a6ec tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1747 microversion: 2.20 time: 0.151155 Nov 09 20:15:22.043849 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 465/951] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:15:21 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1747 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:15:22.252110 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-6c3967f5-3cd6-4bc4-9522-17d8dd42e46c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:15:22.252955 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-6c3967f5-3cd6-4bc4-9522-17d8dd42e46c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:15:22.259648 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6c3967f5-3cd6-4bc4-9522-17d8dd42e46c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:22.260080 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6c3967f5-3cd6-4bc4-9522-17d8dd42e46c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:22.260884 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6c3967f5-3cd6-4bc4-9522-17d8dd42e46c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:22.261310 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6c3967f5-3cd6-4bc4-9522-17d8dd42e46c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:22.290316 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-6c3967f5-3cd6-4bc4-9522-17d8dd42e46c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041888 Nov 09 20:15:22.290871 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 487/952] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:15:22 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:15:23.061608 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-c53af093-833b-4be2-882f-b2939422418f tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:15:23.062154 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-c53af093-833b-4be2-882f-b2939422418f tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:15:23.068239 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c53af093-833b-4be2-882f-b2939422418f tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:23.068720 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c53af093-833b-4be2-882f-b2939422418f tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:23.069485 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c53af093-833b-4be2-882f-b2939422418f tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:23.069914 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c53af093-833b-4be2-882f-b2939422418f tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:23.201803 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-c53af093-833b-4be2-882f-b2939422418f tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:15:23.209882 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-c53af093-833b-4be2-882f-b2939422418f tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:15:23.211371 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-c53af093-833b-4be2-882f-b2939422418f tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:15:23.212587 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-c53af093-833b-4be2-882f-b2939422418f tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1747 microversion: 2.20 time: 0.154676 Nov 09 20:15:23.213142 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 466/953] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:15:23 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1747 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:15:23.301806 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-42dbcc9e-87da-41a4-b868-964ea6be46c8 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:15:23.302713 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-42dbcc9e-87da-41a4-b868-964ea6be46c8 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:15:23.309790 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-42dbcc9e-87da-41a4-b868-964ea6be46c8 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:23.310232 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-42dbcc9e-87da-41a4-b868-964ea6be46c8 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:23.311019 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-42dbcc9e-87da-41a4-b868-964ea6be46c8 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:23.311433 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-42dbcc9e-87da-41a4-b868-964ea6be46c8 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:23.339195 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-42dbcc9e-87da-41a4-b868-964ea6be46c8 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041069 Nov 09 20:15:23.339666 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 488/954] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:15:23 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:15:24.230009 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-b4f7744b-5084-411a-bfef-2788773bcb54 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:15:24.230648 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-b4f7744b-5084-411a-bfef-2788773bcb54 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:15:24.237128 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b4f7744b-5084-411a-bfef-2788773bcb54 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:24.237574 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b4f7744b-5084-411a-bfef-2788773bcb54 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:24.238373 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b4f7744b-5084-411a-bfef-2788773bcb54 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:24.238798 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b4f7744b-5084-411a-bfef-2788773bcb54 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:24.350331 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-55447c7d-12a1-4101-a503-f19c2a26deee tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:15:24.351238 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-55447c7d-12a1-4101-a503-f19c2a26deee tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:15:24.357657 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-55447c7d-12a1-4101-a503-f19c2a26deee tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:24.358108 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-55447c7d-12a1-4101-a503-f19c2a26deee tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:24.358892 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-55447c7d-12a1-4101-a503-f19c2a26deee tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:24.359321 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-55447c7d-12a1-4101-a503-f19c2a26deee tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:24.367308 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-b4f7744b-5084-411a-bfef-2788773bcb54 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:15:24.376162 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-b4f7744b-5084-411a-bfef-2788773bcb54 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:15:24.377668 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-b4f7744b-5084-411a-bfef-2788773bcb54 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:15:24.378791 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-b4f7744b-5084-411a-bfef-2788773bcb54 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1747 microversion: 2.20 time: 0.152770 Nov 09 20:15:24.379340 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 467/955] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:15:24 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1747 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:15:24.389569 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-55447c7d-12a1-4101-a503-f19c2a26deee tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042923 Nov 09 20:15:24.390116 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 489/956] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:15:24 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 20:15:25.398283 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-0ffecd0c-d4db-4e6d-b4cc-8d13b7811523 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:15:25.398931 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-0ffecd0c-d4db-4e6d-b4cc-8d13b7811523 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:15:25.401205 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-14f1b699-d5ec-43dd-87a6-c6d9229ef7ef tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:15:25.402107 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-14f1b699-d5ec-43dd-87a6-c6d9229ef7ef tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:15:25.405324 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0ffecd0c-d4db-4e6d-b4cc-8d13b7811523 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:25.405765 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0ffecd0c-d4db-4e6d-b4cc-8d13b7811523 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:25.406529 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0ffecd0c-d4db-4e6d-b4cc-8d13b7811523 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:25.406950 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0ffecd0c-d4db-4e6d-b4cc-8d13b7811523 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:25.408235 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-14f1b699-d5ec-43dd-87a6-c6d9229ef7ef tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:25.408714 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-14f1b699-d5ec-43dd-87a6-c6d9229ef7ef tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:25.409490 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-14f1b699-d5ec-43dd-87a6-c6d9229ef7ef tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:25.409922 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-14f1b699-d5ec-43dd-87a6-c6d9229ef7ef tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:25.439036 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-14f1b699-d5ec-43dd-87a6-c6d9229ef7ef tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041715 Nov 09 20:15:25.439603 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 490/957] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:15:25 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:15:25.535447 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-0ffecd0c-d4db-4e6d-b4cc-8d13b7811523 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:15:25.543862 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-0ffecd0c-d4db-4e6d-b4cc-8d13b7811523 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:15:25.545382 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-0ffecd0c-d4db-4e6d-b4cc-8d13b7811523 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:15:25.546521 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-0ffecd0c-d4db-4e6d-b4cc-8d13b7811523 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1747 microversion: 2.20 time: 0.152038 Nov 09 20:15:25.547072 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 468/958] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:15:25 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1747 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:15:26.451078 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-f7091355-79a3-4091-a6c9-3add5c50e3ab tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:15:26.451976 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-f7091355-79a3-4091-a6c9-3add5c50e3ab tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:15:26.458084 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f7091355-79a3-4091-a6c9-3add5c50e3ab tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:26.458526 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f7091355-79a3-4091-a6c9-3add5c50e3ab tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:26.459290 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f7091355-79a3-4091-a6c9-3add5c50e3ab tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:26.459716 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f7091355-79a3-4091-a6c9-3add5c50e3ab tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:26.487528 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-f7091355-79a3-4091-a6c9-3add5c50e3ab tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040957 Nov 09 20:15:26.488248 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 491/959] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:15:26 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:15:26.565738 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-8007233c-609b-47f9-ac8d-c4cc0035d85c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:15:26.566272 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-8007233c-609b-47f9-ac8d-c4cc0035d85c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:15:26.572964 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8007233c-609b-47f9-ac8d-c4cc0035d85c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:26.573413 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8007233c-609b-47f9-ac8d-c4cc0035d85c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:26.574180 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8007233c-609b-47f9-ac8d-c4cc0035d85c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:26.574613 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8007233c-609b-47f9-ac8d-c4cc0035d85c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:26.710008 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-8007233c-609b-47f9-ac8d-c4cc0035d85c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:15:26.718235 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-8007233c-609b-47f9-ac8d-c4cc0035d85c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:15:26.719708 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-8007233c-609b-47f9-ac8d-c4cc0035d85c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:15:26.720905 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-8007233c-609b-47f9-ac8d-c4cc0035d85c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1747 microversion: 2.20 time: 0.159038 Nov 09 20:15:26.721461 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 469/960] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:15:26 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1747 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:15:27.499370 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-7918f49d-7cc7-48a5-8d73-3fdd3024ec65 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:15:27.500311 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-7918f49d-7cc7-48a5-8d73-3fdd3024ec65 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:15:27.506509 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-7918f49d-7cc7-48a5-8d73-3fdd3024ec65 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:27.506936 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-7918f49d-7cc7-48a5-8d73-3fdd3024ec65 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:27.507710 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-7918f49d-7cc7-48a5-8d73-3fdd3024ec65 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:27.508140 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-7918f49d-7cc7-48a5-8d73-3fdd3024ec65 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:27.536312 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-7918f49d-7cc7-48a5-8d73-3fdd3024ec65 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040629 Nov 09 20:15:27.536816 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 492/961] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:15:27 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:15:27.739324 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-da9668ff-438a-43d1-bed9-94f26e703748 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:15:27.739897 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-da9668ff-438a-43d1-bed9-94f26e703748 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:15:27.746781 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-da9668ff-438a-43d1-bed9-94f26e703748 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:27.747256 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-da9668ff-438a-43d1-bed9-94f26e703748 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:27.748020 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-da9668ff-438a-43d1-bed9-94f26e703748 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:27.748467 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-da9668ff-438a-43d1-bed9-94f26e703748 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:27.874603 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-da9668ff-438a-43d1-bed9-94f26e703748 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:15:27.882524 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-da9668ff-438a-43d1-bed9-94f26e703748 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:15:27.884062 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-da9668ff-438a-43d1-bed9-94f26e703748 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:15:27.885213 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-da9668ff-438a-43d1-bed9-94f26e703748 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1747 microversion: 2.20 time: 0.149529 Nov 09 20:15:27.885764 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 470/962] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:15:27 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1747 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:15:28.548077 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-f1cfe752-fbb5-4a8a-b10f-9b8a7f60f7bc tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:15:28.548935 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-f1cfe752-fbb5-4a8a-b10f-9b8a7f60f7bc tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:15:28.555195 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f1cfe752-fbb5-4a8a-b10f-9b8a7f60f7bc tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:28.556125 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f1cfe752-fbb5-4a8a-b10f-9b8a7f60f7bc tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:28.556936 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f1cfe752-fbb5-4a8a-b10f-9b8a7f60f7bc tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:28.557369 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f1cfe752-fbb5-4a8a-b10f-9b8a7f60f7bc tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:28.586177 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-f1cfe752-fbb5-4a8a-b10f-9b8a7f60f7bc tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041908 Nov 09 20:15:28.587532 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 493/963] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:15:28 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:15:28.903361 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-db7255f0-0e51-4ab5-bf64-92924334c7f0 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:15:28.903954 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-db7255f0-0e51-4ab5-bf64-92924334c7f0 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:15:28.910369 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-db7255f0-0e51-4ab5-bf64-92924334c7f0 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:28.910818 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-db7255f0-0e51-4ab5-bf64-92924334c7f0 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:28.911598 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-db7255f0-0e51-4ab5-bf64-92924334c7f0 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:28.912028 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-db7255f0-0e51-4ab5-bf64-92924334c7f0 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:29.048470 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-db7255f0-0e51-4ab5-bf64-92924334c7f0 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:15:29.057569 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-db7255f0-0e51-4ab5-bf64-92924334c7f0 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:15:29.059060 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-db7255f0-0e51-4ab5-bf64-92924334c7f0 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:15:29.060210 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-db7255f0-0e51-4ab5-bf64-92924334c7f0 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1747 microversion: 2.20 time: 0.160723 Nov 09 20:15:29.060799 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 471/964] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:15:28 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1747 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:15:29.598183 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-238eadfe-039b-4b98-bfad-83d2b29cb316 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:15:29.599090 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-238eadfe-039b-4b98-bfad-83d2b29cb316 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:15:29.606272 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-238eadfe-039b-4b98-bfad-83d2b29cb316 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:29.606969 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-238eadfe-039b-4b98-bfad-83d2b29cb316 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:29.607734 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-238eadfe-039b-4b98-bfad-83d2b29cb316 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:29.608158 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-238eadfe-039b-4b98-bfad-83d2b29cb316 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:29.636725 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-238eadfe-039b-4b98-bfad-83d2b29cb316 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042271 Nov 09 20:15:29.637274 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 494/965] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:15:29 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:15:30.077992 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-22e6a768-c2fb-4fad-9260-a250f0f38600 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:15:30.078590 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-22e6a768-c2fb-4fad-9260-a250f0f38600 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:15:30.084564 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-22e6a768-c2fb-4fad-9260-a250f0f38600 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:30.085006 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-22e6a768-c2fb-4fad-9260-a250f0f38600 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:30.085773 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-22e6a768-c2fb-4fad-9260-a250f0f38600 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:30.086196 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-22e6a768-c2fb-4fad-9260-a250f0f38600 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:30.219911 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-22e6a768-c2fb-4fad-9260-a250f0f38600 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:15:30.228643 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-22e6a768-c2fb-4fad-9260-a250f0f38600 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:15:30.230128 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-22e6a768-c2fb-4fad-9260-a250f0f38600 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:15:30.231264 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-22e6a768-c2fb-4fad-9260-a250f0f38600 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1747 microversion: 2.20 time: 0.156921 Nov 09 20:15:30.232071 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 472/966] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:15:30 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1747 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:15:30.647977 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-1c2c31a4-001a-431c-b63b-fe73d425d22c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:15:30.648904 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-1c2c31a4-001a-431c-b63b-fe73d425d22c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:15:30.655330 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-1c2c31a4-001a-431c-b63b-fe73d425d22c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:30.655764 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-1c2c31a4-001a-431c-b63b-fe73d425d22c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:30.656564 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-1c2c31a4-001a-431c-b63b-fe73d425d22c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:30.656989 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-1c2c31a4-001a-431c-b63b-fe73d425d22c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:30.685445 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-1c2c31a4-001a-431c-b63b-fe73d425d22c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041160 Nov 09 20:15:30.685973 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 495/967] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:15:30 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:15:31.249399 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-1fe30663-64dc-4ed4-9d1a-cf791d5cce0d tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:15:31.249998 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-1fe30663-64dc-4ed4-9d1a-cf791d5cce0d tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:15:31.256216 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1fe30663-64dc-4ed4-9d1a-cf791d5cce0d tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:31.256687 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1fe30663-64dc-4ed4-9d1a-cf791d5cce0d tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:31.257455 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1fe30663-64dc-4ed4-9d1a-cf791d5cce0d tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:31.257884 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1fe30663-64dc-4ed4-9d1a-cf791d5cce0d tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:31.390687 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-1fe30663-64dc-4ed4-9d1a-cf791d5cce0d tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:15:31.398651 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-1fe30663-64dc-4ed4-9d1a-cf791d5cce0d tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:15:31.400761 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-1fe30663-64dc-4ed4-9d1a-cf791d5cce0d tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:15:31.401898 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-1fe30663-64dc-4ed4-9d1a-cf791d5cce0d tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1747 microversion: 2.20 time: 0.156205 Nov 09 20:15:31.402445 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 473/968] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:15:31 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1747 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:15:31.697884 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-a62b538d-f558-45e2-ba98-1b6bc335d70b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:15:31.701416 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-a62b538d-f558-45e2-ba98-1b6bc335d70b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:15:31.705154 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a62b538d-f558-45e2-ba98-1b6bc335d70b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:31.705599 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a62b538d-f558-45e2-ba98-1b6bc335d70b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:31.706375 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a62b538d-f558-45e2-ba98-1b6bc335d70b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:31.706802 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a62b538d-f558-45e2-ba98-1b6bc335d70b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:31.740664 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-a62b538d-f558-45e2-ba98-1b6bc335d70b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047710 Nov 09 20:15:31.741214 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 496/969] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:15:31 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:15:32.420442 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-3716479e-d31a-47e0-8e11-fded9229dbc6 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:15:32.420987 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-3716479e-d31a-47e0-8e11-fded9229dbc6 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:15:32.427134 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3716479e-d31a-47e0-8e11-fded9229dbc6 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:32.427574 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3716479e-d31a-47e0-8e11-fded9229dbc6 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:32.428340 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3716479e-d31a-47e0-8e11-fded9229dbc6 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:32.428792 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3716479e-d31a-47e0-8e11-fded9229dbc6 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:32.555212 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-3716479e-d31a-47e0-8e11-fded9229dbc6 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:15:32.563287 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-3716479e-d31a-47e0-8e11-fded9229dbc6 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:15:32.564786 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-3716479e-d31a-47e0-8e11-fded9229dbc6 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:15:32.565914 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-3716479e-d31a-47e0-8e11-fded9229dbc6 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1747 microversion: 2.20 time: 0.149852 Nov 09 20:15:32.566460 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 474/970] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:15:32 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1747 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:15:32.752568 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-c933fc16-ca7d-4277-8924-aad6bcf61987 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:15:32.753437 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-c933fc16-ca7d-4277-8924-aad6bcf61987 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:15:32.761220 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c933fc16-ca7d-4277-8924-aad6bcf61987 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:32.761667 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c933fc16-ca7d-4277-8924-aad6bcf61987 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:32.762445 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c933fc16-ca7d-4277-8924-aad6bcf61987 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:32.762877 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c933fc16-ca7d-4277-8924-aad6bcf61987 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:32.791064 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-c933fc16-ca7d-4277-8924-aad6bcf61987 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042284 Nov 09 20:15:32.791725 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 497/971] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:15:32 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:15:33.583927 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-3f92705f-8da5-4e32-a49e-2b1e7973e724 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:15:33.584471 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-3f92705f-8da5-4e32-a49e-2b1e7973e724 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:15:33.590812 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3f92705f-8da5-4e32-a49e-2b1e7973e724 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:33.591261 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3f92705f-8da5-4e32-a49e-2b1e7973e724 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:33.592043 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3f92705f-8da5-4e32-a49e-2b1e7973e724 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:33.592603 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3f92705f-8da5-4e32-a49e-2b1e7973e724 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:33.722499 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-3f92705f-8da5-4e32-a49e-2b1e7973e724 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:15:33.731126 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-3f92705f-8da5-4e32-a49e-2b1e7973e724 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:15:33.732902 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-3f92705f-8da5-4e32-a49e-2b1e7973e724 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:15:33.734042 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-3f92705f-8da5-4e32-a49e-2b1e7973e724 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1747 microversion: 2.20 time: 0.153867 Nov 09 20:15:33.734595 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 475/972] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:15:33 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1747 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:15:33.801873 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-0007b23b-488a-42c4-8495-f94b0e9ad262 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:15:33.802769 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-0007b23b-488a-42c4-8495-f94b0e9ad262 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:15:33.809494 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-0007b23b-488a-42c4-8495-f94b0e9ad262 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:33.809930 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-0007b23b-488a-42c4-8495-f94b0e9ad262 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:33.810695 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-0007b23b-488a-42c4-8495-f94b0e9ad262 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:33.811117 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-0007b23b-488a-42c4-8495-f94b0e9ad262 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:33.838974 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-0007b23b-488a-42c4-8495-f94b0e9ad262 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040154 Nov 09 20:15:33.839445 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 498/973] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:15:33 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:15:34.752583 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-56982780-fdf3-4a20-af7c-a48674c1b6a3 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:15:34.753182 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-56982780-fdf3-4a20-af7c-a48674c1b6a3 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:15:34.759288 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-56982780-fdf3-4a20-af7c-a48674c1b6a3 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:34.759729 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-56982780-fdf3-4a20-af7c-a48674c1b6a3 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:34.761312 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-56982780-fdf3-4a20-af7c-a48674c1b6a3 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:34.761730 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-56982780-fdf3-4a20-af7c-a48674c1b6a3 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:34.849674 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-3264778c-45bc-4da6-b47a-b0a2b9d49efb tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:15:34.850660 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-3264778c-45bc-4da6-b47a-b0a2b9d49efb tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:15:34.857908 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-3264778c-45bc-4da6-b47a-b0a2b9d49efb tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:34.858562 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-3264778c-45bc-4da6-b47a-b0a2b9d49efb tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:34.859348 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-3264778c-45bc-4da6-b47a-b0a2b9d49efb tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:34.859781 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-3264778c-45bc-4da6-b47a-b0a2b9d49efb tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:34.891095 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-3264778c-45bc-4da6-b47a-b0a2b9d49efb tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045037 Nov 09 20:15:34.891658 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 499/974] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:15:34 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 20:15:34.894960 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-56982780-fdf3-4a20-af7c-a48674c1b6a3 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:15:34.903233 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-56982780-fdf3-4a20-af7c-a48674c1b6a3 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:15:34.904738 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-56982780-fdf3-4a20-af7c-a48674c1b6a3 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:15:34.905869 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-56982780-fdf3-4a20-af7c-a48674c1b6a3 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1747 microversion: 2.20 time: 0.156941 Nov 09 20:15:34.906412 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 476/975] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:15:34 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1747 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:15:35.902228 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-be47b44f-c739-491b-9534-ed487440adee tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:15:35.903880 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-be47b44f-c739-491b-9534-ed487440adee tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:15:35.910112 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-be47b44f-c739-491b-9534-ed487440adee tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:35.910551 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-be47b44f-c739-491b-9534-ed487440adee tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:35.911317 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-be47b44f-c739-491b-9534-ed487440adee tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:35.911741 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-be47b44f-c739-491b-9534-ed487440adee tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:35.923010 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-fe5c1986-5964-4dfd-8a93-b6b4f2d8683c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:15:35.923636 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-fe5c1986-5964-4dfd-8a93-b6b4f2d8683c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:15:35.929847 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fe5c1986-5964-4dfd-8a93-b6b4f2d8683c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:35.930290 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fe5c1986-5964-4dfd-8a93-b6b4f2d8683c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:35.931061 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fe5c1986-5964-4dfd-8a93-b6b4f2d8683c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:35.931491 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fe5c1986-5964-4dfd-8a93-b6b4f2d8683c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:35.940074 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-be47b44f-c739-491b-9534-ed487440adee tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041581 Nov 09 20:15:35.940665 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 500/976] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:15:35 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:15:36.058915 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-fe5c1986-5964-4dfd-8a93-b6b4f2d8683c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:15:36.066875 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-fe5c1986-5964-4dfd-8a93-b6b4f2d8683c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:15:36.068349 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-fe5c1986-5964-4dfd-8a93-b6b4f2d8683c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:15:36.069503 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-fe5c1986-5964-4dfd-8a93-b6b4f2d8683c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1747 microversion: 2.20 time: 0.150124 Nov 09 20:15:36.070061 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 477/977] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:15:35 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1747 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 09 20:15:36.952415 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-c4760940-15d3-4bd4-8a36-6b711c25b514 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:15:36.953304 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-c4760940-15d3-4bd4-8a36-6b711c25b514 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:15:36.959016 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c4760940-15d3-4bd4-8a36-6b711c25b514 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:36.959457 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c4760940-15d3-4bd4-8a36-6b711c25b514 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:36.960223 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c4760940-15d3-4bd4-8a36-6b711c25b514 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:36.960676 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c4760940-15d3-4bd4-8a36-6b711c25b514 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:36.988808 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-c4760940-15d3-4bd4-8a36-6b711c25b514 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041243 Nov 09 20:15:36.989360 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 501/978] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:15:36 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:15:37.087844 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-08e76526-bd0f-4670-b71d-ad982d54c1f4 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:15:37.089141 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-08e76526-bd0f-4670-b71d-ad982d54c1f4 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:15:37.095259 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-08e76526-bd0f-4670-b71d-ad982d54c1f4 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:37.095700 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-08e76526-bd0f-4670-b71d-ad982d54c1f4 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:37.096499 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-08e76526-bd0f-4670-b71d-ad982d54c1f4 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:37.096930 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-08e76526-bd0f-4670-b71d-ad982d54c1f4 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:37.226118 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-08e76526-bd0f-4670-b71d-ad982d54c1f4 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:15:37.234926 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-08e76526-bd0f-4670-b71d-ad982d54c1f4 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:15:37.236423 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-08e76526-bd0f-4670-b71d-ad982d54c1f4 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:15:37.237583 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-08e76526-bd0f-4670-b71d-ad982d54c1f4 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1747 microversion: 2.20 time: 0.153409 Nov 09 20:15:37.238157 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 478/979] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:15:37 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1747 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:15:38.001148 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-a3bfcae6-b284-4643-a5c5-22eb2f954f0d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:15:38.002056 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-a3bfcae6-b284-4643-a5c5-22eb2f954f0d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:15:38.008300 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a3bfcae6-b284-4643-a5c5-22eb2f954f0d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:38.008723 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a3bfcae6-b284-4643-a5c5-22eb2f954f0d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:38.009502 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a3bfcae6-b284-4643-a5c5-22eb2f954f0d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:38.010083 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a3bfcae6-b284-4643-a5c5-22eb2f954f0d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:38.037973 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-a3bfcae6-b284-4643-a5c5-22eb2f954f0d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040932 Nov 09 20:15:38.038520 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 502/980] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:15:37 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:15:38.256190 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-1190f9e8-d862-40f6-9fd2-88b7b1dfed49 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:15:38.256817 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-1190f9e8-d862-40f6-9fd2-88b7b1dfed49 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:15:38.263290 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1190f9e8-d862-40f6-9fd2-88b7b1dfed49 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:38.263668 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1190f9e8-d862-40f6-9fd2-88b7b1dfed49 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:38.264449 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1190f9e8-d862-40f6-9fd2-88b7b1dfed49 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:38.264876 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1190f9e8-d862-40f6-9fd2-88b7b1dfed49 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:38.394928 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-1190f9e8-d862-40f6-9fd2-88b7b1dfed49 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:15:38.403473 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-1190f9e8-d862-40f6-9fd2-88b7b1dfed49 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:15:38.404984 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-1190f9e8-d862-40f6-9fd2-88b7b1dfed49 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:15:38.406104 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-1190f9e8-d862-40f6-9fd2-88b7b1dfed49 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1747 microversion: 2.20 time: 0.153586 Nov 09 20:15:38.406649 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 479/981] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:15:38 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1747 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:15:39.049196 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-2cec2d30-dd33-4c27-a4f3-8702fae87b49 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:15:39.050098 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-2cec2d30-dd33-4c27-a4f3-8702fae87b49 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:15:39.056190 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-2cec2d30-dd33-4c27-a4f3-8702fae87b49 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:39.056712 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-2cec2d30-dd33-4c27-a4f3-8702fae87b49 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:39.057515 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-2cec2d30-dd33-4c27-a4f3-8702fae87b49 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:39.057940 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-2cec2d30-dd33-4c27-a4f3-8702fae87b49 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:39.086247 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-2cec2d30-dd33-4c27-a4f3-8702fae87b49 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040771 Nov 09 20:15:39.086781 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 503/982] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:15:39 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:15:39.424762 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-2daf815c-11e3-4e3f-ac4a-ffb210bccad5 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:15:39.425361 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-2daf815c-11e3-4e3f-ac4a-ffb210bccad5 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:15:39.431538 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2daf815c-11e3-4e3f-ac4a-ffb210bccad5 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:39.432625 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2daf815c-11e3-4e3f-ac4a-ffb210bccad5 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:39.433390 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2daf815c-11e3-4e3f-ac4a-ffb210bccad5 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:39.433819 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2daf815c-11e3-4e3f-ac4a-ffb210bccad5 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:39.563151 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-2daf815c-11e3-4e3f-ac4a-ffb210bccad5 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:15:39.572067 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-2daf815c-11e3-4e3f-ac4a-ffb210bccad5 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:15:39.573604 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-2daf815c-11e3-4e3f-ac4a-ffb210bccad5 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:15:39.574752 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-2daf815c-11e3-4e3f-ac4a-ffb210bccad5 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1747 microversion: 2.20 time: 0.153658 Nov 09 20:15:39.575305 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 480/983] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:15:39 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1747 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:15:40.097977 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-de3b707a-cf24-4f1c-906a-2bcc5bc03132 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:15:40.098886 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-de3b707a-cf24-4f1c-906a-2bcc5bc03132 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:15:40.106240 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-de3b707a-cf24-4f1c-906a-2bcc5bc03132 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:40.106942 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-de3b707a-cf24-4f1c-906a-2bcc5bc03132 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:40.107715 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-de3b707a-cf24-4f1c-906a-2bcc5bc03132 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:40.108143 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-de3b707a-cf24-4f1c-906a-2bcc5bc03132 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:40.135704 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-de3b707a-cf24-4f1c-906a-2bcc5bc03132 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041444 Nov 09 20:15:40.136250 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 504/984] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:15:40 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:15:40.593396 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-e77d3041-91dd-4d52-b05e-8a25a59ccb08 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:15:40.594123 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-e77d3041-91dd-4d52-b05e-8a25a59ccb08 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:15:40.600357 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e77d3041-91dd-4d52-b05e-8a25a59ccb08 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:40.600842 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e77d3041-91dd-4d52-b05e-8a25a59ccb08 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:40.601676 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e77d3041-91dd-4d52-b05e-8a25a59ccb08 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:40.602022 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e77d3041-91dd-4d52-b05e-8a25a59ccb08 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:40.739036 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-e77d3041-91dd-4d52-b05e-8a25a59ccb08 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:15:40.748164 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-e77d3041-91dd-4d52-b05e-8a25a59ccb08 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:15:40.749675 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-e77d3041-91dd-4d52-b05e-8a25a59ccb08 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:15:40.750810 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-e77d3041-91dd-4d52-b05e-8a25a59ccb08 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1747 microversion: 2.20 time: 0.161079 Nov 09 20:15:40.751361 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 481/985] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:15:40 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1747 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:15:41.146916 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-212a94d9-84dc-4baf-a00f-69df643e5f87 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:15:41.147819 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-212a94d9-84dc-4baf-a00f-69df643e5f87 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:15:41.154542 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-212a94d9-84dc-4baf-a00f-69df643e5f87 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:41.154986 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-212a94d9-84dc-4baf-a00f-69df643e5f87 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:41.155760 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-212a94d9-84dc-4baf-a00f-69df643e5f87 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:41.156188 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-212a94d9-84dc-4baf-a00f-69df643e5f87 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:41.186142 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-212a94d9-84dc-4baf-a00f-69df643e5f87 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042929 Nov 09 20:15:41.186696 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 505/986] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:15:41 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:15:41.769369 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-6ee3675e-ddd2-4d7d-aad6-0c7377a5a7b6 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:15:41.770074 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-6ee3675e-ddd2-4d7d-aad6-0c7377a5a7b6 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:15:41.777321 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6ee3675e-ddd2-4d7d-aad6-0c7377a5a7b6 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:41.777849 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6ee3675e-ddd2-4d7d-aad6-0c7377a5a7b6 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:41.778703 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6ee3675e-ddd2-4d7d-aad6-0c7377a5a7b6 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:41.779146 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6ee3675e-ddd2-4d7d-aad6-0c7377a5a7b6 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:41.936376 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-fa1e79ad-eadd-4ccd-b64f-e74724e5f03c tempest-TestShelveInstance-1171628010 tempest-TestShelveInstance-1171628010-project] Calling method '.version_select at 0x7fab36d4f4c0>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:15:41.950440 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-6ee3675e-ddd2-4d7d-aad6-0c7377a5a7b6 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:15:41.960555 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-fa1e79ad-eadd-4ccd-b64f-e74724e5f03c tempest-TestShelveInstance-1171628010 tempest-TestShelveInstance-1171628010-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1405938832" status: 202 len: 0 microversion: 2.1 time: 0.028084 Nov 09 20:15:41.961450 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 506/987] 10.222.0.25 () {58 vars in 1253 bytes} [Tue Nov 9 20:15:41 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1405938832 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 09 20:15:41.966939 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-6ee3675e-ddd2-4d7d-aad6-0c7377a5a7b6 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:15:41.966939 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-6ee3675e-ddd2-4d7d-aad6-0c7377a5a7b6 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:15:41.967448 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-6ee3675e-ddd2-4d7d-aad6-0c7377a5a7b6 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1747 microversion: 2.20 time: 0.201566 Nov 09 20:15:41.968709 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 482/988] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:15:41 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1747 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:15:42.198151 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-f2133eaf-bcee-47d8-8cb1-55f0e13d54f4 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:15:42.199063 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-f2133eaf-bcee-47d8-8cb1-55f0e13d54f4 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:15:42.205987 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f2133eaf-bcee-47d8-8cb1-55f0e13d54f4 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:42.206432 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f2133eaf-bcee-47d8-8cb1-55f0e13d54f4 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:42.207208 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f2133eaf-bcee-47d8-8cb1-55f0e13d54f4 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:42.207633 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f2133eaf-bcee-47d8-8cb1-55f0e13d54f4 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:42.237792 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-f2133eaf-bcee-47d8-8cb1-55f0e13d54f4 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044117 Nov 09 20:15:42.238372 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 507/989] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:15:42 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:15:42.986428 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-82cb0afa-5cd8-4aa6-ab87-9f05fc0b1eba tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:15:42.987025 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-82cb0afa-5cd8-4aa6-ab87-9f05fc0b1eba tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:15:42.993360 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-82cb0afa-5cd8-4aa6-ab87-9f05fc0b1eba tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:42.993806 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-82cb0afa-5cd8-4aa6-ab87-9f05fc0b1eba tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:42.995133 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-82cb0afa-5cd8-4aa6-ab87-9f05fc0b1eba tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:42.995843 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-82cb0afa-5cd8-4aa6-ab87-9f05fc0b1eba tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:43.249750 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-189cdc49-579f-451f-a99f-7617982a2732 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:15:43.250795 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-189cdc49-579f-451f-a99f-7617982a2732 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:15:43.259537 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-189cdc49-579f-451f-a99f-7617982a2732 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:43.259537 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-189cdc49-579f-451f-a99f-7617982a2732 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:43.259749 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-82cb0afa-5cd8-4aa6-ab87-9f05fc0b1eba tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:15:43.259855 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-189cdc49-579f-451f-a99f-7617982a2732 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:43.259855 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-189cdc49-579f-451f-a99f-7617982a2732 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:43.268771 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-82cb0afa-5cd8-4aa6-ab87-9f05fc0b1eba tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:15:43.270228 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-82cb0afa-5cd8-4aa6-ab87-9f05fc0b1eba tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:15:43.271486 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-82cb0afa-5cd8-4aa6-ab87-9f05fc0b1eba tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1747 microversion: 2.20 time: 0.288890 Nov 09 20:15:43.272309 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 483/990] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:15:42 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1747 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:15:43.288719 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-189cdc49-579f-451f-a99f-7617982a2732 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042602 Nov 09 20:15:43.289369 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 508/991] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:15:43 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:15:44.290298 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-c27a4283-b596-4caf-b5f8-b887d3719166 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:15:44.290911 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-c27a4283-b596-4caf-b5f8-b887d3719166 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:15:44.297558 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c27a4283-b596-4caf-b5f8-b887d3719166 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:44.298219 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c27a4283-b596-4caf-b5f8-b887d3719166 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:44.299179 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c27a4283-b596-4caf-b5f8-b887d3719166 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:44.299766 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c27a4283-b596-4caf-b5f8-b887d3719166 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:44.300907 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-12d2574b-88dd-442f-9e27-8f16866ab455 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:15:44.302043 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-12d2574b-88dd-442f-9e27-8f16866ab455 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:15:44.309030 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-12d2574b-88dd-442f-9e27-8f16866ab455 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:44.309982 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-12d2574b-88dd-442f-9e27-8f16866ab455 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:44.310889 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-12d2574b-88dd-442f-9e27-8f16866ab455 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:44.311430 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-12d2574b-88dd-442f-9e27-8f16866ab455 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:44.345007 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-12d2574b-88dd-442f-9e27-8f16866ab455 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048844 Nov 09 20:15:44.348896 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 509/992] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:15:44 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:15:44.507511 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-c27a4283-b596-4caf-b5f8-b887d3719166 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:15:44.516352 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-c27a4283-b596-4caf-b5f8-b887d3719166 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:15:44.517846 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-c27a4283-b596-4caf-b5f8-b887d3719166 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:15:44.519009 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-c27a4283-b596-4caf-b5f8-b887d3719166 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1747 microversion: 2.20 time: 0.232331 Nov 09 20:15:44.519569 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 484/993] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:15:44 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1747 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:15:45.357604 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-f73a5693-ee83-47cb-8a75-8ebc7dd4813a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:15:45.359153 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-f73a5693-ee83-47cb-8a75-8ebc7dd4813a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:15:45.365426 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f73a5693-ee83-47cb-8a75-8ebc7dd4813a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:45.365874 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f73a5693-ee83-47cb-8a75-8ebc7dd4813a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:45.366664 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f73a5693-ee83-47cb-8a75-8ebc7dd4813a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:45.367098 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f73a5693-ee83-47cb-8a75-8ebc7dd4813a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:45.401707 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-f73a5693-ee83-47cb-8a75-8ebc7dd4813a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048976 Nov 09 20:15:45.405728 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 510/994] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:15:45 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:15:45.537539 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-6bd1135e-1216-46fe-9829-b0af13ef3344 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:15:45.538847 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-6bd1135e-1216-46fe-9829-b0af13ef3344 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:15:45.545936 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6bd1135e-1216-46fe-9829-b0af13ef3344 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:45.546526 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6bd1135e-1216-46fe-9829-b0af13ef3344 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:45.547608 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6bd1135e-1216-46fe-9829-b0af13ef3344 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:45.548135 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6bd1135e-1216-46fe-9829-b0af13ef3344 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:45.698299 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-6bd1135e-1216-46fe-9829-b0af13ef3344 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:15:45.713654 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-6bd1135e-1216-46fe-9829-b0af13ef3344 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:15:45.715152 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-6bd1135e-1216-46fe-9829-b0af13ef3344 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:15:45.716303 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-6bd1135e-1216-46fe-9829-b0af13ef3344 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1747 microversion: 2.20 time: 0.182841 Nov 09 20:15:45.717074 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 485/995] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:15:45 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1747 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:15:46.413013 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-b5f3d614-704d-4059-94da-5dd636693b4b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:15:46.413914 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-b5f3d614-704d-4059-94da-5dd636693b4b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:15:46.419981 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b5f3d614-704d-4059-94da-5dd636693b4b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:46.420446 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b5f3d614-704d-4059-94da-5dd636693b4b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:46.421237 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b5f3d614-704d-4059-94da-5dd636693b4b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:46.421663 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b5f3d614-704d-4059-94da-5dd636693b4b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:46.450440 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-b5f3d614-704d-4059-94da-5dd636693b4b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041201 Nov 09 20:15:46.451002 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 511/996] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:15:46 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:15:46.735424 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-278394a9-ac19-4813-9f23-965c1686e909 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:15:46.736135 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-278394a9-ac19-4813-9f23-965c1686e909 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:15:46.742611 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-278394a9-ac19-4813-9f23-965c1686e909 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:46.743058 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-278394a9-ac19-4813-9f23-965c1686e909 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:46.743837 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-278394a9-ac19-4813-9f23-965c1686e909 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:46.744904 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-278394a9-ac19-4813-9f23-965c1686e909 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:47.029674 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-278394a9-ac19-4813-9f23-965c1686e909 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:15:47.037811 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-278394a9-ac19-4813-9f23-965c1686e909 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:15:47.039388 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-278394a9-ac19-4813-9f23-965c1686e909 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:15:47.040634 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-278394a9-ac19-4813-9f23-965c1686e909 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1747 microversion: 2.20 time: 0.309159 Nov 09 20:15:47.041936 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 486/997] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:15:46 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1747 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:15:47.462149 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-5cc7c673-57ab-4487-8fbb-a2d6496e0a2a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:15:47.463282 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-5cc7c673-57ab-4487-8fbb-a2d6496e0a2a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:15:47.470127 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-5cc7c673-57ab-4487-8fbb-a2d6496e0a2a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:47.470571 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-5cc7c673-57ab-4487-8fbb-a2d6496e0a2a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:47.471338 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-5cc7c673-57ab-4487-8fbb-a2d6496e0a2a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:47.471765 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-5cc7c673-57ab-4487-8fbb-a2d6496e0a2a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:47.503345 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-5cc7c673-57ab-4487-8fbb-a2d6496e0a2a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044844 Nov 09 20:15:47.503922 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 512/998] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:15:47 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:15:48.061167 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-45406ba3-18a2-4f5e-89ed-c364b7da8ad9 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:15:48.066229 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-45406ba3-18a2-4f5e-89ed-c364b7da8ad9 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:15:48.075301 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-45406ba3-18a2-4f5e-89ed-c364b7da8ad9 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:48.075750 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-45406ba3-18a2-4f5e-89ed-c364b7da8ad9 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:48.077379 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-45406ba3-18a2-4f5e-89ed-c364b7da8ad9 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:48.078183 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-45406ba3-18a2-4f5e-89ed-c364b7da8ad9 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:48.388917 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-45406ba3-18a2-4f5e-89ed-c364b7da8ad9 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:15:48.397368 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-45406ba3-18a2-4f5e-89ed-c364b7da8ad9 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:15:48.398976 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-45406ba3-18a2-4f5e-89ed-c364b7da8ad9 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:15:48.400132 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-45406ba3-18a2-4f5e-89ed-c364b7da8ad9 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1747 microversion: 2.20 time: 0.344966 Nov 09 20:15:48.400779 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 487/999] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:15:48 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1747 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:15:48.515185 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-60481e3a-f89c-4ffe-bf58-ce8ae1b1b485 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:15:48.516089 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-60481e3a-f89c-4ffe-bf58-ce8ae1b1b485 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:15:48.523419 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-60481e3a-f89c-4ffe-bf58-ce8ae1b1b485 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:48.523781 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-60481e3a-f89c-4ffe-bf58-ce8ae1b1b485 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:48.524594 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-60481e3a-f89c-4ffe-bf58-ce8ae1b1b485 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:48.525308 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-60481e3a-f89c-4ffe-bf58-ce8ae1b1b485 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:48.558321 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-60481e3a-f89c-4ffe-bf58-ce8ae1b1b485 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046774 Nov 09 20:15:48.558892 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 513/1000] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:15:48 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:15:49.419087 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-852eaf44-ea69-4d22-8485-68af49c5425c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:15:49.419699 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-852eaf44-ea69-4d22-8485-68af49c5425c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:15:49.426176 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-852eaf44-ea69-4d22-8485-68af49c5425c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:49.426637 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-852eaf44-ea69-4d22-8485-68af49c5425c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:49.427441 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-852eaf44-ea69-4d22-8485-68af49c5425c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:49.427874 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-852eaf44-ea69-4d22-8485-68af49c5425c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:49.568598 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-926c263c-ccc5-48df-8632-3bf26a57ce36 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:15:49.569525 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-926c263c-ccc5-48df-8632-3bf26a57ce36 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:15:49.576106 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-926c263c-ccc5-48df-8632-3bf26a57ce36 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:49.576595 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-926c263c-ccc5-48df-8632-3bf26a57ce36 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:49.577369 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-926c263c-ccc5-48df-8632-3bf26a57ce36 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:49.577827 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-926c263c-ccc5-48df-8632-3bf26a57ce36 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:49.607345 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-926c263c-ccc5-48df-8632-3bf26a57ce36 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042220 Nov 09 20:15:49.607903 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 514/1001] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:15:49 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 20:15:49.638685 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-852eaf44-ea69-4d22-8485-68af49c5425c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:15:49.646757 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-852eaf44-ea69-4d22-8485-68af49c5425c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:15:49.648238 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-852eaf44-ea69-4d22-8485-68af49c5425c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:15:49.649477 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-852eaf44-ea69-4d22-8485-68af49c5425c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1747 microversion: 2.20 time: 0.234777 Nov 09 20:15:49.650042 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 488/1002] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:15:49 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1747 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 09 20:15:50.618696 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-b6a5bd1d-a02d-4c51-8559-4bf2a189206b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:15:50.619793 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-b6a5bd1d-a02d-4c51-8559-4bf2a189206b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:15:50.626112 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b6a5bd1d-a02d-4c51-8559-4bf2a189206b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:50.626563 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b6a5bd1d-a02d-4c51-8559-4bf2a189206b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:50.627333 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b6a5bd1d-a02d-4c51-8559-4bf2a189206b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:50.627763 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b6a5bd1d-a02d-4c51-8559-4bf2a189206b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:50.656363 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-b6a5bd1d-a02d-4c51-8559-4bf2a189206b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041347 Nov 09 20:15:50.656942 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 515/1003] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:15:50 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:15:50.669080 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-38ce6a35-a347-472d-9001-16addcebf576 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:15:50.669681 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-38ce6a35-a347-472d-9001-16addcebf576 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:15:50.676050 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-38ce6a35-a347-472d-9001-16addcebf576 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:50.676532 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-38ce6a35-a347-472d-9001-16addcebf576 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:50.677311 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-38ce6a35-a347-472d-9001-16addcebf576 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:50.677743 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-38ce6a35-a347-472d-9001-16addcebf576 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:50.810026 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-38ce6a35-a347-472d-9001-16addcebf576 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:15:50.818516 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-38ce6a35-a347-472d-9001-16addcebf576 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:15:50.820046 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-38ce6a35-a347-472d-9001-16addcebf576 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:15:50.821217 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-38ce6a35-a347-472d-9001-16addcebf576 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1747 microversion: 2.20 time: 0.156786 Nov 09 20:15:50.821771 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 489/1004] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:15:50 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1747 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:15:51.667425 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-77ad429a-5f15-44e0-90ae-c5cd7ad7015c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:15:51.668326 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-77ad429a-5f15-44e0-90ae-c5cd7ad7015c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:15:51.674457 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-77ad429a-5f15-44e0-90ae-c5cd7ad7015c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:51.674900 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-77ad429a-5f15-44e0-90ae-c5cd7ad7015c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:51.675661 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-77ad429a-5f15-44e0-90ae-c5cd7ad7015c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:51.676090 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-77ad429a-5f15-44e0-90ae-c5cd7ad7015c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:51.706451 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-77ad429a-5f15-44e0-90ae-c5cd7ad7015c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042773 Nov 09 20:15:51.707005 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 516/1005] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:15:51 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:15:51.839940 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-f4c62106-ec9f-427b-a674-2b38667b12d6 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:15:51.840557 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-f4c62106-ec9f-427b-a674-2b38667b12d6 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:15:51.846715 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f4c62106-ec9f-427b-a674-2b38667b12d6 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:51.847154 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f4c62106-ec9f-427b-a674-2b38667b12d6 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:51.847920 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f4c62106-ec9f-427b-a674-2b38667b12d6 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:51.848341 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f4c62106-ec9f-427b-a674-2b38667b12d6 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:51.976676 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-f4c62106-ec9f-427b-a674-2b38667b12d6 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:15:51.985011 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-f4c62106-ec9f-427b-a674-2b38667b12d6 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:15:51.986476 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-f4c62106-ec9f-427b-a674-2b38667b12d6 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:15:51.987597 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-f4c62106-ec9f-427b-a674-2b38667b12d6 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1747 microversion: 2.20 time: 0.151996 Nov 09 20:15:51.988144 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 490/1006] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:15:51 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1747 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:15:52.717867 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-b9d81c58-d484-4de0-8d9e-d892162bb897 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:15:52.718786 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-b9d81c58-d484-4de0-8d9e-d892162bb897 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:15:52.725006 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b9d81c58-d484-4de0-8d9e-d892162bb897 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:52.725451 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b9d81c58-d484-4de0-8d9e-d892162bb897 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:52.726217 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b9d81c58-d484-4de0-8d9e-d892162bb897 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:52.726647 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b9d81c58-d484-4de0-8d9e-d892162bb897 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:52.754790 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-b9d81c58-d484-4de0-8d9e-d892162bb897 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040657 Nov 09 20:15:52.755329 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 517/1007] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:15:52 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:15:53.006334 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-319cdb3c-65b9-44cf-8fbc-4956a74e62f8 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:15:53.007054 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-319cdb3c-65b9-44cf-8fbc-4956a74e62f8 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:15:53.013248 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-319cdb3c-65b9-44cf-8fbc-4956a74e62f8 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:53.013691 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-319cdb3c-65b9-44cf-8fbc-4956a74e62f8 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:53.014450 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-319cdb3c-65b9-44cf-8fbc-4956a74e62f8 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:53.014874 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-319cdb3c-65b9-44cf-8fbc-4956a74e62f8 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:53.158805 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-319cdb3c-65b9-44cf-8fbc-4956a74e62f8 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:15:53.168963 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-319cdb3c-65b9-44cf-8fbc-4956a74e62f8 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:15:53.170316 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-319cdb3c-65b9-44cf-8fbc-4956a74e62f8 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:15:53.171637 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-319cdb3c-65b9-44cf-8fbc-4956a74e62f8 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1747 microversion: 2.20 time: 0.168796 Nov 09 20:15:53.172039 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 491/1008] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:15:53 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1747 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:15:53.766677 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-a024bf1d-2fa0-48c4-b3b2-240dd216f9ff tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:15:53.767621 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-a024bf1d-2fa0-48c4-b3b2-240dd216f9ff tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:15:53.773766 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a024bf1d-2fa0-48c4-b3b2-240dd216f9ff tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:53.774206 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a024bf1d-2fa0-48c4-b3b2-240dd216f9ff tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:53.774969 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a024bf1d-2fa0-48c4-b3b2-240dd216f9ff tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:53.776328 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a024bf1d-2fa0-48c4-b3b2-240dd216f9ff tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:53.804685 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-a024bf1d-2fa0-48c4-b3b2-240dd216f9ff tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041685 Nov 09 20:15:53.805229 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 518/1009] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:15:53 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 20:15:54.191125 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-61041f78-8bd4-4ef0-b292-02383a17738a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:15:54.191812 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-61041f78-8bd4-4ef0-b292-02383a17738a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:15:54.198772 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-61041f78-8bd4-4ef0-b292-02383a17738a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:54.199211 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-61041f78-8bd4-4ef0-b292-02383a17738a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:54.199970 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-61041f78-8bd4-4ef0-b292-02383a17738a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:54.200476 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-61041f78-8bd4-4ef0-b292-02383a17738a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:54.333829 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-61041f78-8bd4-4ef0-b292-02383a17738a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:15:54.342620 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-61041f78-8bd4-4ef0-b292-02383a17738a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:15:54.344140 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-61041f78-8bd4-4ef0-b292-02383a17738a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:15:54.345365 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-61041f78-8bd4-4ef0-b292-02383a17738a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1747 microversion: 2.20 time: 0.158228 Nov 09 20:15:54.345912 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 492/1010] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:15:54 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1747 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:15:54.816239 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-e3f44f17-df63-410c-8c47-5ed91e291383 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:15:54.817174 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-e3f44f17-df63-410c-8c47-5ed91e291383 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:15:54.823530 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e3f44f17-df63-410c-8c47-5ed91e291383 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:54.823972 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e3f44f17-df63-410c-8c47-5ed91e291383 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:54.824781 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e3f44f17-df63-410c-8c47-5ed91e291383 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:54.825210 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e3f44f17-df63-410c-8c47-5ed91e291383 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:54.853177 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-e3f44f17-df63-410c-8c47-5ed91e291383 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040733 Nov 09 20:15:54.854427 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 519/1011] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:15:54 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:15:55.362887 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-90b3e6a4-a773-4dc5-95c6-b0bf3e47e4ba tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:15:55.363483 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-90b3e6a4-a773-4dc5-95c6-b0bf3e47e4ba tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:15:55.370232 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-90b3e6a4-a773-4dc5-95c6-b0bf3e47e4ba tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:55.370573 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-90b3e6a4-a773-4dc5-95c6-b0bf3e47e4ba tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:55.371353 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-90b3e6a4-a773-4dc5-95c6-b0bf3e47e4ba tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:55.371786 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-90b3e6a4-a773-4dc5-95c6-b0bf3e47e4ba tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:55.381823 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-7378db38-48c5-4a60-b406-6dace90c153c tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:15:55.382319 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-7378db38-48c5-4a60-b406-6dace90c153c tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:15:55.389007 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-7378db38-48c5-4a60-b406-6dace90c153c tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:55.389292 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-7378db38-48c5-4a60-b406-6dace90c153c tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:55.390080 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-7378db38-48c5-4a60-b406-6dace90c153c tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:55.390515 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-7378db38-48c5-4a60-b406-6dace90c153c tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:55.504656 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-90b3e6a4-a773-4dc5-95c6-b0bf3e47e4ba tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:15:55.513529 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-90b3e6a4-a773-4dc5-95c6-b0bf3e47e4ba tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:15:55.514960 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-90b3e6a4-a773-4dc5-95c6-b0bf3e47e4ba tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:15:55.516109 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-90b3e6a4-a773-4dc5-95c6-b0bf3e47e4ba tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1747 microversion: 2.20 time: 0.156894 Nov 09 20:15:55.516696 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 493/1012] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:15:55 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1747 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:15:55.691534 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.objects.instance [None req-7378db38-48c5-4a60-b406-6dace90c153c tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lazy-loading 'services' on Instance uuid 75e5847b-18ff-4332-be8a-f77ffae72997 {{(pid=116102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 09 20:15:55.799960 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-7378db38-48c5-4a60-b406-6dace90c153c tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "DELETE /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997/os-volume_attachments/81c8d2da-f7bf-443f-ba0a-b88dc5a6147e" status: 202 len: 0 microversion: 2.1 time: 0.421690 Nov 09 20:15:55.800639 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 520/1013] 10.222.0.25 () {58 vars in 1415 bytes} [Tue Nov 9 20:15:55 2021] DELETE /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997/os-volume_attachments/81c8d2da-f7bf-443f-ba0a-b88dc5a6147e => generated 0 bytes in 423 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 09 20:15:55.866840 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-1dd3e705-b288-4faf-aa85-bc16dec9e6d1 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:15:55.868481 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-1dd3e705-b288-4faf-aa85-bc16dec9e6d1 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:15:55.876148 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1dd3e705-b288-4faf-aa85-bc16dec9e6d1 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:55.876924 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1dd3e705-b288-4faf-aa85-bc16dec9e6d1 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:55.877722 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1dd3e705-b288-4faf-aa85-bc16dec9e6d1 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:55.878157 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1dd3e705-b288-4faf-aa85-bc16dec9e6d1 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:55.916540 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-1dd3e705-b288-4faf-aa85-bc16dec9e6d1 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054180 Nov 09 20:15:55.917122 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 494/1014] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:15:55 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:15:56.538482 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-23da1d94-da6c-4cc0-a0ee-000873bc7488 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:15:56.539202 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-23da1d94-da6c-4cc0-a0ee-000873bc7488 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:15:56.546248 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-23da1d94-da6c-4cc0-a0ee-000873bc7488 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:56.546844 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-23da1d94-da6c-4cc0-a0ee-000873bc7488 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:56.547478 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-23da1d94-da6c-4cc0-a0ee-000873bc7488 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:56.547911 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-23da1d94-da6c-4cc0-a0ee-000873bc7488 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:56.680907 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-23da1d94-da6c-4cc0-a0ee-000873bc7488 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:15:56.689968 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-23da1d94-da6c-4cc0-a0ee-000873bc7488 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:15:56.691633 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-23da1d94-da6c-4cc0-a0ee-000873bc7488 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:15:56.692915 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-23da1d94-da6c-4cc0-a0ee-000873bc7488 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1747 microversion: 2.20 time: 0.161303 Nov 09 20:15:56.693558 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 521/1015] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:15:56 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1747 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:15:56.927042 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-b02c3900-0985-41aa-9744-e6f8b1d7bcf1 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:15:56.927949 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-b02c3900-0985-41aa-9744-e6f8b1d7bcf1 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:15:56.934338 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b02c3900-0985-41aa-9744-e6f8b1d7bcf1 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:56.934783 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b02c3900-0985-41aa-9744-e6f8b1d7bcf1 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:56.935559 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b02c3900-0985-41aa-9744-e6f8b1d7bcf1 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:56.935987 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b02c3900-0985-41aa-9744-e6f8b1d7bcf1 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:56.967049 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-b02c3900-0985-41aa-9744-e6f8b1d7bcf1 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043702 Nov 09 20:15:56.967649 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 495/1016] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:15:56 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:15:57.711003 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-1b74f0e7-3bf2-4264-87f6-d450a8eafee0 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:15:57.711615 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-1b74f0e7-3bf2-4264-87f6-d450a8eafee0 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:15:57.717995 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-1b74f0e7-3bf2-4264-87f6-d450a8eafee0 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:57.718437 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-1b74f0e7-3bf2-4264-87f6-d450a8eafee0 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:57.719203 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-1b74f0e7-3bf2-4264-87f6-d450a8eafee0 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:57.719654 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-1b74f0e7-3bf2-4264-87f6-d450a8eafee0 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:57.863637 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-1b74f0e7-3bf2-4264-87f6-d450a8eafee0 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:15:57.879017 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-1b74f0e7-3bf2-4264-87f6-d450a8eafee0 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:15:57.881610 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-1b74f0e7-3bf2-4264-87f6-d450a8eafee0 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:15:57.883859 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-1b74f0e7-3bf2-4264-87f6-d450a8eafee0 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1747 microversion: 2.20 time: 0.175781 Nov 09 20:15:57.885088 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 522/1017] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:15:57 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1747 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:15:57.979097 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-4cf40b31-65aa-4dda-b4e3-0550a22a868a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:15:57.980020 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-4cf40b31-65aa-4dda-b4e3-0550a22a868a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:15:57.986526 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4cf40b31-65aa-4dda-b4e3-0550a22a868a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:57.986963 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4cf40b31-65aa-4dda-b4e3-0550a22a868a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:57.987939 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4cf40b31-65aa-4dda-b4e3-0550a22a868a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:57.988368 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4cf40b31-65aa-4dda-b4e3-0550a22a868a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:58.022674 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-4cf40b31-65aa-4dda-b4e3-0550a22a868a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047222 Nov 09 20:15:58.026952 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 496/1018] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:15:57 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:15:58.904942 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-f1e54d31-c963-4da1-9c26-24e8f67b3e1d tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:15:58.905542 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-f1e54d31-c963-4da1-9c26-24e8f67b3e1d tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:15:58.913854 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f1e54d31-c963-4da1-9c26-24e8f67b3e1d tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:58.914527 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f1e54d31-c963-4da1-9c26-24e8f67b3e1d tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:58.915537 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f1e54d31-c963-4da1-9c26-24e8f67b3e1d tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:58.916725 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f1e54d31-c963-4da1-9c26-24e8f67b3e1d tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:59.035273 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-4b0b34e9-1f11-47cd-a92c-25dfeb9bf136 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:15:59.035728 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-4b0b34e9-1f11-47cd-a92c-25dfeb9bf136 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:15:59.037539 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 09 20:15:59.037686 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: Tue Nov 9 20:15:59 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e (ip 10.222.0.25) !!! Nov 09 20:15:59.058915 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4b0b34e9-1f11-47cd-a92c-25dfeb9bf136 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:59.059339 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4b0b34e9-1f11-47cd-a92c-25dfeb9bf136 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:59.060292 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4b0b34e9-1f11-47cd-a92c-25dfeb9bf136 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:15:59.060989 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4b0b34e9-1f11-47cd-a92c-25dfeb9bf136 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:15:59.100170 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-4b0b34e9-1f11-47cd-a92c-25dfeb9bf136 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069155 Nov 09 20:15:59.101678 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 497/1019] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:15:59 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 20:15:59.159196 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-f1e54d31-c963-4da1-9c26-24e8f67b3e1d tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:15:59.168699 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-f1e54d31-c963-4da1-9c26-24e8f67b3e1d tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:15:59.171393 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-f1e54d31-c963-4da1-9c26-24e8f67b3e1d tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:15:59.173059 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-f1e54d31-c963-4da1-9c26-24e8f67b3e1d tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1747 microversion: 2.20 time: 0.274501 Nov 09 20:15:59.174407 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 523/1020] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:15:58 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1747 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:16:00.112279 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-77bffd80-dc15-4e65-ad2f-229e76860282 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:16:00.114191 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-77bffd80-dc15-4e65-ad2f-229e76860282 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:16:00.122075 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-77bffd80-dc15-4e65-ad2f-229e76860282 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:00.122532 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-77bffd80-dc15-4e65-ad2f-229e76860282 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:00.123330 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-77bffd80-dc15-4e65-ad2f-229e76860282 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:00.123763 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-77bffd80-dc15-4e65-ad2f-229e76860282 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:00.173187 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-77bffd80-dc15-4e65-ad2f-229e76860282 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064649 Nov 09 20:16:00.174267 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 498/1021] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:16:00 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:16:00.192962 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-64deac4b-6502-48a0-98ce-455d9942e7b5 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:16:00.193568 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-64deac4b-6502-48a0-98ce-455d9942e7b5 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:16:00.202458 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-64deac4b-6502-48a0-98ce-455d9942e7b5 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:00.203380 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-64deac4b-6502-48a0-98ce-455d9942e7b5 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:00.204301 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-64deac4b-6502-48a0-98ce-455d9942e7b5 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:00.204885 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-64deac4b-6502-48a0-98ce-455d9942e7b5 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:00.364964 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-64deac4b-6502-48a0-98ce-455d9942e7b5 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:16:00.374379 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-64deac4b-6502-48a0-98ce-455d9942e7b5 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:16:00.375874 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-64deac4b-6502-48a0-98ce-455d9942e7b5 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:16:00.377691 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-64deac4b-6502-48a0-98ce-455d9942e7b5 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1747 microversion: 2.20 time: 0.188445 Nov 09 20:16:00.378283 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 524/1022] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:16:00 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1747 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:16:01.186257 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-c49a74a8-1a5b-4711-a6cd-65b9c07fc3ef tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:16:01.187695 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-c49a74a8-1a5b-4711-a6cd-65b9c07fc3ef tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:16:01.194407 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c49a74a8-1a5b-4711-a6cd-65b9c07fc3ef tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:01.195081 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c49a74a8-1a5b-4711-a6cd-65b9c07fc3ef tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:01.195922 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c49a74a8-1a5b-4711-a6cd-65b9c07fc3ef tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:01.196501 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c49a74a8-1a5b-4711-a6cd-65b9c07fc3ef tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:01.225512 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-c49a74a8-1a5b-4711-a6cd-65b9c07fc3ef tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044943 Nov 09 20:16:01.226155 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 499/1023] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:16:01 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:16:01.397695 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-71fedd24-5495-46f6-bca0-db4de95b0984 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:16:01.398980 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-71fedd24-5495-46f6-bca0-db4de95b0984 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:16:01.406108 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-71fedd24-5495-46f6-bca0-db4de95b0984 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:01.406870 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-71fedd24-5495-46f6-bca0-db4de95b0984 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:01.408016 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-71fedd24-5495-46f6-bca0-db4de95b0984 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:01.408764 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-71fedd24-5495-46f6-bca0-db4de95b0984 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:01.565003 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-71fedd24-5495-46f6-bca0-db4de95b0984 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:16:01.574363 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-71fedd24-5495-46f6-bca0-db4de95b0984 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:16:01.575949 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-71fedd24-5495-46f6-bca0-db4de95b0984 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:16:01.577079 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-71fedd24-5495-46f6-bca0-db4de95b0984 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1747 microversion: 2.20 time: 0.183812 Nov 09 20:16:01.577626 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 525/1024] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:16:01 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1747 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 09 20:16:02.237673 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-0ebe5709-6e25-482b-aea0-2208a384d984 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:16:02.239249 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-0ebe5709-6e25-482b-aea0-2208a384d984 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:16:02.245586 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0ebe5709-6e25-482b-aea0-2208a384d984 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:02.246234 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0ebe5709-6e25-482b-aea0-2208a384d984 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:02.247218 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0ebe5709-6e25-482b-aea0-2208a384d984 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:02.247847 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0ebe5709-6e25-482b-aea0-2208a384d984 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:02.288377 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-0ebe5709-6e25-482b-aea0-2208a384d984 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054254 Nov 09 20:16:02.290604 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 500/1025] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:16:02 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:16:02.597957 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-a6c8dc2e-7b5b-488a-83ad-70f219412697 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:16:02.598712 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-a6c8dc2e-7b5b-488a-83ad-70f219412697 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:16:02.605726 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a6c8dc2e-7b5b-488a-83ad-70f219412697 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:02.606492 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a6c8dc2e-7b5b-488a-83ad-70f219412697 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:02.607542 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a6c8dc2e-7b5b-488a-83ad-70f219412697 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:02.608203 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a6c8dc2e-7b5b-488a-83ad-70f219412697 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:02.828896 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-a6c8dc2e-7b5b-488a-83ad-70f219412697 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:16:02.838487 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-a6c8dc2e-7b5b-488a-83ad-70f219412697 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:16:02.840347 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-a6c8dc2e-7b5b-488a-83ad-70f219412697 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:16:02.841695 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-a6c8dc2e-7b5b-488a-83ad-70f219412697 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1747 microversion: 2.20 time: 0.248018 Nov 09 20:16:02.842828 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 526/1026] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:16:02 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1747 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:16:03.301132 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-642078db-632e-4283-b867-3d9ae9cf6b91 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:16:03.305087 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-642078db-632e-4283-b867-3d9ae9cf6b91 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:16:03.315342 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-642078db-632e-4283-b867-3d9ae9cf6b91 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:03.316126 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-642078db-632e-4283-b867-3d9ae9cf6b91 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:03.318281 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-642078db-632e-4283-b867-3d9ae9cf6b91 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:03.318977 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-642078db-632e-4283-b867-3d9ae9cf6b91 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:03.371077 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-642078db-632e-4283-b867-3d9ae9cf6b91 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.072084 Nov 09 20:16:03.376456 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 501/1027] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:16:03 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:16:03.861378 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-bf9afa3e-539f-4f2b-ba1d-bd0c8d1163a4 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:16:03.862508 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-bf9afa3e-539f-4f2b-ba1d-bd0c8d1163a4 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:16:03.874280 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-bf9afa3e-539f-4f2b-ba1d-bd0c8d1163a4 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:03.875030 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-bf9afa3e-539f-4f2b-ba1d-bd0c8d1163a4 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:03.876034 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-bf9afa3e-539f-4f2b-ba1d-bd0c8d1163a4 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:03.876688 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-bf9afa3e-539f-4f2b-ba1d-bd0c8d1163a4 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:04.110334 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-bf9afa3e-539f-4f2b-ba1d-bd0c8d1163a4 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:16:04.120711 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-bf9afa3e-539f-4f2b-ba1d-bd0c8d1163a4 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:16:04.122658 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-bf9afa3e-539f-4f2b-ba1d-bd0c8d1163a4 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:16:04.124227 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-bf9afa3e-539f-4f2b-ba1d-bd0c8d1163a4 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1747 microversion: 2.20 time: 0.267677 Nov 09 20:16:04.125970 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 527/1028] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:16:03 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1747 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:16:04.382750 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-e43407b9-eaac-44dc-96bb-b5359203a66f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:16:04.387847 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-e43407b9-eaac-44dc-96bb-b5359203a66f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:16:04.403587 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e43407b9-eaac-44dc-96bb-b5359203a66f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:04.404034 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e43407b9-eaac-44dc-96bb-b5359203a66f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:04.404863 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e43407b9-eaac-44dc-96bb-b5359203a66f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:04.405469 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e43407b9-eaac-44dc-96bb-b5359203a66f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:04.474488 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-e43407b9-eaac-44dc-96bb-b5359203a66f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091190 Nov 09 20:16:04.475159 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 502/1029] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:16:04 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:16:05.143247 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-18a6558b-3676-4aa5-b969-a399311045a5 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:16:05.144100 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-18a6558b-3676-4aa5-b969-a399311045a5 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:16:05.152844 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-18a6558b-3676-4aa5-b969-a399311045a5 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:05.153596 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-18a6558b-3676-4aa5-b969-a399311045a5 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:05.154593 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-18a6558b-3676-4aa5-b969-a399311045a5 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:05.155254 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-18a6558b-3676-4aa5-b969-a399311045a5 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:05.415188 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-18a6558b-3676-4aa5-b969-a399311045a5 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:16:05.426104 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-18a6558b-3676-4aa5-b969-a399311045a5 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:16:05.427800 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-18a6558b-3676-4aa5-b969-a399311045a5 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:16:05.429136 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-18a6558b-3676-4aa5-b969-a399311045a5 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1747 microversion: 2.20 time: 0.289888 Nov 09 20:16:05.430468 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 528/1030] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:16:05 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1747 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:16:05.490927 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-bbd4eba6-a1d6-444a-8b54-0085e715e268 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:16:05.492707 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-bbd4eba6-a1d6-444a-8b54-0085e715e268 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:16:05.500782 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bbd4eba6-a1d6-444a-8b54-0085e715e268 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:05.501758 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bbd4eba6-a1d6-444a-8b54-0085e715e268 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:05.502803 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bbd4eba6-a1d6-444a-8b54-0085e715e268 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:05.503457 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bbd4eba6-a1d6-444a-8b54-0085e715e268 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:05.555353 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-bbd4eba6-a1d6-444a-8b54-0085e715e268 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069489 Nov 09 20:16:05.562147 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 503/1031] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:16:05 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:16:06.449075 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-ddcdd66c-ca3f-4602-ae24-ac45f56179f7 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:16:06.449678 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-ddcdd66c-ca3f-4602-ae24-ac45f56179f7 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:16:06.458441 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ddcdd66c-ca3f-4602-ae24-ac45f56179f7 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:06.460928 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ddcdd66c-ca3f-4602-ae24-ac45f56179f7 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:06.461906 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ddcdd66c-ca3f-4602-ae24-ac45f56179f7 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:06.463281 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ddcdd66c-ca3f-4602-ae24-ac45f56179f7 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:06.566846 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-2ef34979-0c56-4a83-96fa-120f30f3dc3b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:16:06.568372 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-2ef34979-0c56-4a83-96fa-120f30f3dc3b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:16:06.576466 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2ef34979-0c56-4a83-96fa-120f30f3dc3b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:06.577185 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2ef34979-0c56-4a83-96fa-120f30f3dc3b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:06.578139 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2ef34979-0c56-4a83-96fa-120f30f3dc3b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:06.578729 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2ef34979-0c56-4a83-96fa-120f30f3dc3b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:06.610491 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-2ef34979-0c56-4a83-96fa-120f30f3dc3b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047249 Nov 09 20:16:06.611649 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 504/1032] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:16:06 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 20:16:06.615579 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-ddcdd66c-ca3f-4602-ae24-ac45f56179f7 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:16:06.625056 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-ddcdd66c-ca3f-4602-ae24-ac45f56179f7 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:16:06.626617 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-ddcdd66c-ca3f-4602-ae24-ac45f56179f7 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:16:06.627847 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-ddcdd66c-ca3f-4602-ae24-ac45f56179f7 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1747 microversion: 2.20 time: 0.183316 Nov 09 20:16:06.628467 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 529/1033] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:16:06 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1747 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:16:07.622219 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-916e56fb-fddc-4183-b215-8fc5de7788cb tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:16:07.623127 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-916e56fb-fddc-4183-b215-8fc5de7788cb tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:16:07.629389 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-916e56fb-fddc-4183-b215-8fc5de7788cb tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:07.629839 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-916e56fb-fddc-4183-b215-8fc5de7788cb tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:07.630721 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-916e56fb-fddc-4183-b215-8fc5de7788cb tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:07.631157 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-916e56fb-fddc-4183-b215-8fc5de7788cb tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:07.646737 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-ce1eb6c7-391b-4193-8466-4fe39bdd5e8a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:16:07.647910 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-ce1eb6c7-391b-4193-8466-4fe39bdd5e8a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:16:07.655462 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ce1eb6c7-391b-4193-8466-4fe39bdd5e8a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:07.655917 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ce1eb6c7-391b-4193-8466-4fe39bdd5e8a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:07.656731 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ce1eb6c7-391b-4193-8466-4fe39bdd5e8a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:07.657344 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ce1eb6c7-391b-4193-8466-4fe39bdd5e8a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:07.664911 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-916e56fb-fddc-4183-b215-8fc5de7788cb tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046419 Nov 09 20:16:07.670431 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 505/1034] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:16:07 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:16:07.815219 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-ce1eb6c7-391b-4193-8466-4fe39bdd5e8a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:16:07.827294 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-ce1eb6c7-391b-4193-8466-4fe39bdd5e8a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:16:07.829301 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-ce1eb6c7-391b-4193-8466-4fe39bdd5e8a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:16:07.830838 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-ce1eb6c7-391b-4193-8466-4fe39bdd5e8a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1747 microversion: 2.20 time: 0.187706 Nov 09 20:16:07.831458 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 530/1035] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:16:07 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1747 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 09 20:16:08.678069 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-dfbe4d3e-5bba-42bd-9311-b4d5f0c50ec7 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:16:08.678974 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-dfbe4d3e-5bba-42bd-9311-b4d5f0c50ec7 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:16:08.686578 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-dfbe4d3e-5bba-42bd-9311-b4d5f0c50ec7 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:08.687294 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-dfbe4d3e-5bba-42bd-9311-b4d5f0c50ec7 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:08.688083 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-dfbe4d3e-5bba-42bd-9311-b4d5f0c50ec7 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:08.688704 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-dfbe4d3e-5bba-42bd-9311-b4d5f0c50ec7 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:08.724345 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-dfbe4d3e-5bba-42bd-9311-b4d5f0c50ec7 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050358 Nov 09 20:16:08.725219 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 506/1036] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:16:08 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:16:08.850472 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-a845a502-d24f-4578-8fe9-4267616a941a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:16:08.851245 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-a845a502-d24f-4578-8fe9-4267616a941a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:16:08.858446 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a845a502-d24f-4578-8fe9-4267616a941a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:08.859151 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a845a502-d24f-4578-8fe9-4267616a941a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:08.860040 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a845a502-d24f-4578-8fe9-4267616a941a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:08.860816 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a845a502-d24f-4578-8fe9-4267616a941a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:09.026255 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-a845a502-d24f-4578-8fe9-4267616a941a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:16:09.034650 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-a845a502-d24f-4578-8fe9-4267616a941a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:16:09.036925 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-a845a502-d24f-4578-8fe9-4267616a941a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:16:09.038176 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-a845a502-d24f-4578-8fe9-4267616a941a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1747 microversion: 2.20 time: 0.191515 Nov 09 20:16:09.039167 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 531/1037] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:16:08 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1747 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:16:09.737479 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-96cb42f0-5e84-4781-a32e-ef5c9f15deef tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:16:09.739173 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-96cb42f0-5e84-4781-a32e-ef5c9f15deef tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:16:09.746588 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-96cb42f0-5e84-4781-a32e-ef5c9f15deef tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:09.747323 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-96cb42f0-5e84-4781-a32e-ef5c9f15deef tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:09.748346 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-96cb42f0-5e84-4781-a32e-ef5c9f15deef tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:09.749067 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-96cb42f0-5e84-4781-a32e-ef5c9f15deef tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:09.782893 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-96cb42f0-5e84-4781-a32e-ef5c9f15deef tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049076 Nov 09 20:16:09.787190 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 507/1038] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:16:09 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:16:10.058950 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-fc7bc3e5-b9fb-44d5-8725-292f03e23bb1 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:16:10.059661 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-fc7bc3e5-b9fb-44d5-8725-292f03e23bb1 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:16:10.075300 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-fc7bc3e5-b9fb-44d5-8725-292f03e23bb1 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:10.076124 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-fc7bc3e5-b9fb-44d5-8725-292f03e23bb1 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:10.077177 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-fc7bc3e5-b9fb-44d5-8725-292f03e23bb1 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:10.077827 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-fc7bc3e5-b9fb-44d5-8725-292f03e23bb1 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:10.243236 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-fc7bc3e5-b9fb-44d5-8725-292f03e23bb1 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:16:10.254940 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-fc7bc3e5-b9fb-44d5-8725-292f03e23bb1 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:16:10.263724 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-fc7bc3e5-b9fb-44d5-8725-292f03e23bb1 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:16:10.265252 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-fc7bc3e5-b9fb-44d5-8725-292f03e23bb1 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1747 microversion: 2.20 time: 0.210406 Nov 09 20:16:10.276479 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 532/1039] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:16:10 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1747 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:16:10.794812 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-e64ea3be-f77d-49ea-a077-43970f4eea11 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:16:10.795721 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-e64ea3be-f77d-49ea-a077-43970f4eea11 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:16:10.802212 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e64ea3be-f77d-49ea-a077-43970f4eea11 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:10.802666 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e64ea3be-f77d-49ea-a077-43970f4eea11 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:10.803448 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e64ea3be-f77d-49ea-a077-43970f4eea11 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:10.803883 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e64ea3be-f77d-49ea-a077-43970f4eea11 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:10.837963 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-e64ea3be-f77d-49ea-a077-43970f4eea11 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047348 Nov 09 20:16:10.838815 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 508/1040] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:16:10 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:16:11.283165 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-92668544-41c0-463a-96be-dd9e9bfb9bf4 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:16:11.284464 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-92668544-41c0-463a-96be-dd9e9bfb9bf4 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:16:11.292156 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-92668544-41c0-463a-96be-dd9e9bfb9bf4 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:11.292637 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-92668544-41c0-463a-96be-dd9e9bfb9bf4 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:11.299096 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-92668544-41c0-463a-96be-dd9e9bfb9bf4 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:11.299766 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-92668544-41c0-463a-96be-dd9e9bfb9bf4 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:11.456944 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-92668544-41c0-463a-96be-dd9e9bfb9bf4 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:16:11.471042 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-92668544-41c0-463a-96be-dd9e9bfb9bf4 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:16:11.472566 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-92668544-41c0-463a-96be-dd9e9bfb9bf4 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:16:11.474215 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-92668544-41c0-463a-96be-dd9e9bfb9bf4 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1747 microversion: 2.20 time: 0.195029 Nov 09 20:16:11.480489 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 533/1041] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:16:11 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1747 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:16:11.849396 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-052ff658-6503-42cf-85e9-4cf18c6d4f30 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:16:11.850395 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-052ff658-6503-42cf-85e9-4cf18c6d4f30 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:16:11.862806 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-052ff658-6503-42cf-85e9-4cf18c6d4f30 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:11.863319 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-052ff658-6503-42cf-85e9-4cf18c6d4f30 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:11.864327 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-052ff658-6503-42cf-85e9-4cf18c6d4f30 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:11.870026 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-052ff658-6503-42cf-85e9-4cf18c6d4f30 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:11.907340 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-052ff658-6503-42cf-85e9-4cf18c6d4f30 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062001 Nov 09 20:16:11.908040 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 509/1042] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:16:11 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:16:12.498149 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-18c88fcb-b41e-4f4b-9d71-0a9fc3b57871 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:16:12.499344 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-18c88fcb-b41e-4f4b-9d71-0a9fc3b57871 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:16:12.506430 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-18c88fcb-b41e-4f4b-9d71-0a9fc3b57871 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:12.506981 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-18c88fcb-b41e-4f4b-9d71-0a9fc3b57871 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:12.507868 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-18c88fcb-b41e-4f4b-9d71-0a9fc3b57871 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:12.508373 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-18c88fcb-b41e-4f4b-9d71-0a9fc3b57871 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:12.690523 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-18c88fcb-b41e-4f4b-9d71-0a9fc3b57871 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:16:12.699788 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-18c88fcb-b41e-4f4b-9d71-0a9fc3b57871 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:16:12.701304 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-18c88fcb-b41e-4f4b-9d71-0a9fc3b57871 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:16:12.702455 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-18c88fcb-b41e-4f4b-9d71-0a9fc3b57871 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1747 microversion: 2.20 time: 0.209239 Nov 09 20:16:12.703421 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 534/1043] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:16:12 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1747 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:16:12.918939 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-d21ebbfe-d986-4053-92b3-7dd1a0719c57 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:16:12.919837 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-d21ebbfe-d986-4053-92b3-7dd1a0719c57 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:16:12.927311 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d21ebbfe-d986-4053-92b3-7dd1a0719c57 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:12.927752 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d21ebbfe-d986-4053-92b3-7dd1a0719c57 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:12.928555 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d21ebbfe-d986-4053-92b3-7dd1a0719c57 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:12.928985 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d21ebbfe-d986-4053-92b3-7dd1a0719c57 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:12.959012 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-d21ebbfe-d986-4053-92b3-7dd1a0719c57 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044256 Nov 09 20:16:12.959815 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 510/1044] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:16:12 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:16:13.722219 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-723362f1-8709-444e-acf6-0c94dad29f95 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:16:13.723524 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-723362f1-8709-444e-acf6-0c94dad29f95 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:16:13.730475 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-723362f1-8709-444e-acf6-0c94dad29f95 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:13.731606 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-723362f1-8709-444e-acf6-0c94dad29f95 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:13.732927 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-723362f1-8709-444e-acf6-0c94dad29f95 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:13.733592 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-723362f1-8709-444e-acf6-0c94dad29f95 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:13.888145 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-723362f1-8709-444e-acf6-0c94dad29f95 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:16:13.897150 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-723362f1-8709-444e-acf6-0c94dad29f95 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:16:13.901857 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-723362f1-8709-444e-acf6-0c94dad29f95 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:16:13.903065 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-723362f1-8709-444e-acf6-0c94dad29f95 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1747 microversion: 2.20 time: 0.184511 Nov 09 20:16:13.913985 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 535/1045] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:16:13 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1747 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:16:13.971492 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-d67bcc04-14cd-4b31-818e-1fbbf4d88bc7 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:16:13.973301 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-d67bcc04-14cd-4b31-818e-1fbbf4d88bc7 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:16:13.980734 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d67bcc04-14cd-4b31-818e-1fbbf4d88bc7 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:13.981405 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d67bcc04-14cd-4b31-818e-1fbbf4d88bc7 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:13.982467 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d67bcc04-14cd-4b31-818e-1fbbf4d88bc7 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:13.982877 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d67bcc04-14cd-4b31-818e-1fbbf4d88bc7 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:14.019509 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-d67bcc04-14cd-4b31-818e-1fbbf4d88bc7 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051667 Nov 09 20:16:14.020221 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 511/1046] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:16:13 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:16:14.921405 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-bc4c9002-b315-48f0-942c-6da71b617ec2 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:16:14.922009 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-bc4c9002-b315-48f0-942c-6da71b617ec2 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:16:14.928700 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-bc4c9002-b315-48f0-942c-6da71b617ec2 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:14.931041 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-bc4c9002-b315-48f0-942c-6da71b617ec2 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:14.932620 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-bc4c9002-b315-48f0-942c-6da71b617ec2 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:14.933135 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-bc4c9002-b315-48f0-942c-6da71b617ec2 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:15.030915 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-93f605e3-9961-4a12-9908-e7681236b8eb tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:16:15.031918 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-93f605e3-9961-4a12-9908-e7681236b8eb tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:16:15.038485 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-93f605e3-9961-4a12-9908-e7681236b8eb tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:15.039263 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-93f605e3-9961-4a12-9908-e7681236b8eb tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:15.040878 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-93f605e3-9961-4a12-9908-e7681236b8eb tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:15.041544 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-93f605e3-9961-4a12-9908-e7681236b8eb tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:15.072123 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-93f605e3-9961-4a12-9908-e7681236b8eb tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044863 Nov 09 20:16:15.076499 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 512/1047] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:16:15 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 20:16:15.088988 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-bc4c9002-b315-48f0-942c-6da71b617ec2 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:16:15.098681 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-bc4c9002-b315-48f0-942c-6da71b617ec2 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:16:15.100173 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-bc4c9002-b315-48f0-942c-6da71b617ec2 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:16:15.101371 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-bc4c9002-b315-48f0-942c-6da71b617ec2 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1747 microversion: 2.20 time: 0.183627 Nov 09 20:16:15.101920 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 536/1048] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:16:14 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1747 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:16:15.976797 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-097b3a09-ab5d-40c1-b9fc-238295ea1a66 tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] Action: 'create', calling method: .version_select at 0x7fab36aeda60>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-642532956"}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:16:15.990881 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.quota [None req-097b3a09-ab5d-40c1-b9fc-238295ea1a66 tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] Getting quotas for project d9f02e47d7b7453f84fd8dd3881d1329. Resources: {'key_pairs'} {{(pid=116103) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 09 20:16:15.995349 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.quota [None req-097b3a09-ab5d-40c1-b9fc-238295ea1a66 tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] Getting quotas for user fe6c68b3aef547a6b583c25f6e63beb4 and project d9f02e47d7b7453f84fd8dd3881d1329. Resources: {'key_pairs'} {{(pid=116103) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 09 20:16:16.082936 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-897894d4-8ad9-4478-9c32-bd09253483fb tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:16:16.083967 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-897894d4-8ad9-4478-9c32-bd09253483fb tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:16:16.090309 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-897894d4-8ad9-4478-9c32-bd09253483fb tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:16.090757 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-897894d4-8ad9-4478-9c32-bd09253483fb tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:16.091533 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-897894d4-8ad9-4478-9c32-bd09253483fb tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:16.091966 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-897894d4-8ad9-4478-9c32-bd09253483fb tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:16.121350 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-897894d4-8ad9-4478-9c32-bd09253483fb tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042185 Nov 09 20:16:16.121909 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 537/1049] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:16:16 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 20:16:16.126010 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-cb23523b-f8ac-49bd-8be7-2a294206cb5b tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:16:16.126602 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-cb23523b-f8ac-49bd-8be7-2a294206cb5b tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:16:16.131959 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-cb23523b-f8ac-49bd-8be7-2a294206cb5b tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:16.132425 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-cb23523b-f8ac-49bd-8be7-2a294206cb5b tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:16.133200 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-cb23523b-f8ac-49bd-8be7-2a294206cb5b tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:16.133640 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-cb23523b-f8ac-49bd-8be7-2a294206cb5b tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:16.187228 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.quota [None req-097b3a09-ab5d-40c1-b9fc-238295ea1a66 tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] Getting quotas for project d9f02e47d7b7453f84fd8dd3881d1329. Resources: {'key_pairs'} {{(pid=116103) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 09 20:16:16.190788 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.quota [None req-097b3a09-ab5d-40c1-b9fc-238295ea1a66 tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] Getting quotas for user fe6c68b3aef547a6b583c25f6e63beb4 and project d9f02e47d7b7453f84fd8dd3881d1329. Resources: {'key_pairs'} {{(pid=116103) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 09 20:16:16.204374 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-097b3a09-ab5d-40c1-b9fc-238295ea1a66 tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 2321 microversion: 2.1 time: 0.231126 Nov 09 20:16:16.204984 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 513/1050] 10.222.0.25 () {60 vars in 1157 bytes} [Tue Nov 9 20:16:15 2021] POST /compute/v2.1/os-keypairs => generated 2321 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 20:16:16.253862 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-a4c12819-66a3-47b7-bcb7-cbed3ed04f6e tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-2100350427", "imageRef": "79708bf3-78ef-4f11-939f-2af9401dca65", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-642532956", "networks": [{"uuid": "4461d1be-e9fa-44cd-8870-25c655693876"}]}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:16:16.267170 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-cb23523b-f8ac-49bd-8be7-2a294206cb5b tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:16:16.275984 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-cb23523b-f8ac-49bd-8be7-2a294206cb5b tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:16:16.277548 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-cb23523b-f8ac-49bd-8be7-2a294206cb5b tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:16:16.278706 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-cb23523b-f8ac-49bd-8be7-2a294206cb5b tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1747 microversion: 2.20 time: 0.155906 Nov 09 20:16:16.279255 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 538/1051] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:16:16 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1747 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:16:16.305660 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.network.neutron [None req-a4c12819-66a3-47b7-bcb7-cbed3ed04f6e tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] validate_networks() for [('4461d1be-e9fa-44cd-8870-25c655693876', None, None, None, None, None)] {{(pid=116103) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 09 20:16:16.746498 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.virt.hardware [None req-a4c12819-66a3-47b7-bcb7-cbed3ed04f6e tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] Flavor limits 0:0:0 {{(pid=116103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 09 20:16:16.746950 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.virt.hardware [None req-a4c12819-66a3-47b7-bcb7-cbed3ed04f6e tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] Image limits 0:0:0 {{(pid=116103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 09 20:16:16.747418 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.virt.hardware [None req-a4c12819-66a3-47b7-bcb7-cbed3ed04f6e tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] Flavor pref 0:0:0 {{(pid=116103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 09 20:16:16.747844 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.virt.hardware [None req-a4c12819-66a3-47b7-bcb7-cbed3ed04f6e tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] Image pref 0:0:0 {{(pid=116103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 09 20:16:16.748252 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.virt.hardware [None req-a4c12819-66a3-47b7-bcb7-cbed3ed04f6e tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 09 20:16:16.756520 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a4c12819-66a3-47b7-bcb7-cbed3ed04f6e tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:16.756956 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a4c12819-66a3-47b7-bcb7-cbed3ed04f6e tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:16.757743 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a4c12819-66a3-47b7-bcb7-cbed3ed04f6e tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:16.758165 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a4c12819-66a3-47b7-bcb7-cbed3ed04f6e tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:16.774407 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.quota [None req-a4c12819-66a3-47b7-bcb7-cbed3ed04f6e tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] Getting quotas for project d9f02e47d7b7453f84fd8dd3881d1329. Resources: {'cores', 'instances', 'ram'} {{(pid=116103) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 09 20:16:16.778825 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.quota [None req-a4c12819-66a3-47b7-bcb7-cbed3ed04f6e tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] Getting quotas for user fe6c68b3aef547a6b583c25f6e63beb4 and project d9f02e47d7b7453f84fd8dd3881d1329. Resources: {'cores', 'instances', 'ram'} {{(pid=116103) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 09 20:16:16.788948 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-a4c12819-66a3-47b7-bcb7-cbed3ed04f6e tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] Going to run 1 instances... {{(pid=116103) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 09 20:16:16.791134 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-a4c12819-66a3-47b7-bcb7-cbed3ed04f6e tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] [instance: dd766376-8156-40fd-b5e3-78b38e646c6b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='79708bf3-78ef-4f11-939f-2af9401dca65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116103) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 09 20:16:16.834203 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-a4c12819-66a3-47b7-bcb7-cbed3ed04f6e tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.583951 Nov 09 20:16:16.834832 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 514/1052] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Nov 9 20:16:16 2021] POST /compute/v2.1/servers => generated 380 bytes in 585 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 09 20:16:16.845308 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-98ea10c0-ac50-45c2-9f2c-807a65a2962a tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:16:16.845987 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-98ea10c0-ac50-45c2-9f2c-807a65a2962a tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] [instance: dd766376-8156-40fd-b5e3-78b38e646c6b] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:16:16.900281 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-98ea10c0-ac50-45c2-9f2c-807a65a2962a tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6c68b3aef547a6b583c25f6e63beb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f02e47d7b7453f84fd8dd3881d1329', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:16:16.906938 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-98ea10c0-ac50-45c2-9f2c-807a65a2962a tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] 10.222.0.25 "GET /compute/v2.1/servers/dd766376-8156-40fd-b5e3-78b38e646c6b" status: 200 len: 1258 microversion: 2.1 time: 0.065341 Nov 09 20:16:16.907499 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 539/1053] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:16:16 2021] GET /compute/v2.1/servers/dd766376-8156-40fd-b5e3-78b38e646c6b => generated 1258 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:16:17.131639 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-84ff1c79-7c1a-4efa-b8be-ac4d55101467 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:16:17.132917 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-84ff1c79-7c1a-4efa-b8be-ac4d55101467 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:16:17.139798 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-84ff1c79-7c1a-4efa-b8be-ac4d55101467 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:17.140241 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-84ff1c79-7c1a-4efa-b8be-ac4d55101467 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:17.141057 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-84ff1c79-7c1a-4efa-b8be-ac4d55101467 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:17.141566 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-84ff1c79-7c1a-4efa-b8be-ac4d55101467 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:17.172388 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-84ff1c79-7c1a-4efa-b8be-ac4d55101467 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044523 Nov 09 20:16:17.172973 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 515/1054] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:16:17 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:16:17.181826 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 09 20:16:17.181981 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: Tue Nov 9 20:16:17 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 09 20:16:17.298784 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-b5c3ff45-3753-4513-9c53-d6e3cf220250 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:16:17.299797 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-b5c3ff45-3753-4513-9c53-d6e3cf220250 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:16:17.307516 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b5c3ff45-3753-4513-9c53-d6e3cf220250 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:17.308052 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b5c3ff45-3753-4513-9c53-d6e3cf220250 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:17.308939 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b5c3ff45-3753-4513-9c53-d6e3cf220250 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:17.309607 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b5c3ff45-3753-4513-9c53-d6e3cf220250 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:17.447689 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-b5c3ff45-3753-4513-9c53-d6e3cf220250 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:16:17.455922 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-b5c3ff45-3753-4513-9c53-d6e3cf220250 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:16:17.457478 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-b5c3ff45-3753-4513-9c53-d6e3cf220250 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:16:17.458620 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-b5c3ff45-3753-4513-9c53-d6e3cf220250 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1747 microversion: 2.20 time: 0.164404 Nov 09 20:16:17.459180 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 540/1055] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:16:17 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1747 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:16:17.923235 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-3d342b62-1736-4546-b963-c1f731f88199 tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:16:17.924498 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-3d342b62-1736-4546-b963-c1f731f88199 tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] [instance: dd766376-8156-40fd-b5e3-78b38e646c6b] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:16:17.930415 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3d342b62-1736-4546-b963-c1f731f88199 tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:17.931060 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3d342b62-1736-4546-b963-c1f731f88199 tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:17.931822 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3d342b62-1736-4546-b963-c1f731f88199 tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:17.932247 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3d342b62-1736-4546-b963-c1f731f88199 tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:17.998834 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-3d342b62-1736-4546-b963-c1f731f88199 tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6c68b3aef547a6b583c25f6e63beb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f02e47d7b7453f84fd8dd3881d1329', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:16:18.007193 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-3d342b62-1736-4546-b963-c1f731f88199 tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] 10.222.0.25 "GET /compute/v2.1/servers/dd766376-8156-40fd-b5e3-78b38e646c6b" status: 200 len: 1328 microversion: 2.1 time: 0.087791 Nov 09 20:16:18.007777 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 516/1056] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:16:17 2021] GET /compute/v2.1/servers/dd766376-8156-40fd-b5e3-78b38e646c6b => generated 1328 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:16:18.183228 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-6cd877ad-5e6f-43b8-adbb-e9a9309afa19 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:16:18.184394 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-6cd877ad-5e6f-43b8-adbb-e9a9309afa19 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:16:18.190966 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6cd877ad-5e6f-43b8-adbb-e9a9309afa19 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:18.191419 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6cd877ad-5e6f-43b8-adbb-e9a9309afa19 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:18.192454 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6cd877ad-5e6f-43b8-adbb-e9a9309afa19 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:18.192715 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6cd877ad-5e6f-43b8-adbb-e9a9309afa19 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:18.225739 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-6cd877ad-5e6f-43b8-adbb-e9a9309afa19 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046313 Nov 09 20:16:18.230311 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 541/1057] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:16:18 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:16:18.478137 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-fe2b3c19-b47f-4b5c-8f37-97060ba24fad tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:16:18.479380 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-fe2b3c19-b47f-4b5c-8f37-97060ba24fad tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:16:18.487955 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fe2b3c19-b47f-4b5c-8f37-97060ba24fad tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:18.489012 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fe2b3c19-b47f-4b5c-8f37-97060ba24fad tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:18.489983 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fe2b3c19-b47f-4b5c-8f37-97060ba24fad tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:18.490584 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fe2b3c19-b47f-4b5c-8f37-97060ba24fad tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:18.642707 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-fe2b3c19-b47f-4b5c-8f37-97060ba24fad tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:16:18.651649 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-fe2b3c19-b47f-4b5c-8f37-97060ba24fad tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:16:18.654112 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-fe2b3c19-b47f-4b5c-8f37-97060ba24fad tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:16:18.655583 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-fe2b3c19-b47f-4b5c-8f37-97060ba24fad tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 200 len: 1747 microversion: 2.20 time: 0.181344 Nov 09 20:16:18.656173 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 517/1058] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:16:18 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 1747 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:16:18.739413 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-c46a6c8e-f087-4573-ae0d-4facfd1533bc tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:16:18.740277 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-c46a6c8e-f087-4573-ae0d-4facfd1533bc tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:16:18.748363 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c46a6c8e-f087-4573-ae0d-4facfd1533bc tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:18.748851 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c46a6c8e-f087-4573-ae0d-4facfd1533bc tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:18.749849 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c46a6c8e-f087-4573-ae0d-4facfd1533bc tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:18.750433 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c46a6c8e-f087-4573-ae0d-4facfd1533bc tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:19.028849 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-d0a5ba40-7da4-4f0b-a91b-35c4e374ae81 tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:16:19.029663 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-d0a5ba40-7da4-4f0b-a91b-35c4e374ae81 tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] [instance: dd766376-8156-40fd-b5e3-78b38e646c6b] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:16:19.043405 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d0a5ba40-7da4-4f0b-a91b-35c4e374ae81 tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:19.043855 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d0a5ba40-7da4-4f0b-a91b-35c4e374ae81 tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:19.044672 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d0a5ba40-7da4-4f0b-a91b-35c4e374ae81 tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:19.045167 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d0a5ba40-7da4-4f0b-a91b-35c4e374ae81 tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:19.204122 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-c46a6c8e-f087-4573-ae0d-4facfd1533bc tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "DELETE /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e/os-volume_attachments/334c646b-ed41-4854-a092-efa78ad7bbbf" status: 202 len: 0 microversion: 2.20 time: 0.470535 Nov 09 20:16:19.208319 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 542/1059] 10.222.0.25 () {60 vars in 1456 bytes} [Tue Nov 9 20:16:18 2021] DELETE /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e/os-volume_attachments/334c646b-ed41-4854-a092-efa78ad7bbbf => generated 0 bytes in 473 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 09 20:16:19.219239 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-e7161941-1f8c-4228-9d7b-9a8f9e161666 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:16:19.220570 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-e7161941-1f8c-4228-9d7b-9a8f9e161666 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:16:19.234273 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e7161941-1f8c-4228-9d7b-9a8f9e161666 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:19.234784 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e7161941-1f8c-4228-9d7b-9a8f9e161666 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:19.235672 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e7161941-1f8c-4228-9d7b-9a8f9e161666 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:19.236197 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e7161941-1f8c-4228-9d7b-9a8f9e161666 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:19.270081 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-e7161941-1f8c-4228-9d7b-9a8f9e161666 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.060276 Nov 09 20:16:19.270958 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 543/1060] 10.222.0.25 () {60 vars in 1342 bytes} [Tue Nov 9 20:16:19 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e/os-volume_attachments => generated 25 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:16:19.276003 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-da772003-994d-451c-b80f-15ea36ebc22a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:16:19.276937 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-da772003-994d-451c-b80f-15ea36ebc22a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:16:19.283091 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-da772003-994d-451c-b80f-15ea36ebc22a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:19.283545 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-da772003-994d-451c-b80f-15ea36ebc22a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:19.286269 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-da772003-994d-451c-b80f-15ea36ebc22a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:19.286718 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-da772003-994d-451c-b80f-15ea36ebc22a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:19.316017 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-d0a5ba40-7da4-4f0b-a91b-35c4e374ae81 tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6c68b3aef547a6b583c25f6e63beb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f02e47d7b7453f84fd8dd3881d1329', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:16:19.320752 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-da772003-994d-451c-b80f-15ea36ebc22a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045669 Nov 09 20:16:19.322186 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 544/1061] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:16:19 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:16:19.323728 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-d0a5ba40-7da4-4f0b-a91b-35c4e374ae81 tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] 10.222.0.25 "GET /compute/v2.1/servers/dd766376-8156-40fd-b5e3-78b38e646c6b" status: 200 len: 1358 microversion: 2.1 time: 0.302727 Nov 09 20:16:19.324432 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 518/1062] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:16:19 2021] GET /compute/v2.1/servers/dd766376-8156-40fd-b5e3-78b38e646c6b => generated 1358 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:16:19.337058 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-0a643045-0f92-4ca4-b45f-f29cc9e3c8d8 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:16:19.337544 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-0a643045-0f92-4ca4-b45f-f29cc9e3c8d8 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:16:19.343239 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0a643045-0f92-4ca4-b45f-f29cc9e3c8d8 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:19.343683 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0a643045-0f92-4ca4-b45f-f29cc9e3c8d8 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:19.344499 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0a643045-0f92-4ca4-b45f-f29cc9e3c8d8 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:19.344930 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0a643045-0f92-4ca4-b45f-f29cc9e3c8d8 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:19.369428 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-0a643045-0f92-4ca4-b45f-f29cc9e3c8d8 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Going to try to terminate instance {{(pid=116103) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 09 20:16:19.374984 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.compute.api [None req-0a643045-0f92-4ca4-b45f-f29cc9e3c8d8 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Working on deleting snapshot 228e3536-9547-4b08-a97d-b5febffb424d from shelved instance... Nov 09 20:16:19.957463 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-0a643045-0f92-4ca4-b45f-f29cc9e3c8d8 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Doing local delete in cell 3fe77ec2-f067-4504-9205-b014cb4accd4(cell1) {{(pid=116103) _delete /opt/stack/nova/nova/compute/api.py:2439}} Nov 09 20:16:19.958257 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0a643045-0f92-4ca4-b45f-f29cc9e3c8d8 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:19.958690 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0a643045-0f92-4ca4-b45f-f29cc9e3c8d8 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:19.959102 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.compute.api [None req-0a643045-0f92-4ca4-b45f-f29cc9e3c8d8 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Nov 09 20:16:19.962735 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.network.neutron [None req-0a643045-0f92-4ca4-b45f-f29cc9e3c8d8 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] deallocate_for_instance() {{(pid=116103) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1676}} Nov 09 20:16:20.333875 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-d7a9d2a3-1a77-484a-86a4-2c31c27df0ac tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:16:20.336436 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-d7a9d2a3-1a77-484a-86a4-2c31c27df0ac tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:16:20.346922 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d7a9d2a3-1a77-484a-86a4-2c31c27df0ac tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:20.347610 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d7a9d2a3-1a77-484a-86a4-2c31c27df0ac tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:20.348641 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d7a9d2a3-1a77-484a-86a4-2c31c27df0ac tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:20.349649 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d7a9d2a3-1a77-484a-86a4-2c31c27df0ac tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:20.385360 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-d7a9d2a3-1a77-484a-86a4-2c31c27df0ac tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054912 Nov 09 20:16:20.389493 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 545/1063] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:16:20 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:16:20.391055 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-669715b4-fba5-4996-ad01-ac728673063c tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:16:20.391662 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-669715b4-fba5-4996-ad01-ac728673063c tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] [instance: dd766376-8156-40fd-b5e3-78b38e646c6b] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:16:20.397775 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-669715b4-fba5-4996-ad01-ac728673063c tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:20.398240 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-669715b4-fba5-4996-ad01-ac728673063c tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:20.399015 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-669715b4-fba5-4996-ad01-ac728673063c tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:20.399445 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-669715b4-fba5-4996-ad01-ac728673063c tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:20.617697 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-669715b4-fba5-4996-ad01-ac728673063c tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6c68b3aef547a6b583c25f6e63beb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f02e47d7b7453f84fd8dd3881d1329', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:16:20.627322 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-669715b4-fba5-4996-ad01-ac728673063c tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] 10.222.0.25 "GET /compute/v2.1/servers/dd766376-8156-40fd-b5e3-78b38e646c6b" status: 200 len: 1358 microversion: 2.1 time: 0.239688 Nov 09 20:16:20.637364 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 546/1064] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:16:20 2021] GET /compute/v2.1/servers/dd766376-8156-40fd-b5e3-78b38e646c6b => generated 1358 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:16:21.077401 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.network.neutron [None req-0a643045-0f92-4ca4-b45f-f29cc9e3c8d8 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Updating instance_info_cache with network_info: [] {{(pid=116103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Nov 09 20:16:21.272180 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [req-67f4467c-f0ba-4442-9818-1304abd69cc2 req-33d0719b-41b5-4329-aa7a-7784d535a415 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae338c69-d22d-41c2-89b0-b0cec236521e", "name": "network-vif-deleted", "tag": "8caa7fa5-9183-46fa-9387-e9fbebafe302"}]} {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:16:21.273796 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 20:16:21.273796 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: warnings.warn(msg) Nov 09 20:16:21.281092 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [req-67f4467c-f0ba-4442-9818-1304abd69cc2 req-33d0719b-41b5-4329-aa7a-7784d535a415 service nova] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:21.281536 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [req-67f4467c-f0ba-4442-9818-1304abd69cc2 req-33d0719b-41b5-4329-aa7a-7784d535a415 service nova] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:21.293532 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.compute.server_external_events [req-67f4467c-f0ba-4442-9818-1304abd69cc2 req-33d0719b-41b5-4329-aa7a-7784d535a415 service nova] Unable to find a host for instance ae338c69-d22d-41c2-89b0-b0cec236521e. Dropping event network-vif-deleted {{(pid=116102) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Nov 09 20:16:21.294422 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [req-67f4467c-f0ba-4442-9818-1304abd69cc2 req-33d0719b-41b5-4329-aa7a-7784d535a415 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.219047 Nov 09 20:16:21.295200 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 547/1065] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Nov 9 20:16:21 2021] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 220 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Nov 09 20:16:21.344507 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.scheduler.client.report [None req-0a643045-0f92-4ca4-b45f-f29cc9e3c8d8 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Deleted allocations for instance ae338c69-d22d-41c2-89b0-b0cec236521e Nov 09 20:16:21.397212 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-f6bff259-8003-47dc-bab8-479cc0155641 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:16:21.398223 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-f6bff259-8003-47dc-bab8-479cc0155641 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:16:21.410136 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f6bff259-8003-47dc-bab8-479cc0155641 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:21.410595 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f6bff259-8003-47dc-bab8-479cc0155641 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:21.411403 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f6bff259-8003-47dc-bab8-479cc0155641 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:21.418750 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f6bff259-8003-47dc-bab8-479cc0155641 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:21.464626 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-f6bff259-8003-47dc-bab8-479cc0155641 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071568 Nov 09 20:16:21.465466 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 548/1066] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:16:21 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 20:16:21.554116 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-0a643045-0f92-4ca4-b45f-f29cc9e3c8d8 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "DELETE /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 204 len: 0 microversion: 2.20 time: 2.220046 Nov 09 20:16:21.554901 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 519/1067] 10.222.0.25 () {60 vars in 1279 bytes} [Tue Nov 9 20:16:19 2021] DELETE /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 0 bytes in 2222 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Nov 09 20:16:21.562956 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-1d087b8d-b3e7-46cd-94ce-a2b89662472d tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:16:21.563622 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-1d087b8d-b3e7-46cd-94ce-a2b89662472d tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:16:21.570129 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-1d087b8d-b3e7-46cd-94ce-a2b89662472d tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:21.570584 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-1d087b8d-b3e7-46cd-94ce-a2b89662472d tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:21.571426 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-1d087b8d-b3e7-46cd-94ce-a2b89662472d tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:21.571878 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-1d087b8d-b3e7-46cd-94ce-a2b89662472d tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:21.585176 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.wsgi [None req-1d087b8d-b3e7-46cd-94ce-a2b89662472d tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] HTTP exception thrown: Instance ae338c69-d22d-41c2-89b0-b0cec236521e could not be found. Nov 09 20:16:21.585768 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-1d087b8d-b3e7-46cd-94ce-a2b89662472d tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Returning 404 to user: Instance ae338c69-d22d-41c2-89b0-b0cec236521e could not be found. {{(pid=116102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 09 20:16:21.586589 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-1d087b8d-b3e7-46cd-94ce-a2b89662472d tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 404 len: 111 microversion: 2.20 time: 0.027335 Nov 09 20:16:21.587129 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 549/1068] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:16:21 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Nov 09 20:16:21.596747 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-634e6174-1ca6-458c-aac7-6d038012489f tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '.version_select at 0x7fab36b65280>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:16:21.615973 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-634e6174-1ca6-458c-aac7-6d038012489f tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1604207818" status: 204 len: 0 microversion: 2.20 time: 0.023349 Nov 09 20:16:21.616594 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 520/1069] 10.222.0.25 () {60 vars in 1261 bytes} [Tue Nov 9 20:16:21 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1604207818 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 09 20:16:21.660460 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-a04f2d18-dd3b-4663-9500-a4b42a10d677 tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:16:21.661964 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-a04f2d18-dd3b-4663-9500-a4b42a10d677 tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] [instance: dd766376-8156-40fd-b5e3-78b38e646c6b] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:16:21.670264 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a04f2d18-dd3b-4663-9500-a4b42a10d677 tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:21.670708 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a04f2d18-dd3b-4663-9500-a4b42a10d677 tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:21.671675 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a04f2d18-dd3b-4663-9500-a4b42a10d677 tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:21.672317 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a04f2d18-dd3b-4663-9500-a4b42a10d677 tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:21.952910 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-a04f2d18-dd3b-4663-9500-a4b42a10d677 tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6c68b3aef547a6b583c25f6e63beb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f02e47d7b7453f84fd8dd3881d1329', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:16:21.962724 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-a04f2d18-dd3b-4663-9500-a4b42a10d677 tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] 10.222.0.25 "GET /compute/v2.1/servers/dd766376-8156-40fd-b5e3-78b38e646c6b" status: 200 len: 1358 microversion: 2.1 time: 0.315483 Nov 09 20:16:21.963856 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 550/1070] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:16:21 2021] GET /compute/v2.1/servers/dd766376-8156-40fd-b5e3-78b38e646c6b => generated 1358 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:16:22.476049 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-35c4f2db-eab0-40dc-a022-03d682b61c96 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:16:22.477107 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-35c4f2db-eab0-40dc-a022-03d682b61c96 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:16:22.483077 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-35c4f2db-eab0-40dc-a022-03d682b61c96 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:22.483524 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-35c4f2db-eab0-40dc-a022-03d682b61c96 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:22.484295 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-35c4f2db-eab0-40dc-a022-03d682b61c96 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:22.484898 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-35c4f2db-eab0-40dc-a022-03d682b61c96 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:22.533841 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-35c4f2db-eab0-40dc-a022-03d682b61c96 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061544 Nov 09 20:16:22.534406 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 521/1071] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:16:22 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:16:22.643416 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-fac112a5-d73a-4726-8f20-2e4d007f0896 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Action: 'create', calling method: .version_select at 0x7fab36d5a0d0>, body: {"keypair": {"name": "tempest-keypair-409129768"}} {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:16:22.660650 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.quota [None req-fac112a5-d73a-4726-8f20-2e4d007f0896 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Getting quotas for project ee9e1da6a3c14c4a931ece53d568b716. Resources: {'key_pairs'} {{(pid=116102) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 09 20:16:22.665642 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.quota [None req-fac112a5-d73a-4726-8f20-2e4d007f0896 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Getting quotas for user 9f813425597246e495fca79f1d6a1448 and project ee9e1da6a3c14c4a931ece53d568b716. Resources: {'key_pairs'} {{(pid=116102) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 09 20:16:22.798185 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.quota [None req-fac112a5-d73a-4726-8f20-2e4d007f0896 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Getting quotas for project ee9e1da6a3c14c4a931ece53d568b716. Resources: {'key_pairs'} {{(pid=116102) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 09 20:16:22.801804 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.quota [None req-fac112a5-d73a-4726-8f20-2e4d007f0896 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Getting quotas for user 9f813425597246e495fca79f1d6a1448 and project ee9e1da6a3c14c4a931ece53d568b716. Resources: {'key_pairs'} {{(pid=116102) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 09 20:16:22.814749 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-fac112a5-d73a-4726-8f20-2e4d007f0896 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 2315 microversion: 2.20 time: 0.182964 Nov 09 20:16:22.815361 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 551/1072] 10.222.0.25 () {62 vars in 1198 bytes} [Tue Nov 9 20:16:22 2021] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 184 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Nov 09 20:16:22.979792 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-a217c572-aa3a-46e8-ab45-1f8f3c4b3aa3 tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:16:22.980481 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-a217c572-aa3a-46e8-ab45-1f8f3c4b3aa3 tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] [instance: dd766376-8156-40fd-b5e3-78b38e646c6b] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:16:22.992928 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a217c572-aa3a-46e8-ab45-1f8f3c4b3aa3 tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:22.993544 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a217c572-aa3a-46e8-ab45-1f8f3c4b3aa3 tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:22.995033 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a217c572-aa3a-46e8-ab45-1f8f3c4b3aa3 tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:22.997511 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a217c572-aa3a-46e8-ab45-1f8f3c4b3aa3 tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:23.455673 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-a217c572-aa3a-46e8-ab45-1f8f3c4b3aa3 tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6c68b3aef547a6b583c25f6e63beb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f02e47d7b7453f84fd8dd3881d1329', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:16:23.465266 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-a217c572-aa3a-46e8-ab45-1f8f3c4b3aa3 tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] 10.222.0.25 "GET /compute/v2.1/servers/dd766376-8156-40fd-b5e3-78b38e646c6b" status: 200 len: 1358 microversion: 2.1 time: 0.490011 Nov 09 20:16:23.468450 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 522/1073] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:16:22 2021] GET /compute/v2.1/servers/dd766376-8156-40fd-b5e3-78b38e646c6b => generated 1358 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:16:23.545434 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-4019212a-452f-4a3c-8cff-e83fbce1d2a7 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:16:23.546349 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-4019212a-452f-4a3c-8cff-e83fbce1d2a7 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:16:23.552495 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-4019212a-452f-4a3c-8cff-e83fbce1d2a7 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:23.552945 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-4019212a-452f-4a3c-8cff-e83fbce1d2a7 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:23.553727 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-4019212a-452f-4a3c-8cff-e83fbce1d2a7 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:23.554159 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-4019212a-452f-4a3c-8cff-e83fbce1d2a7 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:23.588671 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-4019212a-452f-4a3c-8cff-e83fbce1d2a7 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046337 Nov 09 20:16:23.592626 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 552/1074] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:16:23 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:16:24.482480 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-eee1fdd0-bc69-4cac-9430-8d0addac7dd3 tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:16:24.483433 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-eee1fdd0-bc69-4cac-9430-8d0addac7dd3 tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] [instance: dd766376-8156-40fd-b5e3-78b38e646c6b] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:16:24.491227 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-eee1fdd0-bc69-4cac-9430-8d0addac7dd3 tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:24.491650 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-eee1fdd0-bc69-4cac-9430-8d0addac7dd3 tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:24.492528 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-eee1fdd0-bc69-4cac-9430-8d0addac7dd3 tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:24.492982 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-eee1fdd0-bc69-4cac-9430-8d0addac7dd3 tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:24.595646 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-279f73bc-ecd9-43f4-8e68-1d1cd61fb02a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-120776984", "imageRef": "109ded43-8c19-4f17-afac-7625dcfef942", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5e5cb9f1-b28c-498d-9454-93e9dbc54380"}], "security_groups": [{"name": "tempest-securitygroup--77305136"}], "key_name": "tempest-keypair-409129768", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:16:24.643096 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-eee1fdd0-bc69-4cac-9430-8d0addac7dd3 tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6c68b3aef547a6b583c25f6e63beb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f02e47d7b7453f84fd8dd3881d1329', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:16:24.652218 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-eee1fdd0-bc69-4cac-9430-8d0addac7dd3 tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] 10.222.0.25 "GET /compute/v2.1/servers/dd766376-8156-40fd-b5e3-78b38e646c6b" status: 200 len: 1358 microversion: 2.1 time: 0.173699 Nov 09 20:16:24.654593 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 523/1075] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:16:24 2021] GET /compute/v2.1/servers/dd766376-8156-40fd-b5e3-78b38e646c6b => generated 1358 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:16:24.660837 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-fe526aab-6875-4674-9440-fa73620dda91 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:16:24.667513 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-fe526aab-6875-4674-9440-fa73620dda91 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:16:24.684630 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fe526aab-6875-4674-9440-fa73620dda91 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:24.685297 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fe526aab-6875-4674-9440-fa73620dda91 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:24.686551 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fe526aab-6875-4674-9440-fa73620dda91 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:24.687205 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fe526aab-6875-4674-9440-fa73620dda91 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:24.723245 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-fe526aab-6875-4674-9440-fa73620dda91 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065830 Nov 09 20:16:24.724631 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 524/1076] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:16:24 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:16:24.762309 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.network.neutron [None req-279f73bc-ecd9-43f4-8e68-1d1cd61fb02a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] validate_networks() for [('5e5cb9f1-b28c-498d-9454-93e9dbc54380', None, None, None, None, None)] {{(pid=116102) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 09 20:16:25.188823 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.virt.hardware [None req-279f73bc-ecd9-43f4-8e68-1d1cd61fb02a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Flavor limits 0:0:0 {{(pid=116102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 09 20:16:25.189242 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.virt.hardware [None req-279f73bc-ecd9-43f4-8e68-1d1cd61fb02a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Image limits 0:0:0 {{(pid=116102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 09 20:16:25.189702 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.virt.hardware [None req-279f73bc-ecd9-43f4-8e68-1d1cd61fb02a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Flavor pref 0:0:0 {{(pid=116102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 09 20:16:25.190102 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.virt.hardware [None req-279f73bc-ecd9-43f4-8e68-1d1cd61fb02a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Image pref 0:0:0 {{(pid=116102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 09 20:16:25.190503 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.virt.hardware [None req-279f73bc-ecd9-43f4-8e68-1d1cd61fb02a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 09 20:16:25.215150 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-279f73bc-ecd9-43f4-8e68-1d1cd61fb02a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:25.215594 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-279f73bc-ecd9-43f4-8e68-1d1cd61fb02a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:25.216393 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-279f73bc-ecd9-43f4-8e68-1d1cd61fb02a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:25.216856 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-279f73bc-ecd9-43f4-8e68-1d1cd61fb02a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:25.235223 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.quota [None req-279f73bc-ecd9-43f4-8e68-1d1cd61fb02a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Getting quotas for project ee9e1da6a3c14c4a931ece53d568b716. Resources: {'cores', 'instances', 'ram'} {{(pid=116102) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 09 20:16:25.245545 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.quota [None req-279f73bc-ecd9-43f4-8e68-1d1cd61fb02a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Getting quotas for user 9f813425597246e495fca79f1d6a1448 and project ee9e1da6a3c14c4a931ece53d568b716. Resources: {'cores', 'instances', 'ram'} {{(pid=116102) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 09 20:16:25.259776 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-279f73bc-ecd9-43f4-8e68-1d1cd61fb02a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Going to run 1 instances... {{(pid=116102) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 09 20:16:25.262524 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-279f73bc-ecd9-43f4-8e68-1d1cd61fb02a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: 90c53d4c-080d-4d25-a3eb-50c92e83f38c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='109ded43-8c19-4f17-afac-7625dcfef942',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 09 20:16:25.314618 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-279f73bc-ecd9-43f4-8e68-1d1cd61fb02a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.20 time: 0.727135 Nov 09 20:16:25.315250 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 553/1077] 10.222.0.25 () {62 vars in 1187 bytes} [Tue Nov 9 20:16:24 2021] POST /compute/v2.1/servers => generated 400 bytes in 729 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 09 20:16:25.325562 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-32f01987-3d66-4626-ab28-4490e38c0b2d tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:16:25.326267 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-32f01987-3d66-4626-ab28-4490e38c0b2d tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: 90c53d4c-080d-4d25-a3eb-50c92e83f38c] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:16:25.384037 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-32f01987-3d66-4626-ab28-4490e38c0b2d tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:16:25.391981 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-32f01987-3d66-4626-ab28-4490e38c0b2d tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:16:25.393691 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-32f01987-3d66-4626-ab28-4490e38c0b2d tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:16:25.394962 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-32f01987-3d66-4626-ab28-4490e38c0b2d tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/90c53d4c-080d-4d25-a3eb-50c92e83f38c" status: 200 len: 1280 microversion: 2.20 time: 0.073263 Nov 09 20:16:25.395753 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 525/1078] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:16:25 2021] GET /compute/v2.1/servers/90c53d4c-080d-4d25-a3eb-50c92e83f38c => generated 1280 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:16:25.671177 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-1c5d1027-dc15-4cbc-b7bc-3e0f90b323d1 tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:16:25.673008 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-1c5d1027-dc15-4cbc-b7bc-3e0f90b323d1 tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] [instance: dd766376-8156-40fd-b5e3-78b38e646c6b] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:16:25.687318 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-1c5d1027-dc15-4cbc-b7bc-3e0f90b323d1 tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:25.688035 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-1c5d1027-dc15-4cbc-b7bc-3e0f90b323d1 tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:25.689039 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-1c5d1027-dc15-4cbc-b7bc-3e0f90b323d1 tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:25.689643 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-1c5d1027-dc15-4cbc-b7bc-3e0f90b323d1 tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:25.736821 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-9f45300b-a864-4786-9403-aa4d25dafca0 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:16:25.737852 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-9f45300b-a864-4786-9403-aa4d25dafca0 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:16:25.750636 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9f45300b-a864-4786-9403-aa4d25dafca0 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:25.755940 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9f45300b-a864-4786-9403-aa4d25dafca0 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:25.756808 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9f45300b-a864-4786-9403-aa4d25dafca0 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:25.757261 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9f45300b-a864-4786-9403-aa4d25dafca0 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:25.795834 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-9f45300b-a864-4786-9403-aa4d25dafca0 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063978 Nov 09 20:16:25.796510 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 526/1079] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:16:25 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 20:16:25.870404 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-1c5d1027-dc15-4cbc-b7bc-3e0f90b323d1 tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6c68b3aef547a6b583c25f6e63beb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f02e47d7b7453f84fd8dd3881d1329', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:16:25.877622 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-1c5d1027-dc15-4cbc-b7bc-3e0f90b323d1 tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] 10.222.0.25 "GET /compute/v2.1/servers/dd766376-8156-40fd-b5e3-78b38e646c6b" status: 200 len: 1358 microversion: 2.1 time: 0.211314 Nov 09 20:16:25.878178 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 554/1080] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:16:25 2021] GET /compute/v2.1/servers/dd766376-8156-40fd-b5e3-78b38e646c6b => generated 1358 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:16:26.413888 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-25e919d0-9a42-4037-97df-19993d726d4f tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:16:26.414482 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-25e919d0-9a42-4037-97df-19993d726d4f tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: 90c53d4c-080d-4d25-a3eb-50c92e83f38c] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:16:26.420927 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-25e919d0-9a42-4037-97df-19993d726d4f tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:26.421366 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-25e919d0-9a42-4037-97df-19993d726d4f tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:26.422155 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-25e919d0-9a42-4037-97df-19993d726d4f tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:26.422582 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-25e919d0-9a42-4037-97df-19993d726d4f tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:26.479425 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-25e919d0-9a42-4037-97df-19993d726d4f tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:16:26.487331 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-25e919d0-9a42-4037-97df-19993d726d4f tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:16:26.488833 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-25e919d0-9a42-4037-97df-19993d726d4f tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:16:26.489903 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-25e919d0-9a42-4037-97df-19993d726d4f tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/90c53d4c-080d-4d25-a3eb-50c92e83f38c" status: 200 len: 1284 microversion: 2.20 time: 0.079705 Nov 09 20:16:26.490445 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 527/1081] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:16:26 2021] GET /compute/v2.1/servers/90c53d4c-080d-4d25-a3eb-50c92e83f38c => generated 1284 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:16:26.807403 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-2c66eee7-bf89-4be6-b643-8fd24fa07509 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:16:26.808311 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-2c66eee7-bf89-4be6-b643-8fd24fa07509 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:16:26.814587 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-2c66eee7-bf89-4be6-b643-8fd24fa07509 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:26.815032 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-2c66eee7-bf89-4be6-b643-8fd24fa07509 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:26.815804 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-2c66eee7-bf89-4be6-b643-8fd24fa07509 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:26.816231 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-2c66eee7-bf89-4be6-b643-8fd24fa07509 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:26.845007 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-2c66eee7-bf89-4be6-b643-8fd24fa07509 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041673 Nov 09 20:16:26.845561 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 555/1082] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:16:26 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:16:26.894584 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-b638958f-92d3-4e3a-b68d-560f8bbd51dc tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:16:26.895184 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-b638958f-92d3-4e3a-b68d-560f8bbd51dc tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] [instance: dd766376-8156-40fd-b5e3-78b38e646c6b] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:16:26.901314 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b638958f-92d3-4e3a-b68d-560f8bbd51dc tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:26.901761 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b638958f-92d3-4e3a-b68d-560f8bbd51dc tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:26.902513 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b638958f-92d3-4e3a-b68d-560f8bbd51dc tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:26.902943 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b638958f-92d3-4e3a-b68d-560f8bbd51dc tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:27.049513 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-b638958f-92d3-4e3a-b68d-560f8bbd51dc tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6c68b3aef547a6b583c25f6e63beb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f02e47d7b7453f84fd8dd3881d1329', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:16:27.058075 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-b638958f-92d3-4e3a-b68d-560f8bbd51dc tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] 10.222.0.25 "GET /compute/v2.1/servers/dd766376-8156-40fd-b5e3-78b38e646c6b" status: 200 len: 1358 microversion: 2.1 time: 0.166863 Nov 09 20:16:27.058808 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 528/1083] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:16:26 2021] GET /compute/v2.1/servers/dd766376-8156-40fd-b5e3-78b38e646c6b => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:16:27.508048 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-ebea5f80-de8a-4872-a5f6-9457dba1e216 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:16:27.508740 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-ebea5f80-de8a-4872-a5f6-9457dba1e216 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: 90c53d4c-080d-4d25-a3eb-50c92e83f38c] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:16:27.514610 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ebea5f80-de8a-4872-a5f6-9457dba1e216 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:27.515049 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ebea5f80-de8a-4872-a5f6-9457dba1e216 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:27.515803 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ebea5f80-de8a-4872-a5f6-9457dba1e216 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:27.516227 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ebea5f80-de8a-4872-a5f6-9457dba1e216 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:27.576882 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-ebea5f80-de8a-4872-a5f6-9457dba1e216 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:16:27.586104 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-ebea5f80-de8a-4872-a5f6-9457dba1e216 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:16:27.588213 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-ebea5f80-de8a-4872-a5f6-9457dba1e216 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:16:27.589779 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-ebea5f80-de8a-4872-a5f6-9457dba1e216 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/90c53d4c-080d-4d25-a3eb-50c92e83f38c" status: 200 len: 1284 microversion: 2.20 time: 0.085392 Nov 09 20:16:27.590315 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 556/1084] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:16:27 2021] GET /compute/v2.1/servers/90c53d4c-080d-4d25-a3eb-50c92e83f38c => generated 1284 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:16:27.858007 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-e4c27a17-8c6a-42b2-a422-b46ab2e64095 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:16:27.858922 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-e4c27a17-8c6a-42b2-a422-b46ab2e64095 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:16:27.867299 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e4c27a17-8c6a-42b2-a422-b46ab2e64095 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:27.867749 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e4c27a17-8c6a-42b2-a422-b46ab2e64095 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:27.868600 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e4c27a17-8c6a-42b2-a422-b46ab2e64095 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:27.869091 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e4c27a17-8c6a-42b2-a422-b46ab2e64095 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:27.899531 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-e4c27a17-8c6a-42b2-a422-b46ab2e64095 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046801 Nov 09 20:16:27.900904 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 529/1085] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:16:27 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 20:16:28.075283 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-e46b51d8-e969-4ff0-92bf-0f4efbeb5ce3 tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:16:28.075958 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-e46b51d8-e969-4ff0-92bf-0f4efbeb5ce3 tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] [instance: dd766376-8156-40fd-b5e3-78b38e646c6b] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:16:28.082163 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e46b51d8-e969-4ff0-92bf-0f4efbeb5ce3 tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:28.082699 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e46b51d8-e969-4ff0-92bf-0f4efbeb5ce3 tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:28.083487 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e46b51d8-e969-4ff0-92bf-0f4efbeb5ce3 tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:28.083920 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e46b51d8-e969-4ff0-92bf-0f4efbeb5ce3 tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:28.210831 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-e46b51d8-e969-4ff0-92bf-0f4efbeb5ce3 tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6c68b3aef547a6b583c25f6e63beb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f02e47d7b7453f84fd8dd3881d1329', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:16:28.219229 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-e46b51d8-e969-4ff0-92bf-0f4efbeb5ce3 tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] 10.222.0.25 "GET /compute/v2.1/servers/dd766376-8156-40fd-b5e3-78b38e646c6b" status: 200 len: 1358 microversion: 2.1 time: 0.148576 Nov 09 20:16:28.228960 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 557/1086] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:16:28 2021] GET /compute/v2.1/servers/dd766376-8156-40fd-b5e3-78b38e646c6b => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:16:28.607392 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-e08c1592-0e43-4908-9dbf-a2b9af8e4bea tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:16:28.608884 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-e08c1592-0e43-4908-9dbf-a2b9af8e4bea tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: 90c53d4c-080d-4d25-a3eb-50c92e83f38c] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:16:28.615065 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e08c1592-0e43-4908-9dbf-a2b9af8e4bea tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:28.615740 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e08c1592-0e43-4908-9dbf-a2b9af8e4bea tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:28.616623 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e08c1592-0e43-4908-9dbf-a2b9af8e4bea tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:28.617062 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e08c1592-0e43-4908-9dbf-a2b9af8e4bea tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:28.695842 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-e08c1592-0e43-4908-9dbf-a2b9af8e4bea tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:16:28.704040 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-e08c1592-0e43-4908-9dbf-a2b9af8e4bea tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:16:28.705554 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-e08c1592-0e43-4908-9dbf-a2b9af8e4bea tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:16:28.706648 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-e08c1592-0e43-4908-9dbf-a2b9af8e4bea tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/90c53d4c-080d-4d25-a3eb-50c92e83f38c" status: 200 len: 1284 microversion: 2.20 time: 0.103495 Nov 09 20:16:28.707203 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 530/1087] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:16:28 2021] GET /compute/v2.1/servers/90c53d4c-080d-4d25-a3eb-50c92e83f38c => generated 1284 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:16:28.911478 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-e8145e8d-0b9e-419e-9534-99231df07455 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:16:28.912302 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-e8145e8d-0b9e-419e-9534-99231df07455 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:16:28.927220 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e8145e8d-0b9e-419e-9534-99231df07455 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:28.927667 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e8145e8d-0b9e-419e-9534-99231df07455 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:28.928472 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e8145e8d-0b9e-419e-9534-99231df07455 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:28.928900 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e8145e8d-0b9e-419e-9534-99231df07455 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:28.968478 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-e8145e8d-0b9e-419e-9534-99231df07455 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060622 Nov 09 20:16:28.969059 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 558/1088] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:16:28 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:16:29.237235 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-80052e28-f6fd-4e88-a64a-52cd9756c610 tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:16:29.239021 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-80052e28-f6fd-4e88-a64a-52cd9756c610 tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] [instance: dd766376-8156-40fd-b5e3-78b38e646c6b] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:16:29.247686 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-80052e28-f6fd-4e88-a64a-52cd9756c610 tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:29.248950 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-80052e28-f6fd-4e88-a64a-52cd9756c610 tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:29.249812 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-80052e28-f6fd-4e88-a64a-52cd9756c610 tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:29.250392 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-80052e28-f6fd-4e88-a64a-52cd9756c610 tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:29.382678 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-80052e28-f6fd-4e88-a64a-52cd9756c610 tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6c68b3aef547a6b583c25f6e63beb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f02e47d7b7453f84fd8dd3881d1329', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:16:29.390262 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-80052e28-f6fd-4e88-a64a-52cd9756c610 tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] 10.222.0.25 "GET /compute/v2.1/servers/dd766376-8156-40fd-b5e3-78b38e646c6b" status: 200 len: 1358 microversion: 2.1 time: 0.158134 Nov 09 20:16:29.390815 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 531/1089] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:16:29 2021] GET /compute/v2.1/servers/dd766376-8156-40fd-b5e3-78b38e646c6b => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:16:29.724366 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-b03360f0-a70f-4489-bd80-0f1ed722b24e tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:16:29.724987 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-b03360f0-a70f-4489-bd80-0f1ed722b24e tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: 90c53d4c-080d-4d25-a3eb-50c92e83f38c] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:16:29.731394 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b03360f0-a70f-4489-bd80-0f1ed722b24e tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:29.731834 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b03360f0-a70f-4489-bd80-0f1ed722b24e tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:29.732883 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b03360f0-a70f-4489-bd80-0f1ed722b24e tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:29.733309 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b03360f0-a70f-4489-bd80-0f1ed722b24e tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:29.791284 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-b03360f0-a70f-4489-bd80-0f1ed722b24e tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:16:29.798852 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-b03360f0-a70f-4489-bd80-0f1ed722b24e tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:16:29.800325 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-b03360f0-a70f-4489-bd80-0f1ed722b24e tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:16:29.801436 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-b03360f0-a70f-4489-bd80-0f1ed722b24e tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/90c53d4c-080d-4d25-a3eb-50c92e83f38c" status: 200 len: 1284 microversion: 2.20 time: 0.080732 Nov 09 20:16:29.801976 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 559/1090] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:16:29 2021] GET /compute/v2.1/servers/90c53d4c-080d-4d25-a3eb-50c92e83f38c => generated 1284 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:16:29.979718 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-1478bc3a-d2f6-4378-a407-28f8f32b37f9 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:16:29.980676 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-1478bc3a-d2f6-4378-a407-28f8f32b37f9 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:16:29.986538 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1478bc3a-d2f6-4378-a407-28f8f32b37f9 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:29.986976 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1478bc3a-d2f6-4378-a407-28f8f32b37f9 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:29.987738 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1478bc3a-d2f6-4378-a407-28f8f32b37f9 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:29.988162 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1478bc3a-d2f6-4378-a407-28f8f32b37f9 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:30.017480 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-1478bc3a-d2f6-4378-a407-28f8f32b37f9 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041475 Nov 09 20:16:30.018035 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 532/1091] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:16:29 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:16:30.406300 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-c49813d1-d3ad-4b98-89f7-a560dcc58a69 tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:16:30.406915 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-c49813d1-d3ad-4b98-89f7-a560dcc58a69 tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] [instance: dd766376-8156-40fd-b5e3-78b38e646c6b] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:16:30.412535 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c49813d1-d3ad-4b98-89f7-a560dcc58a69 tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:30.412975 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c49813d1-d3ad-4b98-89f7-a560dcc58a69 tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:30.413731 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c49813d1-d3ad-4b98-89f7-a560dcc58a69 tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:30.414154 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c49813d1-d3ad-4b98-89f7-a560dcc58a69 tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:30.563513 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-c49813d1-d3ad-4b98-89f7-a560dcc58a69 tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6c68b3aef547a6b583c25f6e63beb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f02e47d7b7453f84fd8dd3881d1329', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:16:30.570589 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-c49813d1-d3ad-4b98-89f7-a560dcc58a69 tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] 10.222.0.25 "GET /compute/v2.1/servers/dd766376-8156-40fd-b5e3-78b38e646c6b" status: 200 len: 1358 microversion: 2.1 time: 0.167928 Nov 09 20:16:30.571148 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 560/1092] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:16:30 2021] GET /compute/v2.1/servers/dd766376-8156-40fd-b5e3-78b38e646c6b => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:16:30.819708 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-6af79520-eb87-4955-b1ea-24f958a745d5 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:16:30.822938 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-6af79520-eb87-4955-b1ea-24f958a745d5 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: 90c53d4c-080d-4d25-a3eb-50c92e83f38c] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:16:30.829554 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6af79520-eb87-4955-b1ea-24f958a745d5 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:30.830115 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6af79520-eb87-4955-b1ea-24f958a745d5 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:30.830931 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6af79520-eb87-4955-b1ea-24f958a745d5 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:30.831368 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6af79520-eb87-4955-b1ea-24f958a745d5 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:30.899183 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-6af79520-eb87-4955-b1ea-24f958a745d5 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:16:30.908999 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-6af79520-eb87-4955-b1ea-24f958a745d5 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:16:30.910757 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-6af79520-eb87-4955-b1ea-24f958a745d5 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:16:30.912086 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-6af79520-eb87-4955-b1ea-24f958a745d5 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/90c53d4c-080d-4d25-a3eb-50c92e83f38c" status: 200 len: 1340 microversion: 2.20 time: 0.096708 Nov 09 20:16:30.913325 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 533/1093] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:16:30 2021] GET /compute/v2.1/servers/90c53d4c-080d-4d25-a3eb-50c92e83f38c => generated 1340 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:16:30.992542 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [req-41f771d2-d974-4c36-8fe4-8af893f1f973 req-dd156782-aa3c-4089-900d-279c308be46a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd766376-8156-40fd-b5e3-78b38e646c6b", "tag": "59519f60-a468-440d-994e-53e9e3436175"}]} {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:16:30.994726 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 20:16:30.994726 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: warnings.warn(msg) Nov 09 20:16:31.003154 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [req-41f771d2-d974-4c36-8fe4-8af893f1f973 req-dd156782-aa3c-4089-900d-279c308be46a service nova] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:31.003583 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [req-41f771d2-d974-4c36-8fe4-8af893f1f973 req-dd156782-aa3c-4089-900d-279c308be46a service nova] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:31.015396 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.compute.server_external_events [req-41f771d2-d974-4c36-8fe4-8af893f1f973 req-dd156782-aa3c-4089-900d-279c308be46a service nova] Creating event network-changed:59519f60-a468-440d-994e-53e9e3436175 for instance dd766376-8156-40fd-b5e3-78b38e646c6b on hv-cinder-80135 Nov 09 20:16:31.020652 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [req-41f771d2-d974-4c36-8fe4-8af893f1f973 req-dd156782-aa3c-4089-900d-279c308be46a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099860 Nov 09 20:16:31.021579 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 561/1094] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Nov 9 20:16:30 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:16:31.030195 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-362e68b1-8709-44e1-9375-ab6822c23d0e tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:16:31.031909 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-362e68b1-8709-44e1-9375-ab6822c23d0e tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:16:31.038932 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-362e68b1-8709-44e1-9375-ab6822c23d0e tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:31.039732 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-362e68b1-8709-44e1-9375-ab6822c23d0e tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:31.040962 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-362e68b1-8709-44e1-9375-ab6822c23d0e tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:31.041699 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-362e68b1-8709-44e1-9375-ab6822c23d0e tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:31.077618 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-362e68b1-8709-44e1-9375-ab6822c23d0e tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052608 Nov 09 20:16:31.082365 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 534/1095] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:16:31 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:16:31.588831 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-e79efa23-4d53-43d5-84e3-d79697a3acf8 tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:16:31.589530 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-e79efa23-4d53-43d5-84e3-d79697a3acf8 tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] [instance: dd766376-8156-40fd-b5e3-78b38e646c6b] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:16:31.595518 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e79efa23-4d53-43d5-84e3-d79697a3acf8 tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:31.595965 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e79efa23-4d53-43d5-84e3-d79697a3acf8 tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:31.596767 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e79efa23-4d53-43d5-84e3-d79697a3acf8 tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:31.597203 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e79efa23-4d53-43d5-84e3-d79697a3acf8 tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:31.732826 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-e79efa23-4d53-43d5-84e3-d79697a3acf8 tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6c68b3aef547a6b583c25f6e63beb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f02e47d7b7453f84fd8dd3881d1329', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:16:31.740220 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-e79efa23-4d53-43d5-84e3-d79697a3acf8 tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] 10.222.0.25 "GET /compute/v2.1/servers/dd766376-8156-40fd-b5e3-78b38e646c6b" status: 200 len: 1358 microversion: 2.1 time: 0.155977 Nov 09 20:16:31.742344 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 562/1096] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:16:31 2021] GET /compute/v2.1/servers/dd766376-8156-40fd-b5e3-78b38e646c6b => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:16:31.930473 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-8e56aa24-89c0-4838-aa61-38ac14dc6341 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:16:31.931083 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-8e56aa24-89c0-4838-aa61-38ac14dc6341 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: 90c53d4c-080d-4d25-a3eb-50c92e83f38c] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:16:31.937977 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8e56aa24-89c0-4838-aa61-38ac14dc6341 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:31.938486 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8e56aa24-89c0-4838-aa61-38ac14dc6341 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:31.939326 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8e56aa24-89c0-4838-aa61-38ac14dc6341 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:31.939821 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8e56aa24-89c0-4838-aa61-38ac14dc6341 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:32.082620 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-8e56aa24-89c0-4838-aa61-38ac14dc6341 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:16:32.090755 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-29cfba80-b111-4550-af47-aa931d1c6d26 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:16:32.091702 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-29cfba80-b111-4550-af47-aa931d1c6d26 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:16:32.092053 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-8e56aa24-89c0-4838-aa61-38ac14dc6341 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:16:32.093708 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-8e56aa24-89c0-4838-aa61-38ac14dc6341 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:16:32.098417 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-8e56aa24-89c0-4838-aa61-38ac14dc6341 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/90c53d4c-080d-4d25-a3eb-50c92e83f38c" status: 200 len: 1404 microversion: 2.20 time: 0.171652 Nov 09 20:16:32.099131 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 535/1097] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:16:31 2021] GET /compute/v2.1/servers/90c53d4c-080d-4d25-a3eb-50c92e83f38c => generated 1404 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:16:32.104622 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-29cfba80-b111-4550-af47-aa931d1c6d26 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:32.104622 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-29cfba80-b111-4550-af47-aa931d1c6d26 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:32.104622 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-29cfba80-b111-4550-af47-aa931d1c6d26 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:32.104622 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-29cfba80-b111-4550-af47-aa931d1c6d26 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:32.139356 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-29cfba80-b111-4550-af47-aa931d1c6d26 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053431 Nov 09 20:16:32.140097 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 563/1098] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:16:32 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:16:32.757494 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-a47166ca-045e-4686-9a94-fb7cbdda8885 tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:16:32.758098 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-a47166ca-045e-4686-9a94-fb7cbdda8885 tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] [instance: dd766376-8156-40fd-b5e3-78b38e646c6b] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:16:32.764450 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a47166ca-045e-4686-9a94-fb7cbdda8885 tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:32.764903 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a47166ca-045e-4686-9a94-fb7cbdda8885 tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:32.765674 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a47166ca-045e-4686-9a94-fb7cbdda8885 tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:32.766106 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a47166ca-045e-4686-9a94-fb7cbdda8885 tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:32.894722 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-a47166ca-045e-4686-9a94-fb7cbdda8885 tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6c68b3aef547a6b583c25f6e63beb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f02e47d7b7453f84fd8dd3881d1329', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:16:32.902137 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-a47166ca-045e-4686-9a94-fb7cbdda8885 tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] 10.222.0.25 "GET /compute/v2.1/servers/dd766376-8156-40fd-b5e3-78b38e646c6b" status: 200 len: 1358 microversion: 2.1 time: 0.148394 Nov 09 20:16:32.902794 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 536/1099] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:16:32 2021] GET /compute/v2.1/servers/dd766376-8156-40fd-b5e3-78b38e646c6b => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:16:33.117126 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-fa84bf30-c477-481b-b5e7-932af02993d1 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:16:33.117800 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-fa84bf30-c477-481b-b5e7-932af02993d1 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: 90c53d4c-080d-4d25-a3eb-50c92e83f38c] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:16:33.126825 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-fa84bf30-c477-481b-b5e7-932af02993d1 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:33.127357 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-fa84bf30-c477-481b-b5e7-932af02993d1 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:33.128249 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-fa84bf30-c477-481b-b5e7-932af02993d1 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:33.128780 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-fa84bf30-c477-481b-b5e7-932af02993d1 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:33.150975 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-086eb4c0-80b5-4317-99ec-ee1308c0a089 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:16:33.153409 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-086eb4c0-80b5-4317-99ec-ee1308c0a089 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:16:33.159781 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-086eb4c0-80b5-4317-99ec-ee1308c0a089 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:33.160794 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-086eb4c0-80b5-4317-99ec-ee1308c0a089 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:33.179657 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-086eb4c0-80b5-4317-99ec-ee1308c0a089 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:33.183343 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-086eb4c0-80b5-4317-99ec-ee1308c0a089 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:33.249263 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-086eb4c0-80b5-4317-99ec-ee1308c0a089 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.102199 Nov 09 20:16:33.250448 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 537/1100] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:16:33 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 20:16:33.255532 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [req-1f2f4a5e-6e4a-4ecd-b1ae-3993b318ee62 req-1f9ce2d3-068b-4a9d-becf-dd5d9ba44326 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90c53d4c-080d-4d25-a3eb-50c92e83f38c", "tag": "5b6cdcb9-1700-444f-a78d-dd1966ee5647"}]} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:16:33.257144 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 20:16:33.257144 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: warnings.warn(msg) Nov 09 20:16:33.274556 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-1f2f4a5e-6e4a-4ecd-b1ae-3993b318ee62 req-1f9ce2d3-068b-4a9d-becf-dd5d9ba44326 service nova] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:33.279993 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-1f2f4a5e-6e4a-4ecd-b1ae-3993b318ee62 req-1f9ce2d3-068b-4a9d-becf-dd5d9ba44326 service nova] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:33.294542 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.compute.server_external_events [req-1f2f4a5e-6e4a-4ecd-b1ae-3993b318ee62 req-1f9ce2d3-068b-4a9d-becf-dd5d9ba44326 service nova] Creating event network-changed:5b6cdcb9-1700-444f-a78d-dd1966ee5647 for instance 90c53d4c-080d-4d25-a3eb-50c92e83f38c on hv-cinder-80135 Nov 09 20:16:33.301311 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [req-1f2f4a5e-6e4a-4ecd-b1ae-3993b318ee62 req-1f9ce2d3-068b-4a9d-becf-dd5d9ba44326 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049440 Nov 09 20:16:33.302146 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 538/1101] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Nov 9 20:16:33 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:16:33.308491 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-fa84bf30-c477-481b-b5e7-932af02993d1 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:16:33.317534 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-fa84bf30-c477-481b-b5e7-932af02993d1 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:16:33.319167 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-fa84bf30-c477-481b-b5e7-932af02993d1 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:16:33.320453 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-fa84bf30-c477-481b-b5e7-932af02993d1 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/90c53d4c-080d-4d25-a3eb-50c92e83f38c" status: 200 len: 1404 microversion: 2.20 time: 0.207019 Nov 09 20:16:33.321083 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 564/1102] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:16:33 2021] GET /compute/v2.1/servers/90c53d4c-080d-4d25-a3eb-50c92e83f38c => generated 1404 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:16:33.920412 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-c875115d-c9a1-4515-a5ea-4d9247b962fc tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:16:33.921221 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-c875115d-c9a1-4515-a5ea-4d9247b962fc tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] [instance: dd766376-8156-40fd-b5e3-78b38e646c6b] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:16:33.927327 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c875115d-c9a1-4515-a5ea-4d9247b962fc tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:33.927772 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c875115d-c9a1-4515-a5ea-4d9247b962fc tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:33.928566 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c875115d-c9a1-4515-a5ea-4d9247b962fc tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:33.928997 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c875115d-c9a1-4515-a5ea-4d9247b962fc tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:34.064011 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-c875115d-c9a1-4515-a5ea-4d9247b962fc tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6c68b3aef547a6b583c25f6e63beb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f02e47d7b7453f84fd8dd3881d1329', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:16:34.071238 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-c875115d-c9a1-4515-a5ea-4d9247b962fc tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] 10.222.0.25 "GET /compute/v2.1/servers/dd766376-8156-40fd-b5e3-78b38e646c6b" status: 200 len: 1358 microversion: 2.1 time: 0.155177 Nov 09 20:16:34.072301 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 539/1103] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:16:33 2021] GET /compute/v2.1/servers/dd766376-8156-40fd-b5e3-78b38e646c6b => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:16:34.261850 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-b8f1494f-c9a0-4049-85b3-2d9ee3e4143f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:16:34.262717 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-b8f1494f-c9a0-4049-85b3-2d9ee3e4143f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:16:34.269099 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b8f1494f-c9a0-4049-85b3-2d9ee3e4143f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:34.269614 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b8f1494f-c9a0-4049-85b3-2d9ee3e4143f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:34.270387 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b8f1494f-c9a0-4049-85b3-2d9ee3e4143f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:34.271182 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b8f1494f-c9a0-4049-85b3-2d9ee3e4143f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:34.302064 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-b8f1494f-c9a0-4049-85b3-2d9ee3e4143f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044824 Nov 09 20:16:34.302639 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 565/1104] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:16:34 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:16:34.338757 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-7ff3f0a1-6f09-4789-9b10-ab46be9d1020 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:16:34.339358 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-7ff3f0a1-6f09-4789-9b10-ab46be9d1020 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: 90c53d4c-080d-4d25-a3eb-50c92e83f38c] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:16:34.345227 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7ff3f0a1-6f09-4789-9b10-ab46be9d1020 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:34.345671 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7ff3f0a1-6f09-4789-9b10-ab46be9d1020 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:34.346438 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7ff3f0a1-6f09-4789-9b10-ab46be9d1020 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:34.346865 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7ff3f0a1-6f09-4789-9b10-ab46be9d1020 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:34.475853 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-7ff3f0a1-6f09-4789-9b10-ab46be9d1020 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:16:34.484008 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-7ff3f0a1-6f09-4789-9b10-ab46be9d1020 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:16:34.485519 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-7ff3f0a1-6f09-4789-9b10-ab46be9d1020 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:16:34.486618 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-7ff3f0a1-6f09-4789-9b10-ab46be9d1020 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/90c53d4c-080d-4d25-a3eb-50c92e83f38c" status: 200 len: 1404 microversion: 2.20 time: 0.151572 Nov 09 20:16:34.487176 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 540/1105] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:16:34 2021] GET /compute/v2.1/servers/90c53d4c-080d-4d25-a3eb-50c92e83f38c => generated 1404 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:16:35.088762 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-c38bae55-f9ec-4c86-8828-2115e2d0de30 tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:16:35.089399 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-c38bae55-f9ec-4c86-8828-2115e2d0de30 tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] [instance: dd766376-8156-40fd-b5e3-78b38e646c6b] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:16:35.095149 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c38bae55-f9ec-4c86-8828-2115e2d0de30 tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:35.095599 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c38bae55-f9ec-4c86-8828-2115e2d0de30 tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:35.096376 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c38bae55-f9ec-4c86-8828-2115e2d0de30 tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:35.096833 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c38bae55-f9ec-4c86-8828-2115e2d0de30 tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:35.226406 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-c38bae55-f9ec-4c86-8828-2115e2d0de30 tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6c68b3aef547a6b583c25f6e63beb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f02e47d7b7453f84fd8dd3881d1329', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:16:35.234913 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-c38bae55-f9ec-4c86-8828-2115e2d0de30 tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] 10.222.0.25 "GET /compute/v2.1/servers/dd766376-8156-40fd-b5e3-78b38e646c6b" status: 200 len: 1358 microversion: 2.1 time: 0.150357 Nov 09 20:16:35.235476 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 566/1106] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:16:35 2021] GET /compute/v2.1/servers/dd766376-8156-40fd-b5e3-78b38e646c6b => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:16:35.313428 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-89b1c171-9784-4120-9bbb-1d3f28f82017 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:16:35.314359 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-89b1c171-9784-4120-9bbb-1d3f28f82017 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:16:35.320105 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-89b1c171-9784-4120-9bbb-1d3f28f82017 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:35.320585 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-89b1c171-9784-4120-9bbb-1d3f28f82017 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:35.321350 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-89b1c171-9784-4120-9bbb-1d3f28f82017 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:35.321880 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-89b1c171-9784-4120-9bbb-1d3f28f82017 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:35.352473 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-89b1c171-9784-4120-9bbb-1d3f28f82017 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042751 Nov 09 20:16:35.354070 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 541/1107] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:16:35 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:16:35.504793 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-48f20536-4883-4a82-9274-be1885940ba0 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:16:35.505400 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-48f20536-4883-4a82-9274-be1885940ba0 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: 90c53d4c-080d-4d25-a3eb-50c92e83f38c] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:16:35.512299 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-48f20536-4883-4a82-9274-be1885940ba0 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:35.512771 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-48f20536-4883-4a82-9274-be1885940ba0 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:35.513535 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-48f20536-4883-4a82-9274-be1885940ba0 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:35.513966 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-48f20536-4883-4a82-9274-be1885940ba0 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:35.642307 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-48f20536-4883-4a82-9274-be1885940ba0 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:16:35.650492 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-48f20536-4883-4a82-9274-be1885940ba0 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:16:35.652340 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-48f20536-4883-4a82-9274-be1885940ba0 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:16:35.653463 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-48f20536-4883-4a82-9274-be1885940ba0 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/90c53d4c-080d-4d25-a3eb-50c92e83f38c" status: 200 len: 1404 microversion: 2.20 time: 0.152315 Nov 09 20:16:35.654014 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 567/1108] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:16:35 2021] GET /compute/v2.1/servers/90c53d4c-080d-4d25-a3eb-50c92e83f38c => generated 1404 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:16:36.250984 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-d579e81b-cd94-4bca-829f-8874842263e0 tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:16:36.251590 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-d579e81b-cd94-4bca-829f-8874842263e0 tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] [instance: dd766376-8156-40fd-b5e3-78b38e646c6b] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:16:36.257364 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d579e81b-cd94-4bca-829f-8874842263e0 tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:36.257811 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d579e81b-cd94-4bca-829f-8874842263e0 tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:36.258583 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d579e81b-cd94-4bca-829f-8874842263e0 tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:36.259015 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d579e81b-cd94-4bca-829f-8874842263e0 tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:36.365106 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-851af36a-4a0a-4422-8ba3-1f45152f7551 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:16:36.366222 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-851af36a-4a0a-4422-8ba3-1f45152f7551 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:16:36.373294 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-851af36a-4a0a-4422-8ba3-1f45152f7551 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:36.373769 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-851af36a-4a0a-4422-8ba3-1f45152f7551 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:36.374618 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-851af36a-4a0a-4422-8ba3-1f45152f7551 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:36.375117 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-851af36a-4a0a-4422-8ba3-1f45152f7551 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:36.390415 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-d579e81b-cd94-4bca-829f-8874842263e0 tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6c68b3aef547a6b583c25f6e63beb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f02e47d7b7453f84fd8dd3881d1329', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:16:36.398435 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-d579e81b-cd94-4bca-829f-8874842263e0 tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] 10.222.0.25 "GET /compute/v2.1/servers/dd766376-8156-40fd-b5e3-78b38e646c6b" status: 200 len: 1358 microversion: 2.1 time: 0.151132 Nov 09 20:16:36.408902 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 542/1109] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:16:36 2021] GET /compute/v2.1/servers/dd766376-8156-40fd-b5e3-78b38e646c6b => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:16:36.416173 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-851af36a-4a0a-4422-8ba3-1f45152f7551 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054060 Nov 09 20:16:36.417299 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 568/1110] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:16:36 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:16:36.658249 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [req-ad6d078b-f67b-4b4f-8735-07301c6a65a2 req-06f78008-ad8c-4b16-9d4b-80346ad8c8c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd766376-8156-40fd-b5e3-78b38e646c6b", "name": "network-vif-plugged", "status": "completed", "tag": "59519f60-a468-440d-994e-53e9e3436175"}]} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:16:36.659789 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 20:16:36.659789 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: warnings.warn(msg) Nov 09 20:16:36.667456 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-ad6d078b-f67b-4b4f-8735-07301c6a65a2 req-06f78008-ad8c-4b16-9d4b-80346ad8c8c8 service nova] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:36.667912 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-ad6d078b-f67b-4b4f-8735-07301c6a65a2 req-06f78008-ad8c-4b16-9d4b-80346ad8c8c8 service nova] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:36.672496 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-933a381d-09e8-4fa6-8816-2cd3206b3154 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:16:36.673205 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-933a381d-09e8-4fa6-8816-2cd3206b3154 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: 90c53d4c-080d-4d25-a3eb-50c92e83f38c] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:16:36.679791 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-933a381d-09e8-4fa6-8816-2cd3206b3154 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:36.680335 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-933a381d-09e8-4fa6-8816-2cd3206b3154 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:36.681283 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-933a381d-09e8-4fa6-8816-2cd3206b3154 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:36.681815 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-933a381d-09e8-4fa6-8816-2cd3206b3154 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:36.687034 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.compute.server_external_events [req-ad6d078b-f67b-4b4f-8735-07301c6a65a2 req-06f78008-ad8c-4b16-9d4b-80346ad8c8c8 service nova] Creating event network-vif-plugged:59519f60-a468-440d-994e-53e9e3436175 for instance dd766376-8156-40fd-b5e3-78b38e646c6b on hv-cinder-80135 Nov 09 20:16:36.692892 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [req-ad6d078b-f67b-4b4f-8735-07301c6a65a2 req-06f78008-ad8c-4b16-9d4b-80346ad8c8c8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098581 Nov 09 20:16:36.693766 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 543/1111] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Nov 9 20:16:36 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 20:16:36.822003 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-933a381d-09e8-4fa6-8816-2cd3206b3154 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:16:36.830053 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-933a381d-09e8-4fa6-8816-2cd3206b3154 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:16:36.832012 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-933a381d-09e8-4fa6-8816-2cd3206b3154 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:16:36.833147 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-933a381d-09e8-4fa6-8816-2cd3206b3154 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/90c53d4c-080d-4d25-a3eb-50c92e83f38c" status: 200 len: 1404 microversion: 2.20 time: 0.164634 Nov 09 20:16:36.833705 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 569/1112] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:16:36 2021] GET /compute/v2.1/servers/90c53d4c-080d-4d25-a3eb-50c92e83f38c => generated 1404 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 09 20:16:37.415937 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-028ac744-3f15-4b4c-88d5-78fda882785c tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:16:37.416656 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-028ac744-3f15-4b4c-88d5-78fda882785c tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] [instance: dd766376-8156-40fd-b5e3-78b38e646c6b] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:16:37.422692 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-028ac744-3f15-4b4c-88d5-78fda882785c tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:37.423137 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-028ac744-3f15-4b4c-88d5-78fda882785c tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:37.423904 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-028ac744-3f15-4b4c-88d5-78fda882785c tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:37.424334 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-028ac744-3f15-4b4c-88d5-78fda882785c tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:37.427035 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-d7800a7f-10d8-47a5-a06c-ac9751951f8c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:16:37.427945 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-d7800a7f-10d8-47a5-a06c-ac9751951f8c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:16:37.434750 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d7800a7f-10d8-47a5-a06c-ac9751951f8c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:37.435200 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d7800a7f-10d8-47a5-a06c-ac9751951f8c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:37.435976 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d7800a7f-10d8-47a5-a06c-ac9751951f8c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:37.436419 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d7800a7f-10d8-47a5-a06c-ac9751951f8c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:37.467346 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-d7800a7f-10d8-47a5-a06c-ac9751951f8c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043954 Nov 09 20:16:37.470136 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 570/1113] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:16:37 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 20:16:37.555389 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-028ac744-3f15-4b4c-88d5-78fda882785c tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6c68b3aef547a6b583c25f6e63beb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f02e47d7b7453f84fd8dd3881d1329', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:16:37.563103 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-028ac744-3f15-4b4c-88d5-78fda882785c tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] 10.222.0.25 "GET /compute/v2.1/servers/dd766376-8156-40fd-b5e3-78b38e646c6b" status: 200 len: 1358 microversion: 2.1 time: 0.151677 Nov 09 20:16:37.563667 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 544/1114] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:16:37 2021] GET /compute/v2.1/servers/dd766376-8156-40fd-b5e3-78b38e646c6b => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:16:37.852002 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-3a9b5fef-c5db-42a5-bc98-b41b26029c46 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:16:37.852690 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-3a9b5fef-c5db-42a5-bc98-b41b26029c46 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: 90c53d4c-080d-4d25-a3eb-50c92e83f38c] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:16:37.859646 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-3a9b5fef-c5db-42a5-bc98-b41b26029c46 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:37.860092 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-3a9b5fef-c5db-42a5-bc98-b41b26029c46 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:37.860892 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-3a9b5fef-c5db-42a5-bc98-b41b26029c46 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:37.861321 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-3a9b5fef-c5db-42a5-bc98-b41b26029c46 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:37.990189 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-3a9b5fef-c5db-42a5-bc98-b41b26029c46 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:16:37.998487 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-3a9b5fef-c5db-42a5-bc98-b41b26029c46 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:16:37.999974 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-3a9b5fef-c5db-42a5-bc98-b41b26029c46 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:16:38.001090 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-3a9b5fef-c5db-42a5-bc98-b41b26029c46 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/90c53d4c-080d-4d25-a3eb-50c92e83f38c" status: 200 len: 1404 microversion: 2.20 time: 0.152820 Nov 09 20:16:38.001650 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 571/1115] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:16:37 2021] GET /compute/v2.1/servers/90c53d4c-080d-4d25-a3eb-50c92e83f38c => generated 1404 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:16:38.477943 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-05be20d3-e64c-4e59-8201-f8dac4de6ac3 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:16:38.478862 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-05be20d3-e64c-4e59-8201-f8dac4de6ac3 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:16:38.485308 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-05be20d3-e64c-4e59-8201-f8dac4de6ac3 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:38.485762 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-05be20d3-e64c-4e59-8201-f8dac4de6ac3 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:38.486543 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-05be20d3-e64c-4e59-8201-f8dac4de6ac3 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:38.486980 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-05be20d3-e64c-4e59-8201-f8dac4de6ac3 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:38.519705 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-05be20d3-e64c-4e59-8201-f8dac4de6ac3 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045584 Nov 09 20:16:38.523449 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 545/1116] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:16:38 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:16:38.580144 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-09c2cb58-d5ce-4ef8-8349-941de4abfaa9 tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:16:38.580857 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-09c2cb58-d5ce-4ef8-8349-941de4abfaa9 tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] [instance: dd766376-8156-40fd-b5e3-78b38e646c6b] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:16:38.586707 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-09c2cb58-d5ce-4ef8-8349-941de4abfaa9 tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:38.587155 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-09c2cb58-d5ce-4ef8-8349-941de4abfaa9 tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:38.588500 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-09c2cb58-d5ce-4ef8-8349-941de4abfaa9 tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:38.588937 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-09c2cb58-d5ce-4ef8-8349-941de4abfaa9 tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:38.707513 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [req-77445642-2286-4353-a1ff-127de2f39b76 req-03be444c-81fb-48d1-b97c-4f91456c2ab3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90c53d4c-080d-4d25-a3eb-50c92e83f38c", "name": "network-vif-plugged", "status": "completed", "tag": "5b6cdcb9-1700-444f-a78d-dd1966ee5647"}]} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:16:38.709165 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 20:16:38.709165 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: warnings.warn(msg) Nov 09 20:16:38.715741 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-09c2cb58-d5ce-4ef8-8349-941de4abfaa9 tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6c68b3aef547a6b583c25f6e63beb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f02e47d7b7453f84fd8dd3881d1329', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:16:38.716746 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-77445642-2286-4353-a1ff-127de2f39b76 req-03be444c-81fb-48d1-b97c-4f91456c2ab3 service nova] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:38.717179 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-77445642-2286-4353-a1ff-127de2f39b76 req-03be444c-81fb-48d1-b97c-4f91456c2ab3 service nova] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:38.722941 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-09c2cb58-d5ce-4ef8-8349-941de4abfaa9 tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] 10.222.0.25 "GET /compute/v2.1/servers/dd766376-8156-40fd-b5e3-78b38e646c6b" status: 200 len: 1549 microversion: 2.1 time: 0.146352 Nov 09 20:16:38.723511 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 572/1117] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:16:38 2021] GET /compute/v2.1/servers/dd766376-8156-40fd-b5e3-78b38e646c6b => generated 1549 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:16:38.728060 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.compute.server_external_events [req-77445642-2286-4353-a1ff-127de2f39b76 req-03be444c-81fb-48d1-b97c-4f91456c2ab3 service nova] Creating event network-vif-plugged:5b6cdcb9-1700-444f-a78d-dd1966ee5647 for instance 90c53d4c-080d-4d25-a3eb-50c92e83f38c on hv-cinder-80135 Nov 09 20:16:38.733497 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [req-77445642-2286-4353-a1ff-127de2f39b76 req-03be444c-81fb-48d1-b97c-4f91456c2ab3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029566 Nov 09 20:16:38.734172 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 546/1118] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Nov 9 20:16:38 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:16:38.738526 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-e68f2ca8-837a-4b40-8f2e-63a1b3b20a3d tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:16:38.739124 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-e68f2ca8-837a-4b40-8f2e-63a1b3b20a3d tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] [instance: dd766376-8156-40fd-b5e3-78b38e646c6b] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:16:38.745398 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e68f2ca8-837a-4b40-8f2e-63a1b3b20a3d tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:38.745833 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e68f2ca8-837a-4b40-8f2e-63a1b3b20a3d tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:38.746594 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e68f2ca8-837a-4b40-8f2e-63a1b3b20a3d tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:38.747014 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e68f2ca8-837a-4b40-8f2e-63a1b3b20a3d tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:38.885842 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-e68f2ca8-837a-4b40-8f2e-63a1b3b20a3d tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6c68b3aef547a6b583c25f6e63beb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f02e47d7b7453f84fd8dd3881d1329', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:16:38.893077 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-e68f2ca8-837a-4b40-8f2e-63a1b3b20a3d tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] 10.222.0.25 "GET /compute/v2.1/servers/dd766376-8156-40fd-b5e3-78b38e646c6b" status: 200 len: 1549 microversion: 2.1 time: 0.157954 Nov 09 20:16:38.893896 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 573/1119] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:16:38 2021] GET /compute/v2.1/servers/dd766376-8156-40fd-b5e3-78b38e646c6b => generated 1549 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 20:16:38.909471 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-344a7e2b-645f-4c51-a572-63ac40d00f55 tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:16:38.913173 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 20:16:38.913173 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: warnings.warn(msg) Nov 09 20:16:38.913690 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-344a7e2b-645f-4c51-a572-63ac40d00f55 tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fe6c68b3aef547a6b583c25f6e63beb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f02e47d7b7453f84fd8dd3881d1329', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:16:38.914513 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-344a7e2b-645f-4c51-a572-63ac40d00f55 tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] Searching by: {'deleted': False, 'project_id': 'd9f02e47d7b7453f84fd8dd3881d1329'} {{(pid=116103) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 09 20:16:38.921338 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-344a7e2b-645f-4c51-a572-63ac40d00f55 tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:38.921786 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-344a7e2b-645f-4c51-a572-63ac40d00f55 tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:38.922617 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-344a7e2b-645f-4c51-a572-63ac40d00f55 tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:38.923050 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-344a7e2b-645f-4c51-a572-63ac40d00f55 tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:39.019157 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-41085771-4d14-4a0b-86cf-661b41a36cbd tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:16:39.019756 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-41085771-4d14-4a0b-86cf-661b41a36cbd tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: 90c53d4c-080d-4d25-a3eb-50c92e83f38c] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:16:39.023775 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.multi_cell_list [None req-344a7e2b-645f-4c51-a572-63ac40d00f55 tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=116103) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 09 20:16:39.026056 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-41085771-4d14-4a0b-86cf-661b41a36cbd tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:39.026525 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-41085771-4d14-4a0b-86cf-661b41a36cbd tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:39.027329 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-41085771-4d14-4a0b-86cf-661b41a36cbd tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:39.027757 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-41085771-4d14-4a0b-86cf-661b41a36cbd tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:39.121183 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-344a7e2b-645f-4c51-a572-63ac40d00f55 tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] 10.222.0.25 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.215571 Nov 09 20:16:39.121984 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 547/1120] 10.222.0.25 () {58 vars in 1124 bytes} [Tue Nov 9 20:16:38 2021] GET /compute/v2.1/servers => generated 343 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:16:39.132027 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-a93e134f-ceb0-4b52-a80b-fa8156aea649 tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:16:39.132808 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-a93e134f-ceb0-4b52-a80b-fa8156aea649 tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] [instance: dd766376-8156-40fd-b5e3-78b38e646c6b] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:16:39.139340 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a93e134f-ceb0-4b52-a80b-fa8156aea649 tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:39.139789 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a93e134f-ceb0-4b52-a80b-fa8156aea649 tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:39.140602 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a93e134f-ceb0-4b52-a80b-fa8156aea649 tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:39.141035 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a93e134f-ceb0-4b52-a80b-fa8156aea649 tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:39.162667 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-41085771-4d14-4a0b-86cf-661b41a36cbd tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:16:39.171520 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-41085771-4d14-4a0b-86cf-661b41a36cbd tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:16:39.173080 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-41085771-4d14-4a0b-86cf-661b41a36cbd tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:16:39.174180 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-41085771-4d14-4a0b-86cf-661b41a36cbd tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/90c53d4c-080d-4d25-a3eb-50c92e83f38c" status: 200 len: 1404 microversion: 2.20 time: 0.158785 Nov 09 20:16:39.174739 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 574/1121] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:16:39 2021] GET /compute/v2.1/servers/90c53d4c-080d-4d25-a3eb-50c92e83f38c => generated 1404 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 09 20:16:39.267318 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-a93e134f-ceb0-4b52-a80b-fa8156aea649 tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6c68b3aef547a6b583c25f6e63beb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f02e47d7b7453f84fd8dd3881d1329', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:16:39.274525 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-a93e134f-ceb0-4b52-a80b-fa8156aea649 tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] 10.222.0.25 "GET /compute/v2.1/servers/dd766376-8156-40fd-b5e3-78b38e646c6b" status: 200 len: 1549 microversion: 2.1 time: 0.146128 Nov 09 20:16:39.275093 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 548/1122] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:16:39 2021] GET /compute/v2.1/servers/dd766376-8156-40fd-b5e3-78b38e646c6b => generated 1549 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 20:16:39.532073 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-ef00f9bd-8200-4355-b09f-5b886fb4453f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:16:39.533165 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-ef00f9bd-8200-4355-b09f-5b886fb4453f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:16:39.539156 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ef00f9bd-8200-4355-b09f-5b886fb4453f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:39.539678 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ef00f9bd-8200-4355-b09f-5b886fb4453f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:39.541223 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ef00f9bd-8200-4355-b09f-5b886fb4453f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:39.541760 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ef00f9bd-8200-4355-b09f-5b886fb4453f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:39.577860 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-ef00f9bd-8200-4355-b09f-5b886fb4453f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049860 Nov 09 20:16:39.581828 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 575/1123] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:16:39 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:16:40.193106 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-182caed2-b806-42ec-acc6-0c516e49f946 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:16:40.193742 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-182caed2-b806-42ec-acc6-0c516e49f946 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: 90c53d4c-080d-4d25-a3eb-50c92e83f38c] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:16:40.200575 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-182caed2-b806-42ec-acc6-0c516e49f946 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:40.201052 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-182caed2-b806-42ec-acc6-0c516e49f946 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:40.201815 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-182caed2-b806-42ec-acc6-0c516e49f946 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:40.202245 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-182caed2-b806-42ec-acc6-0c516e49f946 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:40.334881 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-182caed2-b806-42ec-acc6-0c516e49f946 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:16:40.343342 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-182caed2-b806-42ec-acc6-0c516e49f946 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:16:40.345197 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-182caed2-b806-42ec-acc6-0c516e49f946 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:16:40.347092 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-182caed2-b806-42ec-acc6-0c516e49f946 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/90c53d4c-080d-4d25-a3eb-50c92e83f38c" status: 200 len: 1597 microversion: 2.20 time: 0.157566 Nov 09 20:16:40.347660 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 549/1124] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:16:40 2021] GET /compute/v2.1/servers/90c53d4c-080d-4d25-a3eb-50c92e83f38c => generated 1597 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:16:40.365679 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-63548a98-e0ce-470b-ae82-0e2291b09953 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:16:40.366208 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-63548a98-e0ce-470b-ae82-0e2291b09953 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: 90c53d4c-080d-4d25-a3eb-50c92e83f38c] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:16:40.372814 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-63548a98-e0ce-470b-ae82-0e2291b09953 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:40.373251 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-63548a98-e0ce-470b-ae82-0e2291b09953 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:40.374011 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-63548a98-e0ce-470b-ae82-0e2291b09953 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:40.374439 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-63548a98-e0ce-470b-ae82-0e2291b09953 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:40.452347 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-63548a98-e0ce-470b-ae82-0e2291b09953 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/90c53d4c-080d-4d25-a3eb-50c92e83f38c/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.090452 Nov 09 20:16:40.452999 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 576/1125] 10.222.0.25 () {60 vars in 1315 bytes} [Tue Nov 9 20:16:40 2021] GET /compute/v2.1/servers/90c53d4c-080d-4d25-a3eb-50c92e83f38c/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 20:16:40.590638 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-0afe6d75-5297-4bbe-a668-916f744b2d08 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:16:40.591731 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-0afe6d75-5297-4bbe-a668-916f744b2d08 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:16:40.597504 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0afe6d75-5297-4bbe-a668-916f744b2d08 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:40.598140 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0afe6d75-5297-4bbe-a668-916f744b2d08 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:40.598906 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0afe6d75-5297-4bbe-a668-916f744b2d08 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:40.599332 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0afe6d75-5297-4bbe-a668-916f744b2d08 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:40.628930 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-0afe6d75-5297-4bbe-a668-916f744b2d08 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043222 Nov 09 20:16:40.629491 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 550/1126] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:16:40 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:16:41.092107 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-b59e6123-1e61-43ca-b48a-71d6a5d016a0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:16:41.093038 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-b59e6123-1e61-43ca-b48a-71d6a5d016a0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:16:41.098645 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b59e6123-1e61-43ca-b48a-71d6a5d016a0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:41.099091 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b59e6123-1e61-43ca-b48a-71d6a5d016a0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:41.099858 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b59e6123-1e61-43ca-b48a-71d6a5d016a0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:41.100284 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b59e6123-1e61-43ca-b48a-71d6a5d016a0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:41.128767 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-b59e6123-1e61-43ca-b48a-71d6a5d016a0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040244 Nov 09 20:16:41.129506 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 577/1127] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:16:41 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:16:41.396839 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-fc17ef2e-3b61-470e-aebe-dc41eb3c6c03 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:16:41.397754 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-fc17ef2e-3b61-470e-aebe-dc41eb3c6c03 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: 90c53d4c-080d-4d25-a3eb-50c92e83f38c] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:16:41.400537 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [req-3e0190ec-47b0-428c-8ce1-4faba52362de req-f1807796-ae41-47c0-89a9-fffcd543c2a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90c53d4c-080d-4d25-a3eb-50c92e83f38c", "tag": "5b6cdcb9-1700-444f-a78d-dd1966ee5647"}]} {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:16:41.402635 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 20:16:41.402635 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: warnings.warn(msg) Nov 09 20:16:41.405641 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fc17ef2e-3b61-470e-aebe-dc41eb3c6c03 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:41.406363 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fc17ef2e-3b61-470e-aebe-dc41eb3c6c03 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:41.407153 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fc17ef2e-3b61-470e-aebe-dc41eb3c6c03 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:41.407583 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fc17ef2e-3b61-470e-aebe-dc41eb3c6c03 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:41.409920 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [req-3e0190ec-47b0-428c-8ce1-4faba52362de req-f1807796-ae41-47c0-89a9-fffcd543c2a0 service nova] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:41.410429 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [req-3e0190ec-47b0-428c-8ce1-4faba52362de req-f1807796-ae41-47c0-89a9-fffcd543c2a0 service nova] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:41.421406 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.compute.server_external_events [req-3e0190ec-47b0-428c-8ce1-4faba52362de req-f1807796-ae41-47c0-89a9-fffcd543c2a0 service nova] Creating event network-changed:5b6cdcb9-1700-444f-a78d-dd1966ee5647 for instance 90c53d4c-080d-4d25-a3eb-50c92e83f38c on hv-cinder-80135 Nov 09 20:16:41.426548 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [req-3e0190ec-47b0-428c-8ce1-4faba52362de req-f1807796-ae41-47c0-89a9-fffcd543c2a0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030846 Nov 09 20:16:41.427628 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 578/1128] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Nov 9 20:16:41 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:16:41.471280 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-fc17ef2e-3b61-470e-aebe-dc41eb3c6c03 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "POST /compute/v2.1/servers/90c53d4c-080d-4d25-a3eb-50c92e83f38c/action" status: 200 len: 14 microversion: 2.20 time: 0.078197 Nov 09 20:16:41.472249 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 551/1129] 10.222.0.25 () {62 vars in 1318 bytes} [Tue Nov 9 20:16:41 2021] POST /compute/v2.1/servers/90c53d4c-080d-4d25-a3eb-50c92e83f38c/action => generated 14 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:16:41.642511 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-555582be-dbf0-4e8f-928a-8d63b509c14c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:16:41.644554 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-555582be-dbf0-4e8f-928a-8d63b509c14c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:16:41.653747 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-555582be-dbf0-4e8f-928a-8d63b509c14c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:41.655191 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-555582be-dbf0-4e8f-928a-8d63b509c14c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:41.655981 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-555582be-dbf0-4e8f-928a-8d63b509c14c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:41.656434 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-555582be-dbf0-4e8f-928a-8d63b509c14c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:41.685724 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-555582be-dbf0-4e8f-928a-8d63b509c14c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048243 Nov 09 20:16:41.686879 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 579/1130] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:16:41 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:16:42.142227 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-c928e302-55e2-41b6-9d9c-3194645bf959 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:16:42.143128 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-c928e302-55e2-41b6-9d9c-3194645bf959 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:16:42.150668 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c928e302-55e2-41b6-9d9c-3194645bf959 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:42.151126 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c928e302-55e2-41b6-9d9c-3194645bf959 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:42.151898 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c928e302-55e2-41b6-9d9c-3194645bf959 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:42.152327 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c928e302-55e2-41b6-9d9c-3194645bf959 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:42.183598 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-c928e302-55e2-41b6-9d9c-3194645bf959 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045503 Nov 09 20:16:42.184160 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 552/1131] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:16:42 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:16:42.483370 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-b101d9c0-f725-4022-871f-b49058b6ce0c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:16:42.484185 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-b101d9c0-f725-4022-871f-b49058b6ce0c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: 90c53d4c-080d-4d25-a3eb-50c92e83f38c] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:16:42.490822 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b101d9c0-f725-4022-871f-b49058b6ce0c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:42.491318 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b101d9c0-f725-4022-871f-b49058b6ce0c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:42.492106 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b101d9c0-f725-4022-871f-b49058b6ce0c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:42.492565 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b101d9c0-f725-4022-871f-b49058b6ce0c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:42.554373 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-b101d9c0-f725-4022-871f-b49058b6ce0c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "POST /compute/v2.1/servers/90c53d4c-080d-4d25-a3eb-50c92e83f38c/action" status: 200 len: 14 microversion: 2.20 time: 0.074931 Nov 09 20:16:42.555235 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 580/1132] 10.222.0.25 () {62 vars in 1318 bytes} [Tue Nov 9 20:16:42 2021] POST /compute/v2.1/servers/90c53d4c-080d-4d25-a3eb-50c92e83f38c/action => generated 14 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:16:42.697417 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-31b872bb-6393-4b57-bd7a-b4d120863fe1 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:16:42.698382 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-31b872bb-6393-4b57-bd7a-b4d120863fe1 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:16:42.704710 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-31b872bb-6393-4b57-bd7a-b4d120863fe1 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:42.705148 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-31b872bb-6393-4b57-bd7a-b4d120863fe1 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:42.705913 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-31b872bb-6393-4b57-bd7a-b4d120863fe1 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:42.706341 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-31b872bb-6393-4b57-bd7a-b4d120863fe1 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:42.735835 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-31b872bb-6393-4b57-bd7a-b4d120863fe1 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042187 Nov 09 20:16:42.736337 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 553/1133] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:16:42 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:16:43.195404 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-dc91eaa1-4f35-4e45-b420-a7baf880eb15 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:16:43.196373 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-dc91eaa1-4f35-4e45-b420-a7baf880eb15 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:16:43.204203 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-dc91eaa1-4f35-4e45-b420-a7baf880eb15 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:43.204700 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-dc91eaa1-4f35-4e45-b420-a7baf880eb15 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:43.205475 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-dc91eaa1-4f35-4e45-b420-a7baf880eb15 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:43.205909 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-dc91eaa1-4f35-4e45-b420-a7baf880eb15 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:43.235449 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-dc91eaa1-4f35-4e45-b420-a7baf880eb15 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044083 Nov 09 20:16:43.235993 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 581/1134] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:16:43 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:16:43.565150 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-d9844640-2f18-42c9-b3ab-e24a848e98cd tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:16:43.566052 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-d9844640-2f18-42c9-b3ab-e24a848e98cd tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: 90c53d4c-080d-4d25-a3eb-50c92e83f38c] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:16:43.573012 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d9844640-2f18-42c9-b3ab-e24a848e98cd tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:43.573447 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d9844640-2f18-42c9-b3ab-e24a848e98cd tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:43.574206 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d9844640-2f18-42c9-b3ab-e24a848e98cd tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:43.574630 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d9844640-2f18-42c9-b3ab-e24a848e98cd tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:43.636738 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-d9844640-2f18-42c9-b3ab-e24a848e98cd tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "POST /compute/v2.1/servers/90c53d4c-080d-4d25-a3eb-50c92e83f38c/action" status: 200 len: 14 microversion: 2.20 time: 0.075019 Nov 09 20:16:43.637368 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 554/1135] 10.222.0.25 () {62 vars in 1318 bytes} [Tue Nov 9 20:16:43 2021] POST /compute/v2.1/servers/90c53d4c-080d-4d25-a3eb-50c92e83f38c/action => generated 14 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:16:43.747608 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-0c2a2c14-9359-4590-8255-2aeb74901a7d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:16:43.748539 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-0c2a2c14-9359-4590-8255-2aeb74901a7d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:16:43.754606 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-0c2a2c14-9359-4590-8255-2aeb74901a7d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:43.755041 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-0c2a2c14-9359-4590-8255-2aeb74901a7d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:43.755795 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-0c2a2c14-9359-4590-8255-2aeb74901a7d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:43.756221 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-0c2a2c14-9359-4590-8255-2aeb74901a7d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:43.783672 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-0c2a2c14-9359-4590-8255-2aeb74901a7d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040584 Nov 09 20:16:43.784218 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 582/1136] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:16:43 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:16:44.247672 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-faf00709-0ea1-4efa-a71f-b45c6c820539 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:16:44.248687 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-faf00709-0ea1-4efa-a71f-b45c6c820539 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:16:44.255412 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-faf00709-0ea1-4efa-a71f-b45c6c820539 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:44.255852 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-faf00709-0ea1-4efa-a71f-b45c6c820539 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:44.256632 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-faf00709-0ea1-4efa-a71f-b45c6c820539 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:44.257057 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-faf00709-0ea1-4efa-a71f-b45c6c820539 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:44.287622 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-faf00709-0ea1-4efa-a71f-b45c6c820539 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044199 Nov 09 20:16:44.288168 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 555/1137] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:16:44 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:16:44.647426 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-a695fbe5-6433-475c-a66e-0140ce6183d9 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:16:44.648327 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-a695fbe5-6433-475c-a66e-0140ce6183d9 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: 90c53d4c-080d-4d25-a3eb-50c92e83f38c] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:16:44.655421 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a695fbe5-6433-475c-a66e-0140ce6183d9 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:44.655868 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a695fbe5-6433-475c-a66e-0140ce6183d9 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:44.656667 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a695fbe5-6433-475c-a66e-0140ce6183d9 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:44.657099 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a695fbe5-6433-475c-a66e-0140ce6183d9 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:44.715855 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-a695fbe5-6433-475c-a66e-0140ce6183d9 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "POST /compute/v2.1/servers/90c53d4c-080d-4d25-a3eb-50c92e83f38c/action" status: 200 len: 14 microversion: 2.20 time: 0.071974 Nov 09 20:16:44.716512 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 583/1138] 10.222.0.25 () {62 vars in 1318 bytes} [Tue Nov 9 20:16:44 2021] POST /compute/v2.1/servers/90c53d4c-080d-4d25-a3eb-50c92e83f38c/action => generated 14 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:16:44.794734 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-5bbc620a-6265-411a-afed-a9f81a9268b9 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:16:44.795635 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-5bbc620a-6265-411a-afed-a9f81a9268b9 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:16:44.801705 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5bbc620a-6265-411a-afed-a9f81a9268b9 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:44.802141 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5bbc620a-6265-411a-afed-a9f81a9268b9 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:44.802898 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5bbc620a-6265-411a-afed-a9f81a9268b9 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:44.803322 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5bbc620a-6265-411a-afed-a9f81a9268b9 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:44.832165 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-5bbc620a-6265-411a-afed-a9f81a9268b9 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041042 Nov 09 20:16:44.832744 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 556/1139] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:16:44 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:16:45.299727 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-8d65bfba-8b64-475b-8fbc-67f6f2861fdf tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:16:45.300761 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-8d65bfba-8b64-475b-8fbc-67f6f2861fdf tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:16:45.308596 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-8d65bfba-8b64-475b-8fbc-67f6f2861fdf tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:45.309039 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-8d65bfba-8b64-475b-8fbc-67f6f2861fdf tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:45.309805 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-8d65bfba-8b64-475b-8fbc-67f6f2861fdf tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:45.310235 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-8d65bfba-8b64-475b-8fbc-67f6f2861fdf tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:45.340116 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-8d65bfba-8b64-475b-8fbc-67f6f2861fdf tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044469 Nov 09 20:16:45.340688 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 584/1140] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:16:45 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:16:45.726126 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-3f99fabd-4d02-4213-ae88-948996748ab6 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:16:45.727055 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-3f99fabd-4d02-4213-ae88-948996748ab6 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: 90c53d4c-080d-4d25-a3eb-50c92e83f38c] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:16:45.734009 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3f99fabd-4d02-4213-ae88-948996748ab6 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:45.734447 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3f99fabd-4d02-4213-ae88-948996748ab6 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:45.735203 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3f99fabd-4d02-4213-ae88-948996748ab6 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:45.735625 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3f99fabd-4d02-4213-ae88-948996748ab6 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:45.795252 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-3f99fabd-4d02-4213-ae88-948996748ab6 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "POST /compute/v2.1/servers/90c53d4c-080d-4d25-a3eb-50c92e83f38c/action" status: 200 len: 14 microversion: 2.20 time: 0.072670 Nov 09 20:16:45.797477 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 557/1141] 10.222.0.25 () {62 vars in 1318 bytes} [Tue Nov 9 20:16:45 2021] POST /compute/v2.1/servers/90c53d4c-080d-4d25-a3eb-50c92e83f38c/action => generated 14 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:16:45.843811 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-818efcde-be76-46ab-8887-fa7fa273a3aa tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:16:45.844780 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-818efcde-be76-46ab-8887-fa7fa273a3aa tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:16:45.850945 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-818efcde-be76-46ab-8887-fa7fa273a3aa tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:45.851386 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-818efcde-be76-46ab-8887-fa7fa273a3aa tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:45.852150 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-818efcde-be76-46ab-8887-fa7fa273a3aa tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:45.852604 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-818efcde-be76-46ab-8887-fa7fa273a3aa tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:45.881632 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-818efcde-be76-46ab-8887-fa7fa273a3aa tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041476 Nov 09 20:16:45.884680 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 585/1142] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:16:45 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:16:46.351910 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-30e485f0-053a-4ebd-9160-da47c1d033e3 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:16:46.353033 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-30e485f0-053a-4ebd-9160-da47c1d033e3 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:16:46.360154 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-30e485f0-053a-4ebd-9160-da47c1d033e3 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:46.360633 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-30e485f0-053a-4ebd-9160-da47c1d033e3 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:46.361400 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-30e485f0-053a-4ebd-9160-da47c1d033e3 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:46.361835 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-30e485f0-053a-4ebd-9160-da47c1d033e3 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:46.392299 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-30e485f0-053a-4ebd-9160-da47c1d033e3 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044469 Nov 09 20:16:46.392877 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 558/1143] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:16:46 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:16:46.806173 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-6de895e8-0890-45f1-9e0a-ed91719effdf tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:16:46.807227 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-6de895e8-0890-45f1-9e0a-ed91719effdf tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: 90c53d4c-080d-4d25-a3eb-50c92e83f38c] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:16:46.813426 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6de895e8-0890-45f1-9e0a-ed91719effdf tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:46.813868 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6de895e8-0890-45f1-9e0a-ed91719effdf tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:46.814632 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6de895e8-0890-45f1-9e0a-ed91719effdf tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:46.815060 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6de895e8-0890-45f1-9e0a-ed91719effdf tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:46.871931 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-6de895e8-0890-45f1-9e0a-ed91719effdf tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "POST /compute/v2.1/servers/90c53d4c-080d-4d25-a3eb-50c92e83f38c/action" status: 200 len: 14 microversion: 2.20 time: 0.069375 Nov 09 20:16:46.872582 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 586/1144] 10.222.0.25 () {62 vars in 1318 bytes} [Tue Nov 9 20:16:46 2021] POST /compute/v2.1/servers/90c53d4c-080d-4d25-a3eb-50c92e83f38c/action => generated 14 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:16:46.893761 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-4d84386d-5b46-4b04-8946-4ec5f235ad67 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:16:46.894661 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-4d84386d-5b46-4b04-8946-4ec5f235ad67 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:16:46.901605 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4d84386d-5b46-4b04-8946-4ec5f235ad67 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:46.902048 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4d84386d-5b46-4b04-8946-4ec5f235ad67 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:46.902801 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4d84386d-5b46-4b04-8946-4ec5f235ad67 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:46.903234 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4d84386d-5b46-4b04-8946-4ec5f235ad67 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:46.930946 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-4d84386d-5b46-4b04-8946-4ec5f235ad67 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040857 Nov 09 20:16:46.931495 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 559/1145] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:16:46 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:16:47.404188 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-992f6aa8-bcd3-47a7-bb8e-02da538ed77e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:16:47.405206 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-992f6aa8-bcd3-47a7-bb8e-02da538ed77e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:16:47.411305 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-992f6aa8-bcd3-47a7-bb8e-02da538ed77e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:47.411752 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-992f6aa8-bcd3-47a7-bb8e-02da538ed77e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:47.412548 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-992f6aa8-bcd3-47a7-bb8e-02da538ed77e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:47.412983 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-992f6aa8-bcd3-47a7-bb8e-02da538ed77e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:47.443883 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-992f6aa8-bcd3-47a7-bb8e-02da538ed77e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043991 Nov 09 20:16:47.444521 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 587/1146] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:16:47 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:16:47.882965 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-246426fa-107f-4bfd-89e5-2bfb05789fa9 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:16:47.883878 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-246426fa-107f-4bfd-89e5-2bfb05789fa9 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: 90c53d4c-080d-4d25-a3eb-50c92e83f38c] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:16:47.890304 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-246426fa-107f-4bfd-89e5-2bfb05789fa9 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:47.890752 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-246426fa-107f-4bfd-89e5-2bfb05789fa9 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:47.891533 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-246426fa-107f-4bfd-89e5-2bfb05789fa9 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:47.891963 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-246426fa-107f-4bfd-89e5-2bfb05789fa9 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:47.941840 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-f3764688-fea7-4799-b095-05640356ffb8 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:16:47.943311 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-f3764688-fea7-4799-b095-05640356ffb8 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:16:47.949278 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f3764688-fea7-4799-b095-05640356ffb8 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:47.949719 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f3764688-fea7-4799-b095-05640356ffb8 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:47.950527 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f3764688-fea7-4799-b095-05640356ffb8 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:47.950957 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f3764688-fea7-4799-b095-05640356ffb8 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:47.951642 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-246426fa-107f-4bfd-89e5-2bfb05789fa9 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "POST /compute/v2.1/servers/90c53d4c-080d-4d25-a3eb-50c92e83f38c/action" status: 200 len: 14 microversion: 2.20 time: 0.072403 Nov 09 20:16:47.952925 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 560/1147] 10.222.0.25 () {62 vars in 1318 bytes} [Tue Nov 9 20:16:47 2021] POST /compute/v2.1/servers/90c53d4c-080d-4d25-a3eb-50c92e83f38c/action => generated 14 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:16:47.989393 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-f3764688-fea7-4799-b095-05640356ffb8 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051189 Nov 09 20:16:47.989961 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 588/1148] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:16:47 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 20:16:48.455927 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-7c3d585b-f26e-4ab0-8c6a-46d4eb8c9d5c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:16:48.456930 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-7c3d585b-f26e-4ab0-8c6a-46d4eb8c9d5c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:16:48.464384 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7c3d585b-f26e-4ab0-8c6a-46d4eb8c9d5c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:48.464850 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7c3d585b-f26e-4ab0-8c6a-46d4eb8c9d5c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:48.465606 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7c3d585b-f26e-4ab0-8c6a-46d4eb8c9d5c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:48.466024 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7c3d585b-f26e-4ab0-8c6a-46d4eb8c9d5c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:48.495802 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-7c3d585b-f26e-4ab0-8c6a-46d4eb8c9d5c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044030 Nov 09 20:16:48.496346 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 561/1149] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:16:48 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:16:48.962697 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-d017c07f-0d1b-4bea-a1a7-743da1088aee tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:16:48.963546 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-d017c07f-0d1b-4bea-a1a7-743da1088aee tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: 90c53d4c-080d-4d25-a3eb-50c92e83f38c] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:16:48.970075 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d017c07f-0d1b-4bea-a1a7-743da1088aee tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:48.970534 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d017c07f-0d1b-4bea-a1a7-743da1088aee tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:48.971307 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d017c07f-0d1b-4bea-a1a7-743da1088aee tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:48.971909 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d017c07f-0d1b-4bea-a1a7-743da1088aee tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:49.000620 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-8d7b68d3-4aca-4790-bba2-6a1ea3f8f7d3 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:16:49.001635 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-8d7b68d3-4aca-4790-bba2-6a1ea3f8f7d3 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:16:49.007778 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8d7b68d3-4aca-4790-bba2-6a1ea3f8f7d3 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:49.008226 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8d7b68d3-4aca-4790-bba2-6a1ea3f8f7d3 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:49.009041 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8d7b68d3-4aca-4790-bba2-6a1ea3f8f7d3 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:49.009472 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8d7b68d3-4aca-4790-bba2-6a1ea3f8f7d3 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:49.036252 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-d017c07f-0d1b-4bea-a1a7-743da1088aee tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "POST /compute/v2.1/servers/90c53d4c-080d-4d25-a3eb-50c92e83f38c/action" status: 200 len: 14 microversion: 2.20 time: 0.077330 Nov 09 20:16:49.037610 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 589/1150] 10.222.0.25 () {62 vars in 1318 bytes} [Tue Nov 9 20:16:48 2021] POST /compute/v2.1/servers/90c53d4c-080d-4d25-a3eb-50c92e83f38c/action => generated 14 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:16:49.043079 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-8d7b68d3-4aca-4790-bba2-6a1ea3f8f7d3 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046170 Nov 09 20:16:49.043817 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 562/1151] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:16:48 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 20:16:49.507493 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-daafae0a-a7dc-4a1d-86a4-63c0b238a3e3 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:16:49.508547 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-daafae0a-a7dc-4a1d-86a4-63c0b238a3e3 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:16:49.515513 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-daafae0a-a7dc-4a1d-86a4-63c0b238a3e3 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:49.515957 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-daafae0a-a7dc-4a1d-86a4-63c0b238a3e3 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:49.516763 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-daafae0a-a7dc-4a1d-86a4-63c0b238a3e3 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:49.517192 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-daafae0a-a7dc-4a1d-86a4-63c0b238a3e3 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:49.546993 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-daafae0a-a7dc-4a1d-86a4-63c0b238a3e3 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043476 Nov 09 20:16:49.547459 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 590/1152] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:16:49 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:16:50.046865 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-d8d1d0da-8aad-486c-bcd9-a4c9b21c9290 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:16:50.049056 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-d8d1d0da-8aad-486c-bcd9-a4c9b21c9290 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: 90c53d4c-080d-4d25-a3eb-50c92e83f38c] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:16:50.053712 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-ec15a509-47f4-43c1-8e24-8497e39bcc31 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:16:50.054604 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-ec15a509-47f4-43c1-8e24-8497e39bcc31 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:16:50.055371 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d8d1d0da-8aad-486c-bcd9-a4c9b21c9290 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:50.056328 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d8d1d0da-8aad-486c-bcd9-a4c9b21c9290 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:50.057290 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d8d1d0da-8aad-486c-bcd9-a4c9b21c9290 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:50.057713 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d8d1d0da-8aad-486c-bcd9-a4c9b21c9290 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:50.061221 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ec15a509-47f4-43c1-8e24-8497e39bcc31 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:50.061664 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ec15a509-47f4-43c1-8e24-8497e39bcc31 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:50.062442 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ec15a509-47f4-43c1-8e24-8497e39bcc31 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:50.062886 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ec15a509-47f4-43c1-8e24-8497e39bcc31 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:50.095455 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-ec15a509-47f4-43c1-8e24-8497e39bcc31 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045336 Nov 09 20:16:50.096017 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 591/1153] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:16:50 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 20:16:50.124695 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-d8d1d0da-8aad-486c-bcd9-a4c9b21c9290 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "POST /compute/v2.1/servers/90c53d4c-080d-4d25-a3eb-50c92e83f38c/action" status: 200 len: 14 microversion: 2.20 time: 0.081207 Nov 09 20:16:50.125327 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 563/1154] 10.222.0.25 () {62 vars in 1318 bytes} [Tue Nov 9 20:16:50 2021] POST /compute/v2.1/servers/90c53d4c-080d-4d25-a3eb-50c92e83f38c/action => generated 14 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:16:50.558909 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-a41033b3-9346-4912-82f5-e579177603fa tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:16:50.559824 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-a41033b3-9346-4912-82f5-e579177603fa tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:16:50.566046 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a41033b3-9346-4912-82f5-e579177603fa tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:50.566487 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a41033b3-9346-4912-82f5-e579177603fa tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:50.567248 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a41033b3-9346-4912-82f5-e579177603fa tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:50.567674 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a41033b3-9346-4912-82f5-e579177603fa tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:50.595514 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-a41033b3-9346-4912-82f5-e579177603fa tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040994 Nov 09 20:16:50.596050 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 592/1155] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:16:50 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:16:51.108200 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-a95e6c1d-2149-4eb9-ac1d-469b389e6069 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:16:51.109202 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-a95e6c1d-2149-4eb9-ac1d-469b389e6069 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:16:51.115869 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a95e6c1d-2149-4eb9-ac1d-469b389e6069 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:51.116310 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a95e6c1d-2149-4eb9-ac1d-469b389e6069 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:51.117091 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a95e6c1d-2149-4eb9-ac1d-469b389e6069 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:51.117514 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a95e6c1d-2149-4eb9-ac1d-469b389e6069 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:51.135439 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-90c34bb6-0dd4-4db6-8326-34a604dd88fd tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:16:51.137018 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-90c34bb6-0dd4-4db6-8326-34a604dd88fd tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: 90c53d4c-080d-4d25-a3eb-50c92e83f38c] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:16:51.144820 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-90c34bb6-0dd4-4db6-8326-34a604dd88fd tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:51.145484 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-90c34bb6-0dd4-4db6-8326-34a604dd88fd tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:51.146481 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-90c34bb6-0dd4-4db6-8326-34a604dd88fd tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:51.147107 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-90c34bb6-0dd4-4db6-8326-34a604dd88fd tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:51.154004 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-a95e6c1d-2149-4eb9-ac1d-469b389e6069 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050614 Nov 09 20:16:51.154887 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 564/1156] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:16:51 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 20:16:51.211848 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-90c34bb6-0dd4-4db6-8326-34a604dd88fd tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "POST /compute/v2.1/servers/90c53d4c-080d-4d25-a3eb-50c92e83f38c/action" status: 200 len: 14 microversion: 2.20 time: 0.080384 Nov 09 20:16:51.213233 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 593/1157] 10.222.0.25 () {62 vars in 1318 bytes} [Tue Nov 9 20:16:51 2021] POST /compute/v2.1/servers/90c53d4c-080d-4d25-a3eb-50c92e83f38c/action => generated 14 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 20:16:51.607814 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-47fd2a6a-0f62-403f-9c38-2e884967f217 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:16:51.608753 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-47fd2a6a-0f62-403f-9c38-2e884967f217 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:16:51.614944 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-47fd2a6a-0f62-403f-9c38-2e884967f217 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:51.615382 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-47fd2a6a-0f62-403f-9c38-2e884967f217 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:51.616144 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-47fd2a6a-0f62-403f-9c38-2e884967f217 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:51.616607 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-47fd2a6a-0f62-403f-9c38-2e884967f217 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:51.644427 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-47fd2a6a-0f62-403f-9c38-2e884967f217 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041302 Nov 09 20:16:51.644979 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 565/1158] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:16:51 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:16:52.165875 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-e3317530-f522-41d5-b092-45bddd06eb9d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:16:52.166896 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-e3317530-f522-41d5-b092-45bddd06eb9d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:16:52.173686 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e3317530-f522-41d5-b092-45bddd06eb9d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:52.174132 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e3317530-f522-41d5-b092-45bddd06eb9d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:52.174931 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e3317530-f522-41d5-b092-45bddd06eb9d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:52.175362 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e3317530-f522-41d5-b092-45bddd06eb9d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:52.205780 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-e3317530-f522-41d5-b092-45bddd06eb9d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044089 Nov 09 20:16:52.206541 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 594/1159] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:16:52 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:16:52.222818 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-a659bfff-4136-4e83-866f-fd5487d576f8 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:16:52.223716 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-a659bfff-4136-4e83-866f-fd5487d576f8 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: 90c53d4c-080d-4d25-a3eb-50c92e83f38c] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:16:52.229953 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a659bfff-4136-4e83-866f-fd5487d576f8 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:52.230390 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a659bfff-4136-4e83-866f-fd5487d576f8 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:52.231151 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a659bfff-4136-4e83-866f-fd5487d576f8 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:52.231574 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a659bfff-4136-4e83-866f-fd5487d576f8 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:52.308446 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-a659bfff-4136-4e83-866f-fd5487d576f8 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "POST /compute/v2.1/servers/90c53d4c-080d-4d25-a3eb-50c92e83f38c/action" status: 200 len: 6451 microversion: 2.20 time: 0.089030 Nov 09 20:16:52.309074 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 566/1160] 10.222.0.25 () {62 vars in 1318 bytes} [Tue Nov 9 20:16:52 2021] POST /compute/v2.1/servers/90c53d4c-080d-4d25-a3eb-50c92e83f38c/action => generated 6451 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:16:52.655580 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-c90314f0-f546-4442-9150-1a542ab8e2f4 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:16:52.656533 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-c90314f0-f546-4442-9150-1a542ab8e2f4 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:16:52.662630 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c90314f0-f546-4442-9150-1a542ab8e2f4 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:52.663069 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c90314f0-f546-4442-9150-1a542ab8e2f4 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:52.663826 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c90314f0-f546-4442-9150-1a542ab8e2f4 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:52.664250 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c90314f0-f546-4442-9150-1a542ab8e2f4 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:52.693419 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-c90314f0-f546-4442-9150-1a542ab8e2f4 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041572 Nov 09 20:16:52.693948 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 595/1161] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:16:52 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:16:53.217944 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-e1ffc12a-f254-4494-ab49-baa8f7f787be tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:16:53.218922 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-e1ffc12a-f254-4494-ab49-baa8f7f787be tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:16:53.225654 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e1ffc12a-f254-4494-ab49-baa8f7f787be tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:53.226290 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e1ffc12a-f254-4494-ab49-baa8f7f787be tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:53.226827 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e1ffc12a-f254-4494-ab49-baa8f7f787be tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:53.227248 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e1ffc12a-f254-4494-ab49-baa8f7f787be tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:53.258104 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-e1ffc12a-f254-4494-ab49-baa8f7f787be tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044165 Nov 09 20:16:53.258673 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 567/1162] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:16:53 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 20:16:53.319102 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-4384cf65-f23d-4490-bf9d-583a167aeef7 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:16:53.320010 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-4384cf65-f23d-4490-bf9d-583a167aeef7 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: 90c53d4c-080d-4d25-a3eb-50c92e83f38c] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:16:53.325978 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-4384cf65-f23d-4490-bf9d-583a167aeef7 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:53.326439 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-4384cf65-f23d-4490-bf9d-583a167aeef7 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:53.327180 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-4384cf65-f23d-4490-bf9d-583a167aeef7 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:53.327609 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-4384cf65-f23d-4490-bf9d-583a167aeef7 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:53.402424 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-4384cf65-f23d-4490-bf9d-583a167aeef7 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "POST /compute/v2.1/servers/90c53d4c-080d-4d25-a3eb-50c92e83f38c/action" status: 200 len: 15025 microversion: 2.20 time: 0.086683 Nov 09 20:16:53.402985 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 596/1163] 10.222.0.25 () {62 vars in 1318 bytes} [Tue Nov 9 20:16:53 2021] POST /compute/v2.1/servers/90c53d4c-080d-4d25-a3eb-50c92e83f38c/action => generated 15025 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 20:16:53.704307 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-822782b0-6c3f-480c-9ec8-79f55cb62ae8 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:16:53.705143 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-822782b0-6c3f-480c-9ec8-79f55cb62ae8 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:16:53.711271 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-822782b0-6c3f-480c-9ec8-79f55cb62ae8 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:53.711711 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-822782b0-6c3f-480c-9ec8-79f55cb62ae8 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:53.713108 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-822782b0-6c3f-480c-9ec8-79f55cb62ae8 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:53.713535 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-822782b0-6c3f-480c-9ec8-79f55cb62ae8 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:53.741452 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-822782b0-6c3f-480c-9ec8-79f55cb62ae8 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041076 Nov 09 20:16:53.741995 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 568/1164] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:16:53 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:16:54.269640 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-aedf8957-0a60-42a5-bc0b-d7d29350ffd7 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:16:54.270624 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-aedf8957-0a60-42a5-bc0b-d7d29350ffd7 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:16:54.278171 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-aedf8957-0a60-42a5-bc0b-d7d29350ffd7 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:54.278608 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-aedf8957-0a60-42a5-bc0b-d7d29350ffd7 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:54.279366 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-aedf8957-0a60-42a5-bc0b-d7d29350ffd7 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:54.279797 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-aedf8957-0a60-42a5-bc0b-d7d29350ffd7 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:54.308995 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-aedf8957-0a60-42a5-bc0b-d7d29350ffd7 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043378 Nov 09 20:16:54.309542 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 597/1165] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:16:54 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:16:54.413982 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-f27e9af3-d2d2-4ff6-9d32-c274a7c69aa5 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:16:54.414804 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-f27e9af3-d2d2-4ff6-9d32-c274a7c69aa5 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: 90c53d4c-080d-4d25-a3eb-50c92e83f38c] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:16:54.421040 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f27e9af3-d2d2-4ff6-9d32-c274a7c69aa5 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:54.421521 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f27e9af3-d2d2-4ff6-9d32-c274a7c69aa5 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:54.422279 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f27e9af3-d2d2-4ff6-9d32-c274a7c69aa5 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:54.422710 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f27e9af3-d2d2-4ff6-9d32-c274a7c69aa5 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:54.496083 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-f27e9af3-d2d2-4ff6-9d32-c274a7c69aa5 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "POST /compute/v2.1/servers/90c53d4c-080d-4d25-a3eb-50c92e83f38c/action" status: 200 len: 18561 microversion: 2.20 time: 0.085650 Nov 09 20:16:54.496741 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 569/1166] 10.222.0.25 () {62 vars in 1318 bytes} [Tue Nov 9 20:16:54 2021] POST /compute/v2.1/servers/90c53d4c-080d-4d25-a3eb-50c92e83f38c/action => generated 18561 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 20:16:54.752818 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-dc7594d4-ef5e-4c33-b798-611a7b4ada98 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:16:54.753698 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-dc7594d4-ef5e-4c33-b798-611a7b4ada98 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:16:54.762216 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-dc7594d4-ef5e-4c33-b798-611a7b4ada98 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:54.762656 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-dc7594d4-ef5e-4c33-b798-611a7b4ada98 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:54.763421 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-dc7594d4-ef5e-4c33-b798-611a7b4ada98 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:54.763848 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-dc7594d4-ef5e-4c33-b798-611a7b4ada98 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:54.796145 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-dc7594d4-ef5e-4c33-b798-611a7b4ada98 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047204 Nov 09 20:16:54.796728 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 598/1167] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:16:54 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:16:55.320739 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-9ae7bf06-e739-4563-851c-abcf5bc9d5a6 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:16:55.321959 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-9ae7bf06-e739-4563-851c-abcf5bc9d5a6 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:16:55.328733 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9ae7bf06-e739-4563-851c-abcf5bc9d5a6 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:55.329184 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9ae7bf06-e739-4563-851c-abcf5bc9d5a6 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:55.329953 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9ae7bf06-e739-4563-851c-abcf5bc9d5a6 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:55.330383 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9ae7bf06-e739-4563-851c-abcf5bc9d5a6 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:55.360798 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-9ae7bf06-e739-4563-851c-abcf5bc9d5a6 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044166 Nov 09 20:16:55.361353 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 570/1168] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:16:55 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:16:55.507114 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-f1db85a7-3340-4738-984b-ccfb33b01a5b tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:16:55.507941 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-f1db85a7-3340-4738-984b-ccfb33b01a5b tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: 90c53d4c-080d-4d25-a3eb-50c92e83f38c] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:16:55.514320 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f1db85a7-3340-4738-984b-ccfb33b01a5b tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:55.514760 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f1db85a7-3340-4738-984b-ccfb33b01a5b tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:55.515523 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f1db85a7-3340-4738-984b-ccfb33b01a5b tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:55.515951 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f1db85a7-3340-4738-984b-ccfb33b01a5b tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:55.587891 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-f1db85a7-3340-4738-984b-ccfb33b01a5b tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "POST /compute/v2.1/servers/90c53d4c-080d-4d25-a3eb-50c92e83f38c/action" status: 200 len: 19342 microversion: 2.20 time: 0.083797 Nov 09 20:16:55.588787 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 599/1169] 10.222.0.25 () {62 vars in 1318 bytes} [Tue Nov 9 20:16:55 2021] POST /compute/v2.1/servers/90c53d4c-080d-4d25-a3eb-50c92e83f38c/action => generated 19342 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 20:16:55.807464 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-fcc72c64-0037-402d-8df9-2a0acb357528 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:16:55.808416 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-fcc72c64-0037-402d-8df9-2a0acb357528 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:16:55.814591 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fcc72c64-0037-402d-8df9-2a0acb357528 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:55.815031 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fcc72c64-0037-402d-8df9-2a0acb357528 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:55.815790 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fcc72c64-0037-402d-8df9-2a0acb357528 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:55.816223 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fcc72c64-0037-402d-8df9-2a0acb357528 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:55.845828 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-fcc72c64-0037-402d-8df9-2a0acb357528 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042048 Nov 09 20:16:55.846370 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 571/1170] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:16:55 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:16:56.373441 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-f57fa021-80e9-42e7-b7c5-c1c991a762ad tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:16:56.374427 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-f57fa021-80e9-42e7-b7c5-c1c991a762ad tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:16:56.381240 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f57fa021-80e9-42e7-b7c5-c1c991a762ad tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:56.381718 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f57fa021-80e9-42e7-b7c5-c1c991a762ad tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:56.382490 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f57fa021-80e9-42e7-b7c5-c1c991a762ad tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:56.382917 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f57fa021-80e9-42e7-b7c5-c1c991a762ad tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:56.411367 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-f57fa021-80e9-42e7-b7c5-c1c991a762ad tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042911 Nov 09 20:16:56.411922 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 600/1171] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:16:56 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:16:56.598824 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-55a88b9b-91cf-4e7d-bd20-321cb6dcb418 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:16:56.599767 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-55a88b9b-91cf-4e7d-bd20-321cb6dcb418 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: 90c53d4c-080d-4d25-a3eb-50c92e83f38c] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:16:56.606513 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-55a88b9b-91cf-4e7d-bd20-321cb6dcb418 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:56.606963 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-55a88b9b-91cf-4e7d-bd20-321cb6dcb418 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:56.607986 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-55a88b9b-91cf-4e7d-bd20-321cb6dcb418 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:56.608439 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-55a88b9b-91cf-4e7d-bd20-321cb6dcb418 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:56.685830 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-55a88b9b-91cf-4e7d-bd20-321cb6dcb418 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "POST /compute/v2.1/servers/90c53d4c-080d-4d25-a3eb-50c92e83f38c/action" status: 200 len: 22127 microversion: 2.20 time: 0.090637 Nov 09 20:16:56.686734 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 572/1172] 10.222.0.25 () {62 vars in 1318 bytes} [Tue Nov 9 20:16:56 2021] POST /compute/v2.1/servers/90c53d4c-080d-4d25-a3eb-50c92e83f38c/action => generated 22127 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 20:16:56.858003 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-29d3efa0-f5cb-4ac4-820a-4964709bed68 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:16:56.858932 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-29d3efa0-f5cb-4ac4-820a-4964709bed68 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:16:56.865039 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-29d3efa0-f5cb-4ac4-820a-4964709bed68 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:56.865479 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-29d3efa0-f5cb-4ac4-820a-4964709bed68 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:56.866237 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-29d3efa0-f5cb-4ac4-820a-4964709bed68 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:56.866661 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-29d3efa0-f5cb-4ac4-820a-4964709bed68 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:56.894370 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-29d3efa0-f5cb-4ac4-820a-4964709bed68 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040335 Nov 09 20:16:56.894912 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 601/1173] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:16:56 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:16:57.422933 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-212109f4-7c1b-487d-a3f3-9616d9a9f6ac tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:16:57.423912 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-212109f4-7c1b-487d-a3f3-9616d9a9f6ac tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:16:57.431746 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-212109f4-7c1b-487d-a3f3-9616d9a9f6ac tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:57.432178 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-212109f4-7c1b-487d-a3f3-9616d9a9f6ac tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:57.432959 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-212109f4-7c1b-487d-a3f3-9616d9a9f6ac tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:57.433378 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-212109f4-7c1b-487d-a3f3-9616d9a9f6ac tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:57.464143 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-212109f4-7c1b-487d-a3f3-9616d9a9f6ac tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045201 Nov 09 20:16:57.464749 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 573/1174] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:16:57 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:16:57.698020 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-c7a4fbc5-16ea-4496-993e-5880e7acc32f tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:16:57.698947 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-c7a4fbc5-16ea-4496-993e-5880e7acc32f tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: 90c53d4c-080d-4d25-a3eb-50c92e83f38c] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:16:57.705059 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c7a4fbc5-16ea-4496-993e-5880e7acc32f tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:57.705500 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c7a4fbc5-16ea-4496-993e-5880e7acc32f tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:57.706254 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c7a4fbc5-16ea-4496-993e-5880e7acc32f tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:57.706675 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c7a4fbc5-16ea-4496-993e-5880e7acc32f tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:57.778282 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-c7a4fbc5-16ea-4496-993e-5880e7acc32f tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "POST /compute/v2.1/servers/90c53d4c-080d-4d25-a3eb-50c92e83f38c/action" status: 200 len: 23570 microversion: 2.20 time: 0.084424 Nov 09 20:16:57.778873 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 602/1175] 10.222.0.25 () {62 vars in 1318 bytes} [Tue Nov 9 20:16:57 2021] POST /compute/v2.1/servers/90c53d4c-080d-4d25-a3eb-50c92e83f38c/action => generated 23570 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 20:16:57.906317 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-482f8375-e006-4861-8f38-965f63adee7f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:16:57.907224 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-482f8375-e006-4861-8f38-965f63adee7f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:16:57.913465 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-482f8375-e006-4861-8f38-965f63adee7f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:57.913912 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-482f8375-e006-4861-8f38-965f63adee7f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:57.914683 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-482f8375-e006-4861-8f38-965f63adee7f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:57.915116 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-482f8375-e006-4861-8f38-965f63adee7f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:57.942677 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-482f8375-e006-4861-8f38-965f63adee7f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040112 Nov 09 20:16:57.943208 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 574/1176] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:16:57 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:16:58.475810 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-347968da-9fc1-47e1-88e0-2e896a62205a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:16:58.476817 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-347968da-9fc1-47e1-88e0-2e896a62205a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:16:58.483854 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-347968da-9fc1-47e1-88e0-2e896a62205a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:58.484287 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-347968da-9fc1-47e1-88e0-2e896a62205a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:58.485084 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-347968da-9fc1-47e1-88e0-2e896a62205a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:58.485605 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-347968da-9fc1-47e1-88e0-2e896a62205a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:58.516632 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-347968da-9fc1-47e1-88e0-2e896a62205a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044839 Nov 09 20:16:58.517185 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 603/1177] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:16:58 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:16:58.789663 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-d4178efb-19c8-4074-bb87-05715c414077 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:16:58.791116 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-d4178efb-19c8-4074-bb87-05715c414077 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: 90c53d4c-080d-4d25-a3eb-50c92e83f38c] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:16:58.797385 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d4178efb-19c8-4074-bb87-05715c414077 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:58.797827 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d4178efb-19c8-4074-bb87-05715c414077 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:58.798589 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d4178efb-19c8-4074-bb87-05715c414077 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:58.799013 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d4178efb-19c8-4074-bb87-05715c414077 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:58.874679 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-d4178efb-19c8-4074-bb87-05715c414077 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "POST /compute/v2.1/servers/90c53d4c-080d-4d25-a3eb-50c92e83f38c/action" status: 200 len: 24955 microversion: 2.20 time: 0.088654 Nov 09 20:16:58.875320 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 575/1178] 10.222.0.25 () {62 vars in 1318 bytes} [Tue Nov 9 20:16:58 2021] POST /compute/v2.1/servers/90c53d4c-080d-4d25-a3eb-50c92e83f38c/action => generated 24955 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 20:16:58.953801 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-d2965924-6c7c-4eae-a423-69538ad09d54 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:16:58.954698 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-d2965924-6c7c-4eae-a423-69538ad09d54 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:16:58.960863 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d2965924-6c7c-4eae-a423-69538ad09d54 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:58.961303 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d2965924-6c7c-4eae-a423-69538ad09d54 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:58.962431 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d2965924-6c7c-4eae-a423-69538ad09d54 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:58.962919 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d2965924-6c7c-4eae-a423-69538ad09d54 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:58.991942 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-d2965924-6c7c-4eae-a423-69538ad09d54 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041874 Nov 09 20:16:58.992513 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 604/1179] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:16:58 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:16:59.528961 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-442e5560-5413-4c4a-a9cf-118f5c7859a0 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:16:59.529991 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-442e5560-5413-4c4a-a9cf-118f5c7859a0 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:16:59.536853 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-442e5560-5413-4c4a-a9cf-118f5c7859a0 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:59.537240 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-442e5560-5413-4c4a-a9cf-118f5c7859a0 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:59.538002 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-442e5560-5413-4c4a-a9cf-118f5c7859a0 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:59.538431 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-442e5560-5413-4c4a-a9cf-118f5c7859a0 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:59.567713 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-442e5560-5413-4c4a-a9cf-118f5c7859a0 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043452 Nov 09 20:16:59.568274 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 576/1180] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:16:59 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:16:59.887050 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-febbda71-11c5-4d0b-b6ed-f98681b8c5f4 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:16:59.887953 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-febbda71-11c5-4d0b-b6ed-f98681b8c5f4 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: 90c53d4c-080d-4d25-a3eb-50c92e83f38c] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:16:59.894156 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-febbda71-11c5-4d0b-b6ed-f98681b8c5f4 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:59.894604 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-febbda71-11c5-4d0b-b6ed-f98681b8c5f4 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:59.895376 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-febbda71-11c5-4d0b-b6ed-f98681b8c5f4 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:16:59.895806 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-febbda71-11c5-4d0b-b6ed-f98681b8c5f4 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:16:59.971893 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-febbda71-11c5-4d0b-b6ed-f98681b8c5f4 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "POST /compute/v2.1/servers/90c53d4c-080d-4d25-a3eb-50c92e83f38c/action" status: 200 len: 26454 microversion: 2.20 time: 0.089315 Nov 09 20:16:59.972667 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 605/1181] 10.222.0.25 () {62 vars in 1318 bytes} [Tue Nov 9 20:16:59 2021] POST /compute/v2.1/servers/90c53d4c-080d-4d25-a3eb-50c92e83f38c/action => generated 26454 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 20:17:00.003996 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-08a7a9cb-5b60-4913-8714-338673b0a0be tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:17:00.005141 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-08a7a9cb-5b60-4913-8714-338673b0a0be tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:17:00.011976 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-08a7a9cb-5b60-4913-8714-338673b0a0be tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:17:00.012434 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-08a7a9cb-5b60-4913-8714-338673b0a0be tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:17:00.013194 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-08a7a9cb-5b60-4913-8714-338673b0a0be tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:17:00.013627 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-08a7a9cb-5b60-4913-8714-338673b0a0be tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:17:00.044013 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-08a7a9cb-5b60-4913-8714-338673b0a0be tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043765 Nov 09 20:17:00.044586 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 577/1182] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:16:59 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:17:00.579686 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-b4b4d959-02e2-43a7-8c6b-a50f37ed6873 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:17:00.580629 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-b4b4d959-02e2-43a7-8c6b-a50f37ed6873 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:17:00.587799 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b4b4d959-02e2-43a7-8c6b-a50f37ed6873 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:17:00.588274 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b4b4d959-02e2-43a7-8c6b-a50f37ed6873 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:17:00.589091 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b4b4d959-02e2-43a7-8c6b-a50f37ed6873 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:17:00.589521 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b4b4d959-02e2-43a7-8c6b-a50f37ed6873 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:17:00.619758 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-b4b4d959-02e2-43a7-8c6b-a50f37ed6873 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043972 Nov 09 20:17:00.620349 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 606/1183] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:17:00 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:17:00.984360 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-3bfaddee-ffbe-4258-adbe-3ed0128c48df tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:17:00.985293 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-3bfaddee-ffbe-4258-adbe-3ed0128c48df tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: 90c53d4c-080d-4d25-a3eb-50c92e83f38c] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:17:00.991453 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3bfaddee-ffbe-4258-adbe-3ed0128c48df tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:17:00.991903 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3bfaddee-ffbe-4258-adbe-3ed0128c48df tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:17:00.992708 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3bfaddee-ffbe-4258-adbe-3ed0128c48df tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:17:00.993266 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3bfaddee-ffbe-4258-adbe-3ed0128c48df tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:17:01.055184 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-fc10e00f-a555-4866-8536-252aa2f9e2bd tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:17:01.056949 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-fc10e00f-a555-4866-8536-252aa2f9e2bd tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:17:01.063123 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-fc10e00f-a555-4866-8536-252aa2f9e2bd tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:17:01.063570 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-fc10e00f-a555-4866-8536-252aa2f9e2bd tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:17:01.064335 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-fc10e00f-a555-4866-8536-252aa2f9e2bd tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:17:01.064792 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-fc10e00f-a555-4866-8536-252aa2f9e2bd tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:17:01.070238 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-3bfaddee-ffbe-4258-adbe-3ed0128c48df tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "POST /compute/v2.1/servers/90c53d4c-080d-4d25-a3eb-50c92e83f38c/action" status: 200 len: 27466 microversion: 2.20 time: 0.089634 Nov 09 20:17:01.074209 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 578/1184] 10.222.0.25 () {62 vars in 1318 bytes} [Tue Nov 9 20:17:00 2021] POST /compute/v2.1/servers/90c53d4c-080d-4d25-a3eb-50c92e83f38c/action => generated 27466 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 20:17:01.093549 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-fc10e00f-a555-4866-8536-252aa2f9e2bd tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042051 Nov 09 20:17:01.094092 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 607/1185] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:17:01 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 20:17:01.631433 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-93025aec-3f69-4045-9766-31f8f4bed69d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:17:01.632452 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-93025aec-3f69-4045-9766-31f8f4bed69d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:17:01.639753 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-93025aec-3f69-4045-9766-31f8f4bed69d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:17:01.640190 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-93025aec-3f69-4045-9766-31f8f4bed69d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:17:01.640983 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-93025aec-3f69-4045-9766-31f8f4bed69d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:17:01.641408 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-93025aec-3f69-4045-9766-31f8f4bed69d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:17:01.670327 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-93025aec-3f69-4045-9766-31f8f4bed69d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042936 Nov 09 20:17:01.671083 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 579/1186] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:17:01 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:17:02.081770 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-ca8a1b8d-6c8b-48a0-9e2f-c662702828d6 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:17:02.082604 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-ca8a1b8d-6c8b-48a0-9e2f-c662702828d6 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: 90c53d4c-080d-4d25-a3eb-50c92e83f38c] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:17:02.088846 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ca8a1b8d-6c8b-48a0-9e2f-c662702828d6 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:17:02.089287 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ca8a1b8d-6c8b-48a0-9e2f-c662702828d6 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:17:02.090049 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ca8a1b8d-6c8b-48a0-9e2f-c662702828d6 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:17:02.090477 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ca8a1b8d-6c8b-48a0-9e2f-c662702828d6 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:17:02.104176 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-ffd958eb-b852-4a90-9c42-3be5a5aed4ab tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:17:02.105320 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-ffd958eb-b852-4a90-9c42-3be5a5aed4ab tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:17:02.111642 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ffd958eb-b852-4a90-9c42-3be5a5aed4ab tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:17:02.112088 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ffd958eb-b852-4a90-9c42-3be5a5aed4ab tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:17:02.112896 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ffd958eb-b852-4a90-9c42-3be5a5aed4ab tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:17:02.113332 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ffd958eb-b852-4a90-9c42-3be5a5aed4ab tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:17:02.143049 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-ffd958eb-b852-4a90-9c42-3be5a5aed4ab tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042755 Nov 09 20:17:02.143594 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 580/1187] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:17:02 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 20:17:02.164797 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-ca8a1b8d-6c8b-48a0-9e2f-c662702828d6 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "POST /compute/v2.1/servers/90c53d4c-080d-4d25-a3eb-50c92e83f38c/action" status: 200 len: 27899 microversion: 2.20 time: 0.086493 Nov 09 20:17:02.165417 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 608/1188] 10.222.0.25 () {62 vars in 1318 bytes} [Tue Nov 9 20:17:02 2021] POST /compute/v2.1/servers/90c53d4c-080d-4d25-a3eb-50c92e83f38c/action => generated 27899 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 20:17:02.682299 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-f762dedd-acb7-4bfd-8815-6919e3788bc3 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:17:02.683135 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-f762dedd-acb7-4bfd-8815-6919e3788bc3 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:17:02.689260 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f762dedd-acb7-4bfd-8815-6919e3788bc3 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:17:02.689700 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f762dedd-acb7-4bfd-8815-6919e3788bc3 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:17:02.690458 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f762dedd-acb7-4bfd-8815-6919e3788bc3 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:17:02.690879 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f762dedd-acb7-4bfd-8815-6919e3788bc3 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:17:02.719108 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-f762dedd-acb7-4bfd-8815-6919e3788bc3 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041287 Nov 09 20:17:02.719825 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 581/1189] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:17:02 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:17:03.155326 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-b15331e2-bd83-41d3-b5dc-84a141fd356a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:17:03.156325 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-b15331e2-bd83-41d3-b5dc-84a141fd356a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:17:03.163261 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b15331e2-bd83-41d3-b5dc-84a141fd356a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:17:03.163710 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b15331e2-bd83-41d3-b5dc-84a141fd356a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:17:03.164518 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b15331e2-bd83-41d3-b5dc-84a141fd356a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:17:03.164956 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b15331e2-bd83-41d3-b5dc-84a141fd356a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:17:03.175706 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-87324e98-7261-41cc-bdfc-1071cc1a1397 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:17:03.176635 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-87324e98-7261-41cc-bdfc-1071cc1a1397 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: 90c53d4c-080d-4d25-a3eb-50c92e83f38c] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:17:03.182874 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-87324e98-7261-41cc-bdfc-1071cc1a1397 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:17:03.183314 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-87324e98-7261-41cc-bdfc-1071cc1a1397 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:17:03.184075 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-87324e98-7261-41cc-bdfc-1071cc1a1397 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:17:03.184528 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-87324e98-7261-41cc-bdfc-1071cc1a1397 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:17:03.194907 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-b15331e2-bd83-41d3-b5dc-84a141fd356a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044552 Nov 09 20:17:03.195463 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 609/1190] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:17:03 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:17:03.270624 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-87324e98-7261-41cc-bdfc-1071cc1a1397 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "POST /compute/v2.1/servers/90c53d4c-080d-4d25-a3eb-50c92e83f38c/action" status: 200 len: 28192 microversion: 2.20 time: 0.098323 Nov 09 20:17:03.271490 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 582/1191] 10.222.0.25 () {62 vars in 1318 bytes} [Tue Nov 9 20:17:03 2021] POST /compute/v2.1/servers/90c53d4c-080d-4d25-a3eb-50c92e83f38c/action => generated 28192 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 09 20:17:03.730728 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-6f4d6443-68ba-490a-a08a-a653fe788a0f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:17:03.731634 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-6f4d6443-68ba-490a-a08a-a653fe788a0f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:17:03.738042 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6f4d6443-68ba-490a-a08a-a653fe788a0f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:17:03.738490 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6f4d6443-68ba-490a-a08a-a653fe788a0f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:17:03.739274 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6f4d6443-68ba-490a-a08a-a653fe788a0f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:17:03.739685 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6f4d6443-68ba-490a-a08a-a653fe788a0f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:17:03.769338 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-6f4d6443-68ba-490a-a08a-a653fe788a0f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042799 Nov 09 20:17:03.769894 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 610/1192] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:17:03 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:17:04.206930 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-072d7fdf-4234-4e17-becb-65b05354bcfc tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:17:04.207955 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-072d7fdf-4234-4e17-becb-65b05354bcfc tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:17:04.215655 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-072d7fdf-4234-4e17-becb-65b05354bcfc tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:17:04.216099 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-072d7fdf-4234-4e17-becb-65b05354bcfc tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:17:04.216904 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-072d7fdf-4234-4e17-becb-65b05354bcfc tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:17:04.217339 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-072d7fdf-4234-4e17-becb-65b05354bcfc tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:17:04.246815 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-072d7fdf-4234-4e17-becb-65b05354bcfc tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044010 Nov 09 20:17:04.247378 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 583/1193] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:17:04 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:17:04.282490 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-88cc33f4-21ee-4deb-a060-c42694479ec1 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:17:04.283431 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-88cc33f4-21ee-4deb-a060-c42694479ec1 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: 90c53d4c-080d-4d25-a3eb-50c92e83f38c] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:17:04.289583 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-88cc33f4-21ee-4deb-a060-c42694479ec1 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:17:04.290027 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-88cc33f4-21ee-4deb-a060-c42694479ec1 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:17:04.290894 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-88cc33f4-21ee-4deb-a060-c42694479ec1 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:17:04.291839 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-88cc33f4-21ee-4deb-a060-c42694479ec1 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:17:04.355898 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-88cc33f4-21ee-4deb-a060-c42694479ec1 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "POST /compute/v2.1/servers/90c53d4c-080d-4d25-a3eb-50c92e83f38c/action" status: 200 len: 28192 microversion: 2.20 time: 0.076924 Nov 09 20:17:04.356534 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 611/1194] 10.222.0.25 () {62 vars in 1318 bytes} [Tue Nov 9 20:17:04 2021] POST /compute/v2.1/servers/90c53d4c-080d-4d25-a3eb-50c92e83f38c/action => generated 28192 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 20:17:04.781226 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-674c179e-f109-4736-aec1-c5f431f86ca0 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:17:04.782139 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-674c179e-f109-4736-aec1-c5f431f86ca0 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:17:04.788220 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-674c179e-f109-4736-aec1-c5f431f86ca0 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:17:04.788691 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-674c179e-f109-4736-aec1-c5f431f86ca0 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:17:04.789447 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-674c179e-f109-4736-aec1-c5f431f86ca0 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:17:04.789878 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-674c179e-f109-4736-aec1-c5f431f86ca0 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:17:04.818339 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-674c179e-f109-4736-aec1-c5f431f86ca0 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040794 Nov 09 20:17:04.818902 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 584/1195] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:17:04 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:17:05.258802 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-e6e77789-99e8-4966-8908-9b50ca55cdb2 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:17:05.260478 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-e6e77789-99e8-4966-8908-9b50ca55cdb2 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:17:05.267298 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e6e77789-99e8-4966-8908-9b50ca55cdb2 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:17:05.267738 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e6e77789-99e8-4966-8908-9b50ca55cdb2 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:17:05.268541 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e6e77789-99e8-4966-8908-9b50ca55cdb2 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:17:05.268968 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e6e77789-99e8-4966-8908-9b50ca55cdb2 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:17:05.299146 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-e6e77789-99e8-4966-8908-9b50ca55cdb2 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044482 Nov 09 20:17:05.299698 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 612/1196] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:17:05 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:17:05.366982 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-f9389fe8-2a2f-4efd-8aa5-834fcbbab30c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:17:05.367885 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-f9389fe8-2a2f-4efd-8aa5-834fcbbab30c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: 90c53d4c-080d-4d25-a3eb-50c92e83f38c] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:17:05.375123 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f9389fe8-2a2f-4efd-8aa5-834fcbbab30c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:17:05.375565 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f9389fe8-2a2f-4efd-8aa5-834fcbbab30c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:17:05.376326 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f9389fe8-2a2f-4efd-8aa5-834fcbbab30c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:17:05.376777 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f9389fe8-2a2f-4efd-8aa5-834fcbbab30c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:17:05.453047 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-f9389fe8-2a2f-4efd-8aa5-834fcbbab30c tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "POST /compute/v2.1/servers/90c53d4c-080d-4d25-a3eb-50c92e83f38c/action" status: 200 len: 28483 microversion: 2.20 time: 0.089622 Nov 09 20:17:05.453688 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 585/1197] 10.222.0.25 () {62 vars in 1318 bytes} [Tue Nov 9 20:17:05 2021] POST /compute/v2.1/servers/90c53d4c-080d-4d25-a3eb-50c92e83f38c/action => generated 28483 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 20:17:05.829992 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-83df0efa-343e-41a5-91e1-ea3299f2ca01 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:17:05.830923 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-83df0efa-343e-41a5-91e1-ea3299f2ca01 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:17:05.837097 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-83df0efa-343e-41a5-91e1-ea3299f2ca01 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:17:05.837539 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-83df0efa-343e-41a5-91e1-ea3299f2ca01 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:17:05.839288 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-83df0efa-343e-41a5-91e1-ea3299f2ca01 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:17:05.839725 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-83df0efa-343e-41a5-91e1-ea3299f2ca01 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:17:05.868759 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-83df0efa-343e-41a5-91e1-ea3299f2ca01 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042435 Nov 09 20:17:05.869957 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 613/1198] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:17:05 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:17:06.311477 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-dfa05ae0-861e-42c2-9db9-a8323593f68a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:17:06.312554 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-dfa05ae0-861e-42c2-9db9-a8323593f68a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:17:06.319226 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-dfa05ae0-861e-42c2-9db9-a8323593f68a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:17:06.319661 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-dfa05ae0-861e-42c2-9db9-a8323593f68a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:17:06.320432 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-dfa05ae0-861e-42c2-9db9-a8323593f68a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:17:06.320863 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-dfa05ae0-861e-42c2-9db9-a8323593f68a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:17:06.351394 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-dfa05ae0-861e-42c2-9db9-a8323593f68a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043987 Nov 09 20:17:06.351930 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 586/1199] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:17:06 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:17:06.465542 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-33105215-7b01-4449-9628-39a8d3bbaedb tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:17:06.466476 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-33105215-7b01-4449-9628-39a8d3bbaedb tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: 90c53d4c-080d-4d25-a3eb-50c92e83f38c] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:17:06.472655 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-33105215-7b01-4449-9628-39a8d3bbaedb tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:17:06.473107 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-33105215-7b01-4449-9628-39a8d3bbaedb tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:17:06.473872 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-33105215-7b01-4449-9628-39a8d3bbaedb tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:17:06.474298 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-33105215-7b01-4449-9628-39a8d3bbaedb tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:17:06.559550 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-33105215-7b01-4449-9628-39a8d3bbaedb tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "POST /compute/v2.1/servers/90c53d4c-080d-4d25-a3eb-50c92e83f38c/action" status: 200 len: 28651 microversion: 2.20 time: 0.098359 Nov 09 20:17:06.560104 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 614/1200] 10.222.0.25 () {62 vars in 1318 bytes} [Tue Nov 9 20:17:06 2021] POST /compute/v2.1/servers/90c53d4c-080d-4d25-a3eb-50c92e83f38c/action => generated 28651 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 20:17:06.879445 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-203f76a0-eaf9-49b5-a614-d150d4a3251b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:17:06.880341 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-203f76a0-eaf9-49b5-a614-d150d4a3251b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:17:06.887099 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-203f76a0-eaf9-49b5-a614-d150d4a3251b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:17:06.887542 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-203f76a0-eaf9-49b5-a614-d150d4a3251b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:17:06.888297 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-203f76a0-eaf9-49b5-a614-d150d4a3251b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:17:06.888746 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-203f76a0-eaf9-49b5-a614-d150d4a3251b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:17:06.917103 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-203f76a0-eaf9-49b5-a614-d150d4a3251b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041265 Nov 09 20:17:06.917663 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 587/1201] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:17:06 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:17:07.362986 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-34ec67f5-6289-44ff-9607-609233707364 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:17:07.363974 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-34ec67f5-6289-44ff-9607-609233707364 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:17:07.371304 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-34ec67f5-6289-44ff-9607-609233707364 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:17:07.371745 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-34ec67f5-6289-44ff-9607-609233707364 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:17:07.372540 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-34ec67f5-6289-44ff-9607-609233707364 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:17:07.372970 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-34ec67f5-6289-44ff-9607-609233707364 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:17:07.401707 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-34ec67f5-6289-44ff-9607-609233707364 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042842 Nov 09 20:17:07.402250 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 615/1202] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:17:07 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:17:07.571033 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-55328ac9-88a6-4988-b882-7b889da297bc tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:17:07.571862 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-55328ac9-88a6-4988-b882-7b889da297bc tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: 90c53d4c-080d-4d25-a3eb-50c92e83f38c] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:17:07.578565 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-55328ac9-88a6-4988-b882-7b889da297bc tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:17:07.579029 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-55328ac9-88a6-4988-b882-7b889da297bc tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:17:07.579786 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-55328ac9-88a6-4988-b882-7b889da297bc tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:17:07.580207 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-55328ac9-88a6-4988-b882-7b889da297bc tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:17:07.651656 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-55328ac9-88a6-4988-b882-7b889da297bc tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "POST /compute/v2.1/servers/90c53d4c-080d-4d25-a3eb-50c92e83f38c/action" status: 200 len: 28651 microversion: 2.20 time: 0.084249 Nov 09 20:17:07.652282 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 588/1203] 10.222.0.25 () {62 vars in 1318 bytes} [Tue Nov 9 20:17:07 2021] POST /compute/v2.1/servers/90c53d4c-080d-4d25-a3eb-50c92e83f38c/action => generated 28651 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 20:17:07.927865 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-bb9c8ce2-74bb-4584-9828-58b992ce24e9 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:17:07.928806 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-bb9c8ce2-74bb-4584-9828-58b992ce24e9 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:17:07.934991 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-bb9c8ce2-74bb-4584-9828-58b992ce24e9 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:17:07.935430 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-bb9c8ce2-74bb-4584-9828-58b992ce24e9 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:17:07.936190 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-bb9c8ce2-74bb-4584-9828-58b992ce24e9 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:17:07.936639 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-bb9c8ce2-74bb-4584-9828-58b992ce24e9 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:17:07.965910 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-bb9c8ce2-74bb-4584-9828-58b992ce24e9 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041733 Nov 09 20:17:07.966458 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 616/1204] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:17:07 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:17:08.413440 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-5b581a8c-7841-4d14-bebe-231c22b0d552 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:17:08.414431 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-5b581a8c-7841-4d14-bebe-231c22b0d552 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:17:08.422145 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5b581a8c-7841-4d14-bebe-231c22b0d552 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:17:08.422584 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5b581a8c-7841-4d14-bebe-231c22b0d552 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:17:08.423356 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5b581a8c-7841-4d14-bebe-231c22b0d552 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:17:08.423783 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5b581a8c-7841-4d14-bebe-231c22b0d552 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:17:08.455049 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-5b581a8c-7841-4d14-bebe-231c22b0d552 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045666 Nov 09 20:17:08.455598 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 589/1205] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:17:08 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:17:08.663145 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-fb54901a-25f6-47f6-8041-ff136b664f0e tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:17:08.664054 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-fb54901a-25f6-47f6-8041-ff136b664f0e tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: 90c53d4c-080d-4d25-a3eb-50c92e83f38c] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:17:08.670727 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-fb54901a-25f6-47f6-8041-ff136b664f0e tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:17:08.671171 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-fb54901a-25f6-47f6-8041-ff136b664f0e tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:17:08.671930 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-fb54901a-25f6-47f6-8041-ff136b664f0e tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:17:08.672364 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-fb54901a-25f6-47f6-8041-ff136b664f0e tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:17:08.735809 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-fb54901a-25f6-47f6-8041-ff136b664f0e tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "POST /compute/v2.1/servers/90c53d4c-080d-4d25-a3eb-50c92e83f38c/action" status: 200 len: 28651 microversion: 2.20 time: 0.076334 Nov 09 20:17:08.736444 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 617/1206] 10.222.0.25 () {62 vars in 1318 bytes} [Tue Nov 9 20:17:08 2021] POST /compute/v2.1/servers/90c53d4c-080d-4d25-a3eb-50c92e83f38c/action => generated 28651 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 20:17:08.977094 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-9f5443bb-bbef-4794-8cf1-a9128b69e5ac tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:17:08.977976 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-9f5443bb-bbef-4794-8cf1-a9128b69e5ac tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:17:08.985409 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9f5443bb-bbef-4794-8cf1-a9128b69e5ac tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:17:08.985850 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9f5443bb-bbef-4794-8cf1-a9128b69e5ac tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:17:08.986617 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9f5443bb-bbef-4794-8cf1-a9128b69e5ac tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:17:08.987041 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9f5443bb-bbef-4794-8cf1-a9128b69e5ac tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:17:09.014857 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-9f5443bb-bbef-4794-8cf1-a9128b69e5ac tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041556 Nov 09 20:17:09.015405 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 590/1207] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:17:08 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:17:09.466927 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-bb4f2d3c-f456-4022-aa7c-b39e8633dd63 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:17:09.467906 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-bb4f2d3c-f456-4022-aa7c-b39e8633dd63 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:17:09.474737 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-bb4f2d3c-f456-4022-aa7c-b39e8633dd63 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:17:09.475176 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-bb4f2d3c-f456-4022-aa7c-b39e8633dd63 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:17:09.475933 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-bb4f2d3c-f456-4022-aa7c-b39e8633dd63 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:17:09.476361 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-bb4f2d3c-f456-4022-aa7c-b39e8633dd63 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:17:09.505967 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-bb4f2d3c-f456-4022-aa7c-b39e8633dd63 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043704 Nov 09 20:17:09.506501 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 618/1208] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:17:09 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:17:09.747246 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-0484394c-11fd-4a7b-86c2-616f6883e2d8 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:17:09.748145 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-0484394c-11fd-4a7b-86c2-616f6883e2d8 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: 90c53d4c-080d-4d25-a3eb-50c92e83f38c] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:17:09.754600 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0484394c-11fd-4a7b-86c2-616f6883e2d8 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:17:09.755055 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0484394c-11fd-4a7b-86c2-616f6883e2d8 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:17:09.755835 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0484394c-11fd-4a7b-86c2-616f6883e2d8 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:17:09.756269 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0484394c-11fd-4a7b-86c2-616f6883e2d8 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:17:09.839125 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-0484394c-11fd-4a7b-86c2-616f6883e2d8 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "POST /compute/v2.1/servers/90c53d4c-080d-4d25-a3eb-50c92e83f38c/action" status: 200 len: 29013 microversion: 2.20 time: 0.095454 Nov 09 20:17:09.839991 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 591/1209] 10.222.0.25 () {62 vars in 1318 bytes} [Tue Nov 9 20:17:09 2021] POST /compute/v2.1/servers/90c53d4c-080d-4d25-a3eb-50c92e83f38c/action => generated 29013 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 20:17:10.026978 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-fe7b68ff-1807-424a-9fb0-581c1052df1f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:17:10.027785 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-fe7b68ff-1807-424a-9fb0-581c1052df1f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:17:10.034173 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-fe7b68ff-1807-424a-9fb0-581c1052df1f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:17:10.034618 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-fe7b68ff-1807-424a-9fb0-581c1052df1f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:17:10.035384 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-fe7b68ff-1807-424a-9fb0-581c1052df1f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:17:10.035812 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-fe7b68ff-1807-424a-9fb0-581c1052df1f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:17:10.122027 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-fe7b68ff-1807-424a-9fb0-581c1052df1f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "POST /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/action" status: 200 len: 102639 microversion: 2.1 time: 0.099496 Nov 09 20:17:10.122682 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 619/1210] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Nov 9 20:17:10 2021] POST /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df/action => generated 102639 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:17:10.518218 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-47bb48d2-3461-489e-8791-d95d931699c2 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:17:10.519200 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-47bb48d2-3461-489e-8791-d95d931699c2 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:17:10.526127 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-47bb48d2-3461-489e-8791-d95d931699c2 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:17:10.526572 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-47bb48d2-3461-489e-8791-d95d931699c2 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:17:10.527347 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-47bb48d2-3461-489e-8791-d95d931699c2 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:17:10.527780 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-47bb48d2-3461-489e-8791-d95d931699c2 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:17:10.555878 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-47bb48d2-3461-489e-8791-d95d931699c2 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041673 Nov 09 20:17:10.557003 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 592/1211] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:17:10 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 20:17:10.851748 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-8ebc66a6-9ff2-4248-bdb8-08dd516921df tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:17:10.852810 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-8ebc66a6-9ff2-4248-bdb8-08dd516921df tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: 90c53d4c-080d-4d25-a3eb-50c92e83f38c] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:17:10.860381 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-8ebc66a6-9ff2-4248-bdb8-08dd516921df tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:17:10.860951 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-8ebc66a6-9ff2-4248-bdb8-08dd516921df tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:17:10.861721 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-8ebc66a6-9ff2-4248-bdb8-08dd516921df tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:17:10.862148 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-8ebc66a6-9ff2-4248-bdb8-08dd516921df tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:17:10.942557 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-8ebc66a6-9ff2-4248-bdb8-08dd516921df tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "POST /compute/v2.1/servers/90c53d4c-080d-4d25-a3eb-50c92e83f38c/action" status: 200 len: 31224 microversion: 2.20 time: 0.094688 Nov 09 20:17:10.943225 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 620/1212] 10.222.0.25 () {62 vars in 1318 bytes} [Tue Nov 9 20:17:10 2021] POST /compute/v2.1/servers/90c53d4c-080d-4d25-a3eb-50c92e83f38c/action => generated 31224 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 20:17:11.567803 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-2dcec705-e2d5-46b4-a537-15e40a01c52a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:17:11.568664 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-2dcec705-e2d5-46b4-a537-15e40a01c52a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:17:11.575447 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2dcec705-e2d5-46b4-a537-15e40a01c52a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:17:11.575895 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2dcec705-e2d5-46b4-a537-15e40a01c52a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:17:11.576690 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2dcec705-e2d5-46b4-a537-15e40a01c52a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:17:11.577122 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2dcec705-e2d5-46b4-a537-15e40a01c52a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:17:11.606258 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-2dcec705-e2d5-46b4-a537-15e40a01c52a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042287 Nov 09 20:17:11.606810 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 593/1213] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:17:11 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:17:11.955004 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-98b9b6c1-8054-4fe5-a36a-47d6686c6132 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:17:11.955984 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-98b9b6c1-8054-4fe5-a36a-47d6686c6132 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: 90c53d4c-080d-4d25-a3eb-50c92e83f38c] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:17:11.962899 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-98b9b6c1-8054-4fe5-a36a-47d6686c6132 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:17:11.963460 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-98b9b6c1-8054-4fe5-a36a-47d6686c6132 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:17:11.964229 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-98b9b6c1-8054-4fe5-a36a-47d6686c6132 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:17:11.964683 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-98b9b6c1-8054-4fe5-a36a-47d6686c6132 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:17:12.041582 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-98b9b6c1-8054-4fe5-a36a-47d6686c6132 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "POST /compute/v2.1/servers/90c53d4c-080d-4d25-a3eb-50c92e83f38c/action" status: 200 len: 33082 microversion: 2.20 time: 0.090465 Nov 09 20:17:12.042212 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 621/1214] 10.222.0.25 () {62 vars in 1318 bytes} [Tue Nov 9 20:17:11 2021] POST /compute/v2.1/servers/90c53d4c-080d-4d25-a3eb-50c92e83f38c/action => generated 33082 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 20:17:12.617714 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-65ae3167-8a46-421e-96f4-b490aad0c64b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:17:12.618613 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-65ae3167-8a46-421e-96f4-b490aad0c64b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:17:12.625179 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-65ae3167-8a46-421e-96f4-b490aad0c64b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:17:12.625618 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-65ae3167-8a46-421e-96f4-b490aad0c64b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:17:12.626368 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-65ae3167-8a46-421e-96f4-b490aad0c64b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:17:12.626789 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-65ae3167-8a46-421e-96f4-b490aad0c64b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:17:12.655839 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-65ae3167-8a46-421e-96f4-b490aad0c64b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041790 Nov 09 20:17:12.656389 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 594/1215] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:17:12 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:17:13.052879 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-fcc9e4e7-9dae-419f-9c54-0a981cb9ef94 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:17:13.053870 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-fcc9e4e7-9dae-419f-9c54-0a981cb9ef94 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: 90c53d4c-080d-4d25-a3eb-50c92e83f38c] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:17:13.060765 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-fcc9e4e7-9dae-419f-9c54-0a981cb9ef94 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:17:13.061208 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-fcc9e4e7-9dae-419f-9c54-0a981cb9ef94 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:17:13.062000 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-fcc9e4e7-9dae-419f-9c54-0a981cb9ef94 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:17:13.062432 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-fcc9e4e7-9dae-419f-9c54-0a981cb9ef94 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:17:13.139519 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-fcc9e4e7-9dae-419f-9c54-0a981cb9ef94 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "POST /compute/v2.1/servers/90c53d4c-080d-4d25-a3eb-50c92e83f38c/action" status: 200 len: 33876 microversion: 2.20 time: 0.090558 Nov 09 20:17:13.140440 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 622/1216] 10.222.0.25 () {62 vars in 1318 bytes} [Tue Nov 9 20:17:13 2021] POST /compute/v2.1/servers/90c53d4c-080d-4d25-a3eb-50c92e83f38c/action => generated 33876 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 20:17:13.667134 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-8eaa7f1a-665b-4fb5-820b-6c2dd8f2004c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:17:13.668062 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-8eaa7f1a-665b-4fb5-820b-6c2dd8f2004c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:17:13.674205 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8eaa7f1a-665b-4fb5-820b-6c2dd8f2004c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:17:13.674678 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8eaa7f1a-665b-4fb5-820b-6c2dd8f2004c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:17:13.675443 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8eaa7f1a-665b-4fb5-820b-6c2dd8f2004c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:17:13.675889 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8eaa7f1a-665b-4fb5-820b-6c2dd8f2004c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:17:13.704238 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-8eaa7f1a-665b-4fb5-820b-6c2dd8f2004c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040947 Nov 09 20:17:13.704811 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 595/1217] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:17:13 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:17:14.151638 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-c97d0033-fcb5-408e-b814-79639268625d tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:17:14.152704 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-c97d0033-fcb5-408e-b814-79639268625d tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: 90c53d4c-080d-4d25-a3eb-50c92e83f38c] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:17:14.159484 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c97d0033-fcb5-408e-b814-79639268625d tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:17:14.159933 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c97d0033-fcb5-408e-b814-79639268625d tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:17:14.160745 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c97d0033-fcb5-408e-b814-79639268625d tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:17:14.161180 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c97d0033-fcb5-408e-b814-79639268625d tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:17:14.231711 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-c97d0033-fcb5-408e-b814-79639268625d tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "POST /compute/v2.1/servers/90c53d4c-080d-4d25-a3eb-50c92e83f38c/action" status: 200 len: 34924 microversion: 2.20 time: 0.084024 Nov 09 20:17:14.232341 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 623/1218] 10.222.0.25 () {62 vars in 1318 bytes} [Tue Nov 9 20:17:14 2021] POST /compute/v2.1/servers/90c53d4c-080d-4d25-a3eb-50c92e83f38c/action => generated 34924 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 20:17:14.715627 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-2aef3692-6a9f-4fdd-8013-9d2ac286604a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:17:14.716549 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-2aef3692-6a9f-4fdd-8013-9d2ac286604a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:17:14.722802 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2aef3692-6a9f-4fdd-8013-9d2ac286604a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:17:14.723256 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2aef3692-6a9f-4fdd-8013-9d2ac286604a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:17:14.724014 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2aef3692-6a9f-4fdd-8013-9d2ac286604a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:17:14.724464 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2aef3692-6a9f-4fdd-8013-9d2ac286604a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:17:14.752814 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-2aef3692-6a9f-4fdd-8013-9d2ac286604a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041617 Nov 09 20:17:14.753353 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 596/1219] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:17:14 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:17:15.244146 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-966ecd06-e7d1-4d97-b7d1-f6bd71f7e668 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:17:15.245211 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-966ecd06-e7d1-4d97-b7d1-f6bd71f7e668 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: 90c53d4c-080d-4d25-a3eb-50c92e83f38c] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:17:15.251965 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-966ecd06-e7d1-4d97-b7d1-f6bd71f7e668 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:17:15.252421 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-966ecd06-e7d1-4d97-b7d1-f6bd71f7e668 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:17:15.253214 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-966ecd06-e7d1-4d97-b7d1-f6bd71f7e668 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:17:15.253648 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-966ecd06-e7d1-4d97-b7d1-f6bd71f7e668 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:17:15.345917 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-966ecd06-e7d1-4d97-b7d1-f6bd71f7e668 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "POST /compute/v2.1/servers/90c53d4c-080d-4d25-a3eb-50c92e83f38c/action" status: 200 len: 36049 microversion: 2.20 time: 0.105679 Nov 09 20:17:15.350147 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 624/1220] 10.222.0.25 () {62 vars in 1318 bytes} [Tue Nov 9 20:17:15 2021] POST /compute/v2.1/servers/90c53d4c-080d-4d25-a3eb-50c92e83f38c/action => generated 36049 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 20:17:15.763064 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-f673cce8-ffa7-4e5d-b8a9-f50bf85c65a9 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:17:15.763967 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-f673cce8-ffa7-4e5d-b8a9-f50bf85c65a9 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:17:15.770373 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f673cce8-ffa7-4e5d-b8a9-f50bf85c65a9 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:17:15.770813 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f673cce8-ffa7-4e5d-b8a9-f50bf85c65a9 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:17:15.771573 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f673cce8-ffa7-4e5d-b8a9-f50bf85c65a9 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:17:15.771995 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f673cce8-ffa7-4e5d-b8a9-f50bf85c65a9 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:17:15.800786 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-f673cce8-ffa7-4e5d-b8a9-f50bf85c65a9 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041444 Nov 09 20:17:15.801328 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 597/1221] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:17:15 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:17:16.358885 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-fa123cc8-579d-4b6b-9001-fd09a76b6148 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:17:16.359885 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-fa123cc8-579d-4b6b-9001-fd09a76b6148 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: 90c53d4c-080d-4d25-a3eb-50c92e83f38c] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:17:16.366734 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-fa123cc8-579d-4b6b-9001-fd09a76b6148 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:17:16.367123 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-fa123cc8-579d-4b6b-9001-fd09a76b6148 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:17:16.367901 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-fa123cc8-579d-4b6b-9001-fd09a76b6148 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:17:16.368375 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-fa123cc8-579d-4b6b-9001-fd09a76b6148 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:17:16.439624 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-fa123cc8-579d-4b6b-9001-fd09a76b6148 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "POST /compute/v2.1/servers/90c53d4c-080d-4d25-a3eb-50c92e83f38c/action" status: 200 len: 37705 microversion: 2.20 time: 0.084877 Nov 09 20:17:16.440505 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 625/1222] 10.222.0.25 () {62 vars in 1318 bytes} [Tue Nov 9 20:17:16 2021] POST /compute/v2.1/servers/90c53d4c-080d-4d25-a3eb-50c92e83f38c/action => generated 37705 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 20:17:16.811578 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-3a129f11-8821-40f9-af11-2318a8b753bb tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:17:16.812392 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-3a129f11-8821-40f9-af11-2318a8b753bb tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:17:16.818588 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3a129f11-8821-40f9-af11-2318a8b753bb tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:17:16.819029 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3a129f11-8821-40f9-af11-2318a8b753bb tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:17:16.819818 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3a129f11-8821-40f9-af11-2318a8b753bb tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:17:16.820246 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3a129f11-8821-40f9-af11-2318a8b753bb tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:17:16.848010 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-3a129f11-8821-40f9-af11-2318a8b753bb tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040250 Nov 09 20:17:16.848798 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 598/1223] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:17:16 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:17:17.451882 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-0aff1802-ca79-409a-b75f-f64a650f55fe tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:17:17.452896 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-0aff1802-ca79-409a-b75f-f64a650f55fe tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: 90c53d4c-080d-4d25-a3eb-50c92e83f38c] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:17:17.459758 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-0aff1802-ca79-409a-b75f-f64a650f55fe tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:17:17.460333 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-0aff1802-ca79-409a-b75f-f64a650f55fe tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:17:17.461043 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-0aff1802-ca79-409a-b75f-f64a650f55fe tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:17:17.461523 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-0aff1802-ca79-409a-b75f-f64a650f55fe tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:17:17.535909 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-0aff1802-ca79-409a-b75f-f64a650f55fe tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "POST /compute/v2.1/servers/90c53d4c-080d-4d25-a3eb-50c92e83f38c/action" status: 200 len: 38203 microversion: 2.20 time: 0.087878 Nov 09 20:17:17.536619 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 626/1224] 10.222.0.25 () {62 vars in 1318 bytes} [Tue Nov 9 20:17:17 2021] POST /compute/v2.1/servers/90c53d4c-080d-4d25-a3eb-50c92e83f38c/action => generated 38203 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 20:17:17.859627 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-9640ed00-e8d5-45a0-989a-6932f3bba366 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:17:17.860660 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-9640ed00-e8d5-45a0-989a-6932f3bba366 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:17:17.866827 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9640ed00-e8d5-45a0-989a-6932f3bba366 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:17:17.867260 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9640ed00-e8d5-45a0-989a-6932f3bba366 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:17:17.868012 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9640ed00-e8d5-45a0-989a-6932f3bba366 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:17:17.868462 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9640ed00-e8d5-45a0-989a-6932f3bba366 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:17:17.897649 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-9640ed00-e8d5-45a0-989a-6932f3bba366 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041969 Nov 09 20:17:17.898181 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 599/1225] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:17:17 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:17:18.548539 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-2e50bbdd-189d-4106-a244-50a3a76ded43 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:17:18.549525 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-2e50bbdd-189d-4106-a244-50a3a76ded43 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: 90c53d4c-080d-4d25-a3eb-50c92e83f38c] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:17:18.556295 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-2e50bbdd-189d-4106-a244-50a3a76ded43 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:17:18.556765 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-2e50bbdd-189d-4106-a244-50a3a76ded43 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:17:18.557528 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-2e50bbdd-189d-4106-a244-50a3a76ded43 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:17:18.558113 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-2e50bbdd-189d-4106-a244-50a3a76ded43 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:17:18.619769 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-2e50bbdd-189d-4106-a244-50a3a76ded43 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "POST /compute/v2.1/servers/90c53d4c-080d-4d25-a3eb-50c92e83f38c/action" status: 200 len: 38203 microversion: 2.20 time: 0.075074 Nov 09 20:17:18.621004 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 627/1226] 10.222.0.25 () {62 vars in 1318 bytes} [Tue Nov 9 20:17:18 2021] POST /compute/v2.1/servers/90c53d4c-080d-4d25-a3eb-50c92e83f38c/action => generated 38203 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 20:17:18.909201 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-f7f31200-efa7-4459-89af-9d438c83cbb7 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:17:18.910110 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-f7f31200-efa7-4459-89af-9d438c83cbb7 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:17:18.916294 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f7f31200-efa7-4459-89af-9d438c83cbb7 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:17:18.916774 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f7f31200-efa7-4459-89af-9d438c83cbb7 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:17:18.918075 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f7f31200-efa7-4459-89af-9d438c83cbb7 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:17:18.918503 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f7f31200-efa7-4459-89af-9d438c83cbb7 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:17:18.946602 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-f7f31200-efa7-4459-89af-9d438c83cbb7 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041162 Nov 09 20:17:18.947140 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 600/1227] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:17:18 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:17:19.632369 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-d9c3cff6-e646-4f71-9571-8aa0df77d713 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:17:19.633380 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-d9c3cff6-e646-4f71-9571-8aa0df77d713 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: 90c53d4c-080d-4d25-a3eb-50c92e83f38c] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:17:19.640669 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d9c3cff6-e646-4f71-9571-8aa0df77d713 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:17:19.641110 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d9c3cff6-e646-4f71-9571-8aa0df77d713 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:17:19.641872 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d9c3cff6-e646-4f71-9571-8aa0df77d713 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:17:19.642300 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d9c3cff6-e646-4f71-9571-8aa0df77d713 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:17:19.701232 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-d9c3cff6-e646-4f71-9571-8aa0df77d713 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "POST /compute/v2.1/servers/90c53d4c-080d-4d25-a3eb-50c92e83f38c/action" status: 200 len: 38203 microversion: 2.20 time: 0.072623 Nov 09 20:17:19.701979 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 628/1228] 10.222.0.25 () {62 vars in 1318 bytes} [Tue Nov 9 20:17:19 2021] POST /compute/v2.1/servers/90c53d4c-080d-4d25-a3eb-50c92e83f38c/action => generated 38203 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 20:17:19.957908 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-8e776b08-9d87-4489-af9f-618f6f4ac0a9 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:17:19.958797 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-8e776b08-9d87-4489-af9f-618f6f4ac0a9 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:17:19.965154 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8e776b08-9d87-4489-af9f-618f6f4ac0a9 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:17:19.965594 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8e776b08-9d87-4489-af9f-618f6f4ac0a9 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:17:19.966346 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8e776b08-9d87-4489-af9f-618f6f4ac0a9 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:17:19.966768 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8e776b08-9d87-4489-af9f-618f6f4ac0a9 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:17:19.994631 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-8e776b08-9d87-4489-af9f-618f6f4ac0a9 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040479 Nov 09 20:17:19.995724 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 601/1229] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:17:19 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:17:20.713504 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-2ce463a6-874e-4db6-b028-01effb2291f2 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:17:20.715076 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-2ce463a6-874e-4db6-b028-01effb2291f2 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: 90c53d4c-080d-4d25-a3eb-50c92e83f38c] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:17:20.721816 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-2ce463a6-874e-4db6-b028-01effb2291f2 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:17:20.722266 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-2ce463a6-874e-4db6-b028-01effb2291f2 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:17:20.723039 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-2ce463a6-874e-4db6-b028-01effb2291f2 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:17:20.723480 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-2ce463a6-874e-4db6-b028-01effb2291f2 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:17:20.798215 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-2ce463a6-874e-4db6-b028-01effb2291f2 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "POST /compute/v2.1/servers/90c53d4c-080d-4d25-a3eb-50c92e83f38c/action" status: 200 len: 38337 microversion: 2.20 time: 0.088340 Nov 09 20:17:20.801187 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 629/1230] 10.222.0.25 () {62 vars in 1318 bytes} [Tue Nov 9 20:17:20 2021] POST /compute/v2.1/servers/90c53d4c-080d-4d25-a3eb-50c92e83f38c/action => generated 38337 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 20:17:21.006329 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-39dd5f7b-2c87-48a9-a60f-1587a0484162 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:17:21.007236 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-39dd5f7b-2c87-48a9-a60f-1587a0484162 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:17:21.013999 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-39dd5f7b-2c87-48a9-a60f-1587a0484162 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:17:21.014448 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-39dd5f7b-2c87-48a9-a60f-1587a0484162 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:17:21.015215 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-39dd5f7b-2c87-48a9-a60f-1587a0484162 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:17:21.015647 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-39dd5f7b-2c87-48a9-a60f-1587a0484162 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:17:21.046506 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-39dd5f7b-2c87-48a9-a60f-1587a0484162 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043854 Nov 09 20:17:21.047060 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 602/1231] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:17:21 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:17:21.810628 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-a3bf67a9-3b29-4b80-8b41-4f30f4c2c843 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:17:21.811669 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-a3bf67a9-3b29-4b80-8b41-4f30f4c2c843 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: 90c53d4c-080d-4d25-a3eb-50c92e83f38c] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:17:21.818667 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a3bf67a9-3b29-4b80-8b41-4f30f4c2c843 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:17:21.819111 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a3bf67a9-3b29-4b80-8b41-4f30f4c2c843 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:17:21.819879 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a3bf67a9-3b29-4b80-8b41-4f30f4c2c843 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:17:21.820305 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a3bf67a9-3b29-4b80-8b41-4f30f4c2c843 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:17:21.889803 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-a3bf67a9-3b29-4b80-8b41-4f30f4c2c843 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "POST /compute/v2.1/servers/90c53d4c-080d-4d25-a3eb-50c92e83f38c/action" status: 200 len: 38344 microversion: 2.20 time: 0.083653 Nov 09 20:17:21.890332 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 630/1232] 10.222.0.25 () {62 vars in 1318 bytes} [Tue Nov 9 20:17:21 2021] POST /compute/v2.1/servers/90c53d4c-080d-4d25-a3eb-50c92e83f38c/action => generated 38344 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 20:17:21.900121 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-a7a9f30d-900e-4547-a38b-359fec9e44da tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:17:21.900638 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-a7a9f30d-900e-4547-a38b-359fec9e44da tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: 90c53d4c-080d-4d25-a3eb-50c92e83f38c] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:17:21.906517 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a7a9f30d-900e-4547-a38b-359fec9e44da tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:17:21.906963 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a7a9f30d-900e-4547-a38b-359fec9e44da tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:17:21.907732 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a7a9f30d-900e-4547-a38b-359fec9e44da tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:17:21.908165 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a7a9f30d-900e-4547-a38b-359fec9e44da tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:17:21.930728 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-a7a9f30d-900e-4547-a38b-359fec9e44da tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/90c53d4c-080d-4d25-a3eb-50c92e83f38c/ips" status: 200 len: 151 microversion: 2.20 time: 0.034282 Nov 09 20:17:21.931279 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 603/1233] 10.222.0.25 () {60 vars in 1288 bytes} [Tue Nov 9 20:17:21 2021] GET /compute/v2.1/servers/90c53d4c-080d-4d25-a3eb-50c92e83f38c/ips => generated 151 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 20:17:22.058427 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-89665b8a-f92d-4b58-b14a-5092a1cd9530 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:17:22.060408 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-89665b8a-f92d-4b58-b14a-5092a1cd9530 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:17:22.067421 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-89665b8a-f92d-4b58-b14a-5092a1cd9530 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:17:22.067874 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-89665b8a-f92d-4b58-b14a-5092a1cd9530 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:17:22.068756 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-89665b8a-f92d-4b58-b14a-5092a1cd9530 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:17:22.069197 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-89665b8a-f92d-4b58-b14a-5092a1cd9530 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:17:22.103199 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-89665b8a-f92d-4b58-b14a-5092a1cd9530 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049278 Nov 09 20:17:22.103891 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 631/1234] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:17:22 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:17:23.116052 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-b1bc9f75-32ea-4062-8172-3cbcec095b37 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:17:23.116994 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-b1bc9f75-32ea-4062-8172-3cbcec095b37 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:17:23.125221 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b1bc9f75-32ea-4062-8172-3cbcec095b37 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:17:23.125221 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b1bc9f75-32ea-4062-8172-3cbcec095b37 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:17:23.125708 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b1bc9f75-32ea-4062-8172-3cbcec095b37 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:17:23.126808 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b1bc9f75-32ea-4062-8172-3cbcec095b37 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:17:23.157973 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-b1bc9f75-32ea-4062-8172-3cbcec095b37 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045621 Nov 09 20:17:23.158532 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 604/1235] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:17:23 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:17:24.169553 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-6ed4284a-800f-4f16-987a-abe451b9fdf0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:17:24.170472 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-6ed4284a-800f-4f16-987a-abe451b9fdf0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:17:24.176908 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6ed4284a-800f-4f16-987a-abe451b9fdf0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:17:24.177349 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6ed4284a-800f-4f16-987a-abe451b9fdf0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:17:24.178118 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6ed4284a-800f-4f16-987a-abe451b9fdf0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:17:24.178542 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6ed4284a-800f-4f16-987a-abe451b9fdf0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:17:24.211909 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-6ed4284a-800f-4f16-987a-abe451b9fdf0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046137 Nov 09 20:17:24.212487 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 632/1236] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:17:24 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:17:25.223548 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-b75793c7-0e0f-46b4-80aa-4f44df450086 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:17:25.224485 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-b75793c7-0e0f-46b4-80aa-4f44df450086 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:17:25.231398 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b75793c7-0e0f-46b4-80aa-4f44df450086 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:17:25.231846 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b75793c7-0e0f-46b4-80aa-4f44df450086 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:17:25.232641 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b75793c7-0e0f-46b4-80aa-4f44df450086 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:17:25.233327 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b75793c7-0e0f-46b4-80aa-4f44df450086 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:17:25.261135 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-b75793c7-0e0f-46b4-80aa-4f44df450086 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041225 Nov 09 20:17:25.261701 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 605/1237] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:17:25 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:17:26.272603 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-28bcb064-5c09-457b-ab2f-2777a68f8a06 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:17:26.273537 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-28bcb064-5c09-457b-ab2f-2777a68f8a06 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:17:26.279872 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-28bcb064-5c09-457b-ab2f-2777a68f8a06 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:17:26.280317 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-28bcb064-5c09-457b-ab2f-2777a68f8a06 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:17:26.281166 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-28bcb064-5c09-457b-ab2f-2777a68f8a06 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:17:26.281600 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-28bcb064-5c09-457b-ab2f-2777a68f8a06 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:17:26.313340 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-28bcb064-5c09-457b-ab2f-2777a68f8a06 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044465 Nov 09 20:17:26.313901 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 633/1238] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:17:26 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:17:27.325212 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-5159927e-797f-42c9-8cf4-d37a169688c8 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:17:27.326112 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-5159927e-797f-42c9-8cf4-d37a169688c8 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:17:27.332312 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5159927e-797f-42c9-8cf4-d37a169688c8 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:17:27.332785 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5159927e-797f-42c9-8cf4-d37a169688c8 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:17:27.333551 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5159927e-797f-42c9-8cf4-d37a169688c8 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:17:27.333983 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5159927e-797f-42c9-8cf4-d37a169688c8 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:17:27.362570 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-5159927e-797f-42c9-8cf4-d37a169688c8 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041605 Nov 09 20:17:27.363122 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 606/1239] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:17:27 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:17:28.374799 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-dda03039-3aaa-4560-bb0e-07bd05a5437d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:17:28.375736 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-dda03039-3aaa-4560-bb0e-07bd05a5437d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:17:28.381994 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-dda03039-3aaa-4560-bb0e-07bd05a5437d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:17:28.382439 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-dda03039-3aaa-4560-bb0e-07bd05a5437d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:17:28.383210 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-dda03039-3aaa-4560-bb0e-07bd05a5437d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:17:28.383644 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-dda03039-3aaa-4560-bb0e-07bd05a5437d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:17:28.412418 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-dda03039-3aaa-4560-bb0e-07bd05a5437d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041800 Nov 09 20:17:28.413200 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 634/1240] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:17:28 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:17:29.423581 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-ebb48323-69c6-4ac4-82ea-18d20fd47e37 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:17:29.424499 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-ebb48323-69c6-4ac4-82ea-18d20fd47e37 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:17:29.430596 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ebb48323-69c6-4ac4-82ea-18d20fd47e37 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:17:29.431033 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ebb48323-69c6-4ac4-82ea-18d20fd47e37 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:17:29.431790 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ebb48323-69c6-4ac4-82ea-18d20fd47e37 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:17:29.432212 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ebb48323-69c6-4ac4-82ea-18d20fd47e37 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:17:29.460651 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-ebb48323-69c6-4ac4-82ea-18d20fd47e37 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040826 Nov 09 20:17:29.461203 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 607/1241] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:17:29 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:17:30.471525 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-b5c88621-53da-410a-b806-cd5bc5c51f6f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:17:30.472451 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-b5c88621-53da-410a-b806-cd5bc5c51f6f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:17:30.478712 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b5c88621-53da-410a-b806-cd5bc5c51f6f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:17:30.479164 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b5c88621-53da-410a-b806-cd5bc5c51f6f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:17:30.479935 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b5c88621-53da-410a-b806-cd5bc5c51f6f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:17:30.480374 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b5c88621-53da-410a-b806-cd5bc5c51f6f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:17:30.510107 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-b5c88621-53da-410a-b806-cd5bc5c51f6f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042268 Nov 09 20:17:30.510675 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 635/1242] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:17:30 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:17:31.520953 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-45b0a0a3-4800-4e5c-9aaf-ee3b5a6a9785 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:17:31.521869 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-45b0a0a3-4800-4e5c-9aaf-ee3b5a6a9785 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:17:31.528276 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-45b0a0a3-4800-4e5c-9aaf-ee3b5a6a9785 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:17:31.528754 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-45b0a0a3-4800-4e5c-9aaf-ee3b5a6a9785 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:17:31.529529 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-45b0a0a3-4800-4e5c-9aaf-ee3b5a6a9785 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:17:31.529961 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-45b0a0a3-4800-4e5c-9aaf-ee3b5a6a9785 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:17:31.559919 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-45b0a0a3-4800-4e5c-9aaf-ee3b5a6a9785 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042698 Nov 09 20:17:31.560678 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 608/1243] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:17:31 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:17:32.571025 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-79c5dfa0-86ae-4508-bd59-80ddbeef9860 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:17:32.571845 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-79c5dfa0-86ae-4508-bd59-80ddbeef9860 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:17:32.578488 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-79c5dfa0-86ae-4508-bd59-80ddbeef9860 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:17:32.578926 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-79c5dfa0-86ae-4508-bd59-80ddbeef9860 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:17:32.579687 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-79c5dfa0-86ae-4508-bd59-80ddbeef9860 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:17:32.580111 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-79c5dfa0-86ae-4508-bd59-80ddbeef9860 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:17:32.609779 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-79c5dfa0-86ae-4508-bd59-80ddbeef9860 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042523 Nov 09 20:17:32.610336 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 636/1244] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:17:32 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:17:33.620651 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-357367f2-189c-46d6-bf92-ce3821593d92 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:17:33.621596 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-357367f2-189c-46d6-bf92-ce3821593d92 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:17:33.627895 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-357367f2-189c-46d6-bf92-ce3821593d92 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:17:33.628344 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-357367f2-189c-46d6-bf92-ce3821593d92 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:17:33.629147 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-357367f2-189c-46d6-bf92-ce3821593d92 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:17:33.629578 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-357367f2-189c-46d6-bf92-ce3821593d92 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:17:33.658780 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-357367f2-189c-46d6-bf92-ce3821593d92 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041991 Nov 09 20:17:33.659346 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 609/1245] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:17:33 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:17:34.671053 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-ff4deeef-91e8-430f-be23-a872dca2bd79 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:17:34.671964 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-ff4deeef-91e8-430f-be23-a872dca2bd79 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:17:34.678221 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ff4deeef-91e8-430f-be23-a872dca2bd79 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:17:34.678664 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ff4deeef-91e8-430f-be23-a872dca2bd79 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:17:34.679437 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ff4deeef-91e8-430f-be23-a872dca2bd79 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:17:34.679867 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ff4deeef-91e8-430f-be23-a872dca2bd79 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:17:34.710127 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-ff4deeef-91e8-430f-be23-a872dca2bd79 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043915 Nov 09 20:17:34.710671 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 637/1246] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:17:34 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:17:35.721456 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-2abf7742-9a37-45c6-862b-d39e5f57e48d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:17:35.722362 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-2abf7742-9a37-45c6-862b-d39e5f57e48d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:17:35.728637 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2abf7742-9a37-45c6-862b-d39e5f57e48d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:17:35.729081 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2abf7742-9a37-45c6-862b-d39e5f57e48d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:17:35.729844 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2abf7742-9a37-45c6-862b-d39e5f57e48d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:17:35.730272 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2abf7742-9a37-45c6-862b-d39e5f57e48d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:17:35.760321 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-2abf7742-9a37-45c6-862b-d39e5f57e48d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042588 Nov 09 20:17:35.760892 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 610/1247] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:17:35 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:17:36.772447 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-f776ce64-282a-4775-8a50-862d6df6e316 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:17:36.773234 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-f776ce64-282a-4775-8a50-862d6df6e316 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:17:36.780491 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f776ce64-282a-4775-8a50-862d6df6e316 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:17:36.780944 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f776ce64-282a-4775-8a50-862d6df6e316 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:17:36.781724 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f776ce64-282a-4775-8a50-862d6df6e316 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:17:36.782155 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f776ce64-282a-4775-8a50-862d6df6e316 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:17:36.810580 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-f776ce64-282a-4775-8a50-862d6df6e316 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042043 Nov 09 20:17:36.811138 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 638/1248] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:17:36 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:17:37.820753 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-deff3479-614e-4ae4-b401-abebf5e430f6 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:17:37.821628 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-deff3479-614e-4ae4-b401-abebf5e430f6 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:17:37.828188 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-deff3479-614e-4ae4-b401-abebf5e430f6 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:17:37.828653 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-deff3479-614e-4ae4-b401-abebf5e430f6 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:17:37.829415 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-deff3479-614e-4ae4-b401-abebf5e430f6 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:17:37.829838 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-deff3479-614e-4ae4-b401-abebf5e430f6 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:17:37.859280 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-deff3479-614e-4ae4-b401-abebf5e430f6 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042265 Nov 09 20:17:37.859824 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 611/1249] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:17:37 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:17:38.870337 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-f22dd17b-4517-4071-9d09-793add55179e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:17:38.871277 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-f22dd17b-4517-4071-9d09-793add55179e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:17:38.877484 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f22dd17b-4517-4071-9d09-793add55179e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:17:38.877827 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f22dd17b-4517-4071-9d09-793add55179e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:17:38.878599 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f22dd17b-4517-4071-9d09-793add55179e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:17:38.879028 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f22dd17b-4517-4071-9d09-793add55179e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:17:38.907704 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-f22dd17b-4517-4071-9d09-793add55179e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040982 Nov 09 20:17:38.908246 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 639/1250] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:17:38 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:17:39.918539 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-b6b7061a-4d38-429b-9f41-956535776a72 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:17:39.919444 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-b6b7061a-4d38-429b-9f41-956535776a72 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:17:39.926318 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b6b7061a-4d38-429b-9f41-956535776a72 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:17:39.926808 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b6b7061a-4d38-429b-9f41-956535776a72 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:17:39.927580 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b6b7061a-4d38-429b-9f41-956535776a72 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:17:39.928009 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b6b7061a-4d38-429b-9f41-956535776a72 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:17:39.956497 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-b6b7061a-4d38-429b-9f41-956535776a72 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041598 Nov 09 20:17:39.957046 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 612/1251] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:17:39 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:17:40.967705 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-7e82e5c1-8b8e-4fdf-a87a-6f61234047cf tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:17:40.968658 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-7e82e5c1-8b8e-4fdf-a87a-6f61234047cf tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:17:40.974828 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-7e82e5c1-8b8e-4fdf-a87a-6f61234047cf tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:17:40.975275 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-7e82e5c1-8b8e-4fdf-a87a-6f61234047cf tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:17:40.976086 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-7e82e5c1-8b8e-4fdf-a87a-6f61234047cf tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:17:40.976496 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-7e82e5c1-8b8e-4fdf-a87a-6f61234047cf tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:17:41.005388 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-7e82e5c1-8b8e-4fdf-a87a-6f61234047cf tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041584 Nov 09 20:17:41.005942 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 640/1252] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:17:40 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:17:42.017632 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-e072a366-dc71-4016-b863-9f2fa6b9f91c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:17:42.018699 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-e072a366-dc71-4016-b863-9f2fa6b9f91c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:17:42.024681 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e072a366-dc71-4016-b863-9f2fa6b9f91c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:17:42.025128 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e072a366-dc71-4016-b863-9f2fa6b9f91c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:17:42.025903 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e072a366-dc71-4016-b863-9f2fa6b9f91c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:17:42.026334 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e072a366-dc71-4016-b863-9f2fa6b9f91c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:17:42.056796 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-e072a366-dc71-4016-b863-9f2fa6b9f91c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043899 Nov 09 20:17:42.057340 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 613/1253] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:17:42 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:17:43.068201 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-4a161b89-6f80-4c05-8b1e-0a459a0dce3e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:17:43.069136 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-4a161b89-6f80-4c05-8b1e-0a459a0dce3e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:17:43.075298 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-4a161b89-6f80-4c05-8b1e-0a459a0dce3e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:17:43.075750 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-4a161b89-6f80-4c05-8b1e-0a459a0dce3e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:17:43.076927 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-4a161b89-6f80-4c05-8b1e-0a459a0dce3e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:17:43.077366 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-4a161b89-6f80-4c05-8b1e-0a459a0dce3e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:17:43.105650 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-4a161b89-6f80-4c05-8b1e-0a459a0dce3e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041122 Nov 09 20:17:43.106194 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 641/1254] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:17:43 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:17:44.117453 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-c20096b5-aa90-46c3-b36e-29056c060caf tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:17:44.118398 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-c20096b5-aa90-46c3-b36e-29056c060caf tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:17:44.125254 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c20096b5-aa90-46c3-b36e-29056c060caf tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:17:44.125709 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c20096b5-aa90-46c3-b36e-29056c060caf tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:17:44.126493 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c20096b5-aa90-46c3-b36e-29056c060caf tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:17:44.126928 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c20096b5-aa90-46c3-b36e-29056c060caf tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:17:44.157210 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-c20096b5-aa90-46c3-b36e-29056c060caf tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043366 Nov 09 20:17:44.157774 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 614/1255] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:17:44 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:17:45.168241 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-f8fab537-b581-455e-bfdd-124a235ac61e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:17:45.169202 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-f8fab537-b581-455e-bfdd-124a235ac61e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:17:45.175735 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f8fab537-b581-455e-bfdd-124a235ac61e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:17:45.176217 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f8fab537-b581-455e-bfdd-124a235ac61e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:17:45.177022 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f8fab537-b581-455e-bfdd-124a235ac61e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:17:45.177452 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f8fab537-b581-455e-bfdd-124a235ac61e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:17:45.206252 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-f8fab537-b581-455e-bfdd-124a235ac61e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041703 Nov 09 20:17:45.206809 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 642/1256] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:17:45 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:17:46.217893 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-86e27498-cda6-439a-9c17-038c75b91803 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:17:46.218798 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-86e27498-cda6-439a-9c17-038c75b91803 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:17:46.225023 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-86e27498-cda6-439a-9c17-038c75b91803 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:17:46.225460 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-86e27498-cda6-439a-9c17-038c75b91803 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:17:46.226217 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-86e27498-cda6-439a-9c17-038c75b91803 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:17:46.226639 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-86e27498-cda6-439a-9c17-038c75b91803 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:17:46.255056 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-86e27498-cda6-439a-9c17-038c75b91803 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041571 Nov 09 20:17:46.255607 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 615/1257] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:17:46 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:17:47.267132 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-8b8a2f1a-6af5-43ba-9a5f-57e0e74905df tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:17:47.267968 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-8b8a2f1a-6af5-43ba-9a5f-57e0e74905df tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:17:47.274190 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-8b8a2f1a-6af5-43ba-9a5f-57e0e74905df tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:17:47.274640 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-8b8a2f1a-6af5-43ba-9a5f-57e0e74905df tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:17:47.275414 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-8b8a2f1a-6af5-43ba-9a5f-57e0e74905df tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:17:47.275848 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-8b8a2f1a-6af5-43ba-9a5f-57e0e74905df tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:17:47.304741 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-8b8a2f1a-6af5-43ba-9a5f-57e0e74905df tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042115 Nov 09 20:17:47.305292 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 643/1258] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:17:47 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:17:48.316494 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-89d93414-dee6-47b9-bef3-968929c343b8 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:17:48.317411 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-89d93414-dee6-47b9-bef3-968929c343b8 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:17:48.323580 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-89d93414-dee6-47b9-bef3-968929c343b8 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:17:48.324027 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-89d93414-dee6-47b9-bef3-968929c343b8 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:17:48.324824 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-89d93414-dee6-47b9-bef3-968929c343b8 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:17:48.325258 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-89d93414-dee6-47b9-bef3-968929c343b8 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:17:48.353130 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-89d93414-dee6-47b9-bef3-968929c343b8 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040430 Nov 09 20:17:48.353676 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 616/1259] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:17:48 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:17:49.364506 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-2b1c51b0-e742-4c72-bede-5778ded5b8ff tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:17:49.365435 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-2b1c51b0-e742-4c72-bede-5778ded5b8ff tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:17:49.371633 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-2b1c51b0-e742-4c72-bede-5778ded5b8ff tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:17:49.372077 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-2b1c51b0-e742-4c72-bede-5778ded5b8ff tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:17:49.373590 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-2b1c51b0-e742-4c72-bede-5778ded5b8ff tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:17:49.374028 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-2b1c51b0-e742-4c72-bede-5778ded5b8ff tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:17:49.402241 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-2b1c51b0-e742-4c72-bede-5778ded5b8ff tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041482 Nov 09 20:17:49.402781 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 644/1260] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:17:49 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:17:50.413951 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-96ce38b1-5cf8-4790-a587-3149528b61b6 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:17:50.414781 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-96ce38b1-5cf8-4790-a587-3149528b61b6 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:17:50.421136 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-96ce38b1-5cf8-4790-a587-3149528b61b6 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:17:50.421573 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-96ce38b1-5cf8-4790-a587-3149528b61b6 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:17:50.422328 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-96ce38b1-5cf8-4790-a587-3149528b61b6 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:17:50.422749 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-96ce38b1-5cf8-4790-a587-3149528b61b6 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:17:50.450434 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-96ce38b1-5cf8-4790-a587-3149528b61b6 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040313 Nov 09 20:17:50.451999 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 617/1261] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:17:50 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:17:51.462657 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-0d2a5581-6d22-4fcd-8d94-8da37409559b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:17:51.463562 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-0d2a5581-6d22-4fcd-8d94-8da37409559b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:17:51.470360 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-0d2a5581-6d22-4fcd-8d94-8da37409559b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:17:51.470806 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-0d2a5581-6d22-4fcd-8d94-8da37409559b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:17:51.471581 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-0d2a5581-6d22-4fcd-8d94-8da37409559b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:17:51.472019 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-0d2a5581-6d22-4fcd-8d94-8da37409559b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:17:51.500960 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-0d2a5581-6d22-4fcd-8d94-8da37409559b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042047 Nov 09 20:17:51.501517 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 645/1262] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:17:51 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:17:52.639426 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-2a970cc5-9261-4b57-9431-20dacb3417d0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:17:52.640591 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-2a970cc5-9261-4b57-9431-20dacb3417d0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:17:52.646091 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2a970cc5-9261-4b57-9431-20dacb3417d0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:17:52.646539 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2a970cc5-9261-4b57-9431-20dacb3417d0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:17:52.647305 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2a970cc5-9261-4b57-9431-20dacb3417d0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:17:52.647735 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2a970cc5-9261-4b57-9431-20dacb3417d0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:17:52.676373 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-2a970cc5-9261-4b57-9431-20dacb3417d0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.167967 Nov 09 20:17:52.676952 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 618/1263] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:17:52 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:17:53.688088 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-3c30c869-dc02-4e1c-939c-e0b4d46468ce tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:17:53.689015 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-3c30c869-dc02-4e1c-939c-e0b4d46468ce tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:17:53.695211 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-3c30c869-dc02-4e1c-939c-e0b4d46468ce tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:17:53.695658 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-3c30c869-dc02-4e1c-939c-e0b4d46468ce tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:17:53.696446 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-3c30c869-dc02-4e1c-939c-e0b4d46468ce tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:17:53.696881 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-3c30c869-dc02-4e1c-939c-e0b4d46468ce tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:17:53.725913 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-3c30c869-dc02-4e1c-939c-e0b4d46468ce tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042105 Nov 09 20:17:53.726463 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 646/1264] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:17:53 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:17:54.737745 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-c0a9e4f5-7068-4eaf-affe-ee329511dc76 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:17:54.738648 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-c0a9e4f5-7068-4eaf-affe-ee329511dc76 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:17:54.744871 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c0a9e4f5-7068-4eaf-affe-ee329511dc76 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:17:54.745322 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c0a9e4f5-7068-4eaf-affe-ee329511dc76 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:17:54.746129 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c0a9e4f5-7068-4eaf-affe-ee329511dc76 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:17:54.746571 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c0a9e4f5-7068-4eaf-affe-ee329511dc76 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:17:54.775096 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-c0a9e4f5-7068-4eaf-affe-ee329511dc76 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041767 Nov 09 20:17:54.775647 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 619/1265] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:17:54 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:17:55.787098 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-068aac9f-ade3-44c5-bb8b-bea823d9205c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:17:55.788018 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-068aac9f-ade3-44c5-bb8b-bea823d9205c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:17:55.794208 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-068aac9f-ade3-44c5-bb8b-bea823d9205c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:17:55.794656 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-068aac9f-ade3-44c5-bb8b-bea823d9205c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:17:55.795429 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-068aac9f-ade3-44c5-bb8b-bea823d9205c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:17:55.795870 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-068aac9f-ade3-44c5-bb8b-bea823d9205c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:17:55.824363 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-068aac9f-ade3-44c5-bb8b-bea823d9205c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040983 Nov 09 20:17:55.824889 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 647/1266] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:17:55 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:17:56.836390 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-2fcfa436-9656-4a0b-9ff6-a07699a43c35 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:17:56.837319 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-2fcfa436-9656-4a0b-9ff6-a07699a43c35 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:17:56.843648 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2fcfa436-9656-4a0b-9ff6-a07699a43c35 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:17:56.844098 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2fcfa436-9656-4a0b-9ff6-a07699a43c35 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:17:56.844898 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2fcfa436-9656-4a0b-9ff6-a07699a43c35 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:17:56.845339 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2fcfa436-9656-4a0b-9ff6-a07699a43c35 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:17:56.875785 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-2fcfa436-9656-4a0b-9ff6-a07699a43c35 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043263 Nov 09 20:17:56.876560 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 620/1267] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:17:56 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:17:57.886896 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-b1a64edd-fad1-446d-9635-796b6291b623 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:17:57.887794 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-b1a64edd-fad1-446d-9635-796b6291b623 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:17:57.894061 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b1a64edd-fad1-446d-9635-796b6291b623 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:17:57.894499 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b1a64edd-fad1-446d-9635-796b6291b623 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:17:57.895257 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b1a64edd-fad1-446d-9635-796b6291b623 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:17:57.895684 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b1a64edd-fad1-446d-9635-796b6291b623 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:17:57.926056 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-b1a64edd-fad1-446d-9635-796b6291b623 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042863 Nov 09 20:17:57.926609 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 648/1268] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:17:57 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:17:58.938023 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-c7cd1584-9feb-43ee-82e9-5fff153511aa tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:17:58.938919 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-c7cd1584-9feb-43ee-82e9-5fff153511aa tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:17:58.945135 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c7cd1584-9feb-43ee-82e9-5fff153511aa tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:17:58.945579 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c7cd1584-9feb-43ee-82e9-5fff153511aa tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:17:58.946342 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c7cd1584-9feb-43ee-82e9-5fff153511aa tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:17:58.946772 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c7cd1584-9feb-43ee-82e9-5fff153511aa tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:17:58.975658 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-c7cd1584-9feb-43ee-82e9-5fff153511aa tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041986 Nov 09 20:17:58.976395 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 621/1269] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:17:58 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:17:59.986506 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-fc71a1f0-57db-455c-b7d8-1b7629f2c470 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:17:59.987443 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-fc71a1f0-57db-455c-b7d8-1b7629f2c470 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:17:59.993607 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-fc71a1f0-57db-455c-b7d8-1b7629f2c470 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:17:59.994064 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-fc71a1f0-57db-455c-b7d8-1b7629f2c470 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:17:59.994843 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-fc71a1f0-57db-455c-b7d8-1b7629f2c470 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:17:59.995281 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-fc71a1f0-57db-455c-b7d8-1b7629f2c470 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:18:00.024563 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-fc71a1f0-57db-455c-b7d8-1b7629f2c470 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041974 Nov 09 20:18:00.025133 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 649/1270] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:17:59 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:18:01.036736 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-bf95cd04-3b12-4bc7-9d5e-17162ec50755 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:18:01.037637 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-bf95cd04-3b12-4bc7-9d5e-17162ec50755 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:18:01.043739 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bf95cd04-3b12-4bc7-9d5e-17162ec50755 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:18:01.044183 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bf95cd04-3b12-4bc7-9d5e-17162ec50755 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:18:01.044995 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bf95cd04-3b12-4bc7-9d5e-17162ec50755 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:18:01.045428 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bf95cd04-3b12-4bc7-9d5e-17162ec50755 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:18:01.075585 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-bf95cd04-3b12-4bc7-9d5e-17162ec50755 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043457 Nov 09 20:18:01.076041 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 622/1271] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:18:01 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:18:02.086793 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-6a78180d-80ec-4d5d-bd9c-42baf0ef9a50 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:18:02.087622 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-6a78180d-80ec-4d5d-bd9c-42baf0ef9a50 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:18:02.093819 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6a78180d-80ec-4d5d-bd9c-42baf0ef9a50 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:18:02.094265 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6a78180d-80ec-4d5d-bd9c-42baf0ef9a50 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:18:02.095029 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6a78180d-80ec-4d5d-bd9c-42baf0ef9a50 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:18:02.095544 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6a78180d-80ec-4d5d-bd9c-42baf0ef9a50 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:18:02.124428 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-6a78180d-80ec-4d5d-bd9c-42baf0ef9a50 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040913 Nov 09 20:18:02.124990 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 650/1272] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:18:02 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:18:03.135555 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-75e78a30-fd33-419f-964c-9b87e49b250a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:18:03.136475 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-75e78a30-fd33-419f-964c-9b87e49b250a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:18:03.142850 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-75e78a30-fd33-419f-964c-9b87e49b250a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:18:03.143296 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-75e78a30-fd33-419f-964c-9b87e49b250a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:18:03.144430 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-75e78a30-fd33-419f-964c-9b87e49b250a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:18:03.144711 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-75e78a30-fd33-419f-964c-9b87e49b250a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:18:03.175039 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-75e78a30-fd33-419f-964c-9b87e49b250a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042934 Nov 09 20:18:03.175420 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 623/1273] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:18:03 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:18:04.187858 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-6f5b2175-e2c4-4080-9ea9-e4325721a8a9 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:18:04.188800 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-6f5b2175-e2c4-4080-9ea9-e4325721a8a9 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:18:04.195160 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6f5b2175-e2c4-4080-9ea9-e4325721a8a9 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:18:04.195605 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6f5b2175-e2c4-4080-9ea9-e4325721a8a9 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:18:04.196540 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6f5b2175-e2c4-4080-9ea9-e4325721a8a9 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:18:04.196989 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6f5b2175-e2c4-4080-9ea9-e4325721a8a9 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:18:04.228063 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-6f5b2175-e2c4-4080-9ea9-e4325721a8a9 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046226 Nov 09 20:18:04.228746 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 651/1274] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:18:04 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:18:05.239207 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-fe4b2d66-ec3c-4777-a25c-b42b36581b64 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:18:05.240115 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-fe4b2d66-ec3c-4777-a25c-b42b36581b64 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:18:05.246311 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fe4b2d66-ec3c-4777-a25c-b42b36581b64 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:18:05.246754 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fe4b2d66-ec3c-4777-a25c-b42b36581b64 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:18:05.247528 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fe4b2d66-ec3c-4777-a25c-b42b36581b64 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:18:05.247959 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fe4b2d66-ec3c-4777-a25c-b42b36581b64 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:18:05.276940 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-fe4b2d66-ec3c-4777-a25c-b42b36581b64 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041364 Nov 09 20:18:05.277485 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 624/1275] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:18:05 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:18:06.288682 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-a95ea640-7920-4b3c-b0ad-02d581b70326 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:18:06.289666 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-a95ea640-7920-4b3c-b0ad-02d581b70326 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:18:06.296410 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a95ea640-7920-4b3c-b0ad-02d581b70326 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:18:06.296934 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a95ea640-7920-4b3c-b0ad-02d581b70326 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:18:06.297630 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a95ea640-7920-4b3c-b0ad-02d581b70326 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:18:06.298057 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a95ea640-7920-4b3c-b0ad-02d581b70326 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:18:06.327676 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-a95ea640-7920-4b3c-b0ad-02d581b70326 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042588 Nov 09 20:18:06.328227 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 652/1276] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:18:06 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:18:07.338664 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-757a1150-8d39-4fb4-b404-1449bd4e8144 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:18:07.339614 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-757a1150-8d39-4fb4-b404-1449bd4e8144 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:18:07.345950 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-757a1150-8d39-4fb4-b404-1449bd4e8144 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:18:07.346397 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-757a1150-8d39-4fb4-b404-1449bd4e8144 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:18:07.347225 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-757a1150-8d39-4fb4-b404-1449bd4e8144 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:18:07.347662 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-757a1150-8d39-4fb4-b404-1449bd4e8144 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:18:07.376542 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-757a1150-8d39-4fb4-b404-1449bd4e8144 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041519 Nov 09 20:18:07.377087 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 625/1277] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:18:07 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:18:08.386855 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-34876c53-3688-4969-a422-2b7c6c944ce2 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:18:08.387601 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-34876c53-3688-4969-a422-2b7c6c944ce2 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:18:08.394405 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-34876c53-3688-4969-a422-2b7c6c944ce2 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:18:08.394855 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-34876c53-3688-4969-a422-2b7c6c944ce2 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:18:08.395634 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-34876c53-3688-4969-a422-2b7c6c944ce2 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:18:08.396068 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-34876c53-3688-4969-a422-2b7c6c944ce2 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:18:08.424733 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-34876c53-3688-4969-a422-2b7c6c944ce2 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041625 Nov 09 20:18:08.425320 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 653/1278] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:18:08 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:18:09.435474 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-171ab2d1-b406-4d36-bfca-6be50015e140 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:18:09.436476 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-171ab2d1-b406-4d36-bfca-6be50015e140 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:18:09.442978 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-171ab2d1-b406-4d36-bfca-6be50015e140 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:18:09.443429 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-171ab2d1-b406-4d36-bfca-6be50015e140 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:18:09.444211 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-171ab2d1-b406-4d36-bfca-6be50015e140 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:18:09.444672 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-171ab2d1-b406-4d36-bfca-6be50015e140 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:18:09.473951 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-171ab2d1-b406-4d36-bfca-6be50015e140 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042331 Nov 09 20:18:09.474504 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 626/1279] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:18:09 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:18:10.485280 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-6f7e4b22-545a-461e-bd68-34c259178e41 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:18:10.486191 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-6f7e4b22-545a-461e-bd68-34c259178e41 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:18:10.492338 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6f7e4b22-545a-461e-bd68-34c259178e41 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:18:10.492831 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6f7e4b22-545a-461e-bd68-34c259178e41 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:18:10.493611 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6f7e4b22-545a-461e-bd68-34c259178e41 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:18:10.494046 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6f7e4b22-545a-461e-bd68-34c259178e41 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:18:10.522626 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-6f7e4b22-545a-461e-bd68-34c259178e41 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041272 Nov 09 20:18:10.523175 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 654/1280] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:18:10 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:18:11.534541 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-b10fe6b3-00fb-47fd-9e24-c41767a301e8 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:18:11.535439 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-b10fe6b3-00fb-47fd-9e24-c41767a301e8 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:18:11.541739 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b10fe6b3-00fb-47fd-9e24-c41767a301e8 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:18:11.542179 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b10fe6b3-00fb-47fd-9e24-c41767a301e8 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:18:11.542942 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b10fe6b3-00fb-47fd-9e24-c41767a301e8 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:18:11.543367 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b10fe6b3-00fb-47fd-9e24-c41767a301e8 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:18:11.571953 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-b10fe6b3-00fb-47fd-9e24-c41767a301e8 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041792 Nov 09 20:18:11.572704 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 627/1281] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:18:11 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:18:12.582824 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-27751f80-a72a-461d-a132-4a2ca2c61835 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:18:12.583734 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-27751f80-a72a-461d-a132-4a2ca2c61835 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:18:12.589945 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-27751f80-a72a-461d-a132-4a2ca2c61835 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:18:12.590395 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-27751f80-a72a-461d-a132-4a2ca2c61835 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:18:12.591179 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-27751f80-a72a-461d-a132-4a2ca2c61835 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:18:12.591617 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-27751f80-a72a-461d-a132-4a2ca2c61835 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:18:12.620722 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-27751f80-a72a-461d-a132-4a2ca2c61835 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041510 Nov 09 20:18:12.621276 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 655/1282] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:18:12 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:18:13.631060 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-71142974-a559-4979-9d99-5cf880feda1f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:18:13.631966 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-71142974-a559-4979-9d99-5cf880feda1f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:18:13.638148 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-71142974-a559-4979-9d99-5cf880feda1f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:18:13.638585 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-71142974-a559-4979-9d99-5cf880feda1f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:18:13.639918 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-71142974-a559-4979-9d99-5cf880feda1f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:18:13.640543 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-71142974-a559-4979-9d99-5cf880feda1f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:18:13.668574 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-71142974-a559-4979-9d99-5cf880feda1f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041260 Nov 09 20:18:13.669115 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 628/1283] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:18:13 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:18:14.679580 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-5a0a5d0b-f642-41ca-8a68-5fd3c3348823 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:18:14.680515 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-5a0a5d0b-f642-41ca-8a68-5fd3c3348823 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:18:14.687173 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-5a0a5d0b-f642-41ca-8a68-5fd3c3348823 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:18:14.687621 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-5a0a5d0b-f642-41ca-8a68-5fd3c3348823 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:18:14.688395 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-5a0a5d0b-f642-41ca-8a68-5fd3c3348823 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:18:14.688853 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-5a0a5d0b-f642-41ca-8a68-5fd3c3348823 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:18:14.716897 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-5a0a5d0b-f642-41ca-8a68-5fd3c3348823 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040957 Nov 09 20:18:14.717995 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 656/1284] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:18:14 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:18:15.728656 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-87ffd80d-8898-4cfd-a401-8a246f66e8ac tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:18:15.729562 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-87ffd80d-8898-4cfd-a401-8a246f66e8ac tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:18:15.736466 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-87ffd80d-8898-4cfd-a401-8a246f66e8ac tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:18:15.736918 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-87ffd80d-8898-4cfd-a401-8a246f66e8ac tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:18:15.737684 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-87ffd80d-8898-4cfd-a401-8a246f66e8ac tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:18:15.738119 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-87ffd80d-8898-4cfd-a401-8a246f66e8ac tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:18:15.766432 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-87ffd80d-8898-4cfd-a401-8a246f66e8ac tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041600 Nov 09 20:18:15.766970 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 629/1285] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:18:15 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:18:16.777565 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-10152dc1-035e-4cad-b135-d50e89a7483f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:18:16.778468 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-10152dc1-035e-4cad-b135-d50e89a7483f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:18:16.784997 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-10152dc1-035e-4cad-b135-d50e89a7483f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:18:16.785442 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-10152dc1-035e-4cad-b135-d50e89a7483f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:18:16.786205 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-10152dc1-035e-4cad-b135-d50e89a7483f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:18:16.786631 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-10152dc1-035e-4cad-b135-d50e89a7483f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:18:16.815063 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-10152dc1-035e-4cad-b135-d50e89a7483f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041356 Nov 09 20:18:16.815612 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 657/1286] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:18:16 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:18:17.825561 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-2e32aea8-e495-43ee-b5ad-17802fbf0eac tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:18:17.826463 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-2e32aea8-e495-43ee-b5ad-17802fbf0eac tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:18:17.833190 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2e32aea8-e495-43ee-b5ad-17802fbf0eac tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:18:17.833605 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2e32aea8-e495-43ee-b5ad-17802fbf0eac tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:18:17.834369 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2e32aea8-e495-43ee-b5ad-17802fbf0eac tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:18:17.834799 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2e32aea8-e495-43ee-b5ad-17802fbf0eac tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:18:17.864793 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-2e32aea8-e495-43ee-b5ad-17802fbf0eac tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042820 Nov 09 20:18:17.865366 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 630/1287] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:18:17 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:18:18.876713 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-8cbfa41e-8312-415b-9664-5ddc163aa2ce tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:18:18.877616 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-8cbfa41e-8312-415b-9664-5ddc163aa2ce tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:18:18.883742 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-8cbfa41e-8312-415b-9664-5ddc163aa2ce tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:18:18.884187 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-8cbfa41e-8312-415b-9664-5ddc163aa2ce tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:18:18.884997 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-8cbfa41e-8312-415b-9664-5ddc163aa2ce tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:18:18.885429 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-8cbfa41e-8312-415b-9664-5ddc163aa2ce tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:18:18.912604 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-8cbfa41e-8312-415b-9664-5ddc163aa2ce tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040464 Nov 09 20:18:18.913143 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 658/1288] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:18:18 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:18:19.923019 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-bbc4b090-2f4a-4504-86f2-7ebd48b49902 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:18:19.923909 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-bbc4b090-2f4a-4504-86f2-7ebd48b49902 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:18:19.929981 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bbc4b090-2f4a-4504-86f2-7ebd48b49902 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:18:19.930420 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bbc4b090-2f4a-4504-86f2-7ebd48b49902 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:18:19.931204 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bbc4b090-2f4a-4504-86f2-7ebd48b49902 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:18:19.931628 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bbc4b090-2f4a-4504-86f2-7ebd48b49902 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:18:19.960129 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-bbc4b090-2f4a-4504-86f2-7ebd48b49902 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040976 Nov 09 20:18:19.960704 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 631/1289] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:18:19 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:18:20.971288 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-059d9fbe-ac5d-40e6-b24e-46f644a561b0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:18:20.972230 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-059d9fbe-ac5d-40e6-b24e-46f644a561b0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:18:20.978421 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-059d9fbe-ac5d-40e6-b24e-46f644a561b0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:18:20.978883 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-059d9fbe-ac5d-40e6-b24e-46f644a561b0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:18:20.979625 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-059d9fbe-ac5d-40e6-b24e-46f644a561b0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:18:20.980051 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-059d9fbe-ac5d-40e6-b24e-46f644a561b0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:18:21.008903 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-059d9fbe-ac5d-40e6-b24e-46f644a561b0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041450 Nov 09 20:18:21.009443 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 659/1290] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:18:20 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:18:22.020309 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-3f4ce8a3-a349-4633-9256-c9bd2f6a73bf tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:18:22.021253 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-3f4ce8a3-a349-4633-9256-c9bd2f6a73bf tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:18:22.027374 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3f4ce8a3-a349-4633-9256-c9bd2f6a73bf tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:18:22.027818 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3f4ce8a3-a349-4633-9256-c9bd2f6a73bf tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:18:22.028609 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3f4ce8a3-a349-4633-9256-c9bd2f6a73bf tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:18:22.029046 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3f4ce8a3-a349-4633-9256-c9bd2f6a73bf tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:18:22.057688 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-3f4ce8a3-a349-4633-9256-c9bd2f6a73bf tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041116 Nov 09 20:18:22.058236 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 632/1291] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:18:22 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:18:23.069719 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-0190642e-f10a-498e-9793-bcb97d4f909e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:18:23.070623 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-0190642e-f10a-498e-9793-bcb97d4f909e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:18:23.077643 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-0190642e-f10a-498e-9793-bcb97d4f909e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:18:23.078088 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-0190642e-f10a-498e-9793-bcb97d4f909e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:18:23.078854 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-0190642e-f10a-498e-9793-bcb97d4f909e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:18:23.079282 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-0190642e-f10a-498e-9793-bcb97d4f909e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:18:23.107243 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-0190642e-f10a-498e-9793-bcb97d4f909e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041172 Nov 09 20:18:23.107794 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 660/1292] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:18:23 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:18:24.120689 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-06aa6f53-20d2-4ba0-bfce-eed9570e253a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:18:24.121605 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-06aa6f53-20d2-4ba0-bfce-eed9570e253a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:18:24.127709 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-06aa6f53-20d2-4ba0-bfce-eed9570e253a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:18:24.128159 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-06aa6f53-20d2-4ba0-bfce-eed9570e253a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:18:24.128968 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-06aa6f53-20d2-4ba0-bfce-eed9570e253a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:18:24.129407 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-06aa6f53-20d2-4ba0-bfce-eed9570e253a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:18:24.158493 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-06aa6f53-20d2-4ba0-bfce-eed9570e253a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043405 Nov 09 20:18:24.159042 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 633/1293] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:18:24 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:18:25.169604 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-98c76095-af0c-429a-8d05-b2700330cfe1 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:18:25.171146 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-98c76095-af0c-429a-8d05-b2700330cfe1 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:18:25.177461 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-98c76095-af0c-429a-8d05-b2700330cfe1 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:18:25.177908 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-98c76095-af0c-429a-8d05-b2700330cfe1 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:18:25.178673 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-98c76095-af0c-429a-8d05-b2700330cfe1 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:18:25.179104 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-98c76095-af0c-429a-8d05-b2700330cfe1 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:18:25.207178 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-98c76095-af0c-429a-8d05-b2700330cfe1 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041271 Nov 09 20:18:25.207714 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 661/1294] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:18:25 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:18:26.218896 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-ed2e15cb-fe44-4cc8-9982-3d90837bf31e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:18:26.219816 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-ed2e15cb-fe44-4cc8-9982-3d90837bf31e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:18:26.225554 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ed2e15cb-fe44-4cc8-9982-3d90837bf31e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:18:26.225990 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ed2e15cb-fe44-4cc8-9982-3d90837bf31e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:18:26.226746 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ed2e15cb-fe44-4cc8-9982-3d90837bf31e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:18:26.227169 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ed2e15cb-fe44-4cc8-9982-3d90837bf31e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:18:26.255657 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-ed2e15cb-fe44-4cc8-9982-3d90837bf31e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040902 Nov 09 20:18:26.256202 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 634/1295] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:18:26 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:18:27.267636 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-4d3b46e5-beef-4edc-8a2b-53da37428315 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:18:27.268579 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-4d3b46e5-beef-4edc-8a2b-53da37428315 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:18:27.274728 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-4d3b46e5-beef-4edc-8a2b-53da37428315 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:18:27.275167 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-4d3b46e5-beef-4edc-8a2b-53da37428315 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:18:27.275926 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-4d3b46e5-beef-4edc-8a2b-53da37428315 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:18:27.276352 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-4d3b46e5-beef-4edc-8a2b-53da37428315 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:18:27.304939 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-4d3b46e5-beef-4edc-8a2b-53da37428315 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041835 Nov 09 20:18:27.305491 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 662/1296] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:18:27 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:18:28.317079 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-c3e97c6a-62c3-48d1-b94e-89d674213c7c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:18:28.317985 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-c3e97c6a-62c3-48d1-b94e-89d674213c7c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:18:28.324149 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c3e97c6a-62c3-48d1-b94e-89d674213c7c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:18:28.324628 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c3e97c6a-62c3-48d1-b94e-89d674213c7c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:18:28.325397 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c3e97c6a-62c3-48d1-b94e-89d674213c7c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:18:28.325826 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c3e97c6a-62c3-48d1-b94e-89d674213c7c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:18:28.354463 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-c3e97c6a-62c3-48d1-b94e-89d674213c7c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041483 Nov 09 20:18:28.355001 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 635/1297] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:18:28 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:18:29.365639 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-a1fc595a-2bc6-4bee-b2c9-c778a5dfcf7f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:18:29.366536 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-a1fc595a-2bc6-4bee-b2c9-c778a5dfcf7f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:18:29.372625 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a1fc595a-2bc6-4bee-b2c9-c778a5dfcf7f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:18:29.373067 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a1fc595a-2bc6-4bee-b2c9-c778a5dfcf7f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:18:29.373827 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a1fc595a-2bc6-4bee-b2c9-c778a5dfcf7f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:18:29.374252 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a1fc595a-2bc6-4bee-b2c9-c778a5dfcf7f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:18:29.402515 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-a1fc595a-2bc6-4bee-b2c9-c778a5dfcf7f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040509 Nov 09 20:18:29.403057 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 663/1298] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:18:29 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:18:30.413886 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-b3966066-89f7-4116-9ca7-06170311cd3b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:18:30.414769 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-b3966066-89f7-4116-9ca7-06170311cd3b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:18:30.420992 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b3966066-89f7-4116-9ca7-06170311cd3b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:18:30.421434 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b3966066-89f7-4116-9ca7-06170311cd3b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:18:30.422196 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b3966066-89f7-4116-9ca7-06170311cd3b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:18:30.422622 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b3966066-89f7-4116-9ca7-06170311cd3b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:18:30.451071 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-b3966066-89f7-4116-9ca7-06170311cd3b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041010 Nov 09 20:18:30.451613 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 636/1299] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:18:30 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:18:31.462044 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-e2565012-9882-407c-b873-dc18505f1bcb tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:18:31.462944 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-e2565012-9882-407c-b873-dc18505f1bcb tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:18:31.469714 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e2565012-9882-407c-b873-dc18505f1bcb tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:18:31.470152 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e2565012-9882-407c-b873-dc18505f1bcb tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:18:31.470911 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e2565012-9882-407c-b873-dc18505f1bcb tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:18:31.471336 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e2565012-9882-407c-b873-dc18505f1bcb tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:18:31.499044 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-e2565012-9882-407c-b873-dc18505f1bcb tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040667 Nov 09 20:18:31.499693 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 664/1300] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:18:31 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:18:32.515372 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-e894c517-c22b-4b34-aba5-76bf96e99ae6 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:18:32.516290 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-e894c517-c22b-4b34-aba5-76bf96e99ae6 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:18:32.522515 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e894c517-c22b-4b34-aba5-76bf96e99ae6 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:18:32.522964 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e894c517-c22b-4b34-aba5-76bf96e99ae6 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:18:32.523741 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e894c517-c22b-4b34-aba5-76bf96e99ae6 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:18:32.524185 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e894c517-c22b-4b34-aba5-76bf96e99ae6 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:18:32.552906 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-e894c517-c22b-4b34-aba5-76bf96e99ae6 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041336 Nov 09 20:18:32.553461 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 637/1301] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:18:32 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:18:33.564630 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-7712812f-8246-4107-8dcd-3c6f3f4bc890 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:18:33.565526 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-7712812f-8246-4107-8dcd-3c6f3f4bc890 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:18:33.571902 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-7712812f-8246-4107-8dcd-3c6f3f4bc890 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:18:33.572348 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-7712812f-8246-4107-8dcd-3c6f3f4bc890 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:18:33.573195 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-7712812f-8246-4107-8dcd-3c6f3f4bc890 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:18:33.573653 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-7712812f-8246-4107-8dcd-3c6f3f4bc890 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:18:33.603222 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-7712812f-8246-4107-8dcd-3c6f3f4bc890 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042769 Nov 09 20:18:33.603711 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 665/1302] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:18:33 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:18:34.615396 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-74ab4f52-82d2-4b9c-8226-899dab08d142 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:18:34.616330 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-74ab4f52-82d2-4b9c-8226-899dab08d142 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:18:34.622471 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-74ab4f52-82d2-4b9c-8226-899dab08d142 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:18:34.622915 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-74ab4f52-82d2-4b9c-8226-899dab08d142 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:18:34.623676 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-74ab4f52-82d2-4b9c-8226-899dab08d142 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:18:34.624109 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-74ab4f52-82d2-4b9c-8226-899dab08d142 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:18:34.653520 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-74ab4f52-82d2-4b9c-8226-899dab08d142 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041818 Nov 09 20:18:34.654008 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 638/1303] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:18:34 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:18:35.665739 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-6ed3023f-d65c-4686-8525-aed86c528168 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:18:35.666645 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-6ed3023f-d65c-4686-8525-aed86c528168 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:18:35.673655 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6ed3023f-d65c-4686-8525-aed86c528168 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:18:35.674107 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6ed3023f-d65c-4686-8525-aed86c528168 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:18:35.674909 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6ed3023f-d65c-4686-8525-aed86c528168 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:18:35.675351 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6ed3023f-d65c-4686-8525-aed86c528168 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:18:35.703401 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-6ed3023f-d65c-4686-8525-aed86c528168 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041267 Nov 09 20:18:35.703973 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 666/1304] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:18:35 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:18:36.714671 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-8ef99ab3-39d5-4b6a-a24f-8fa5805280e5 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:18:36.715575 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-8ef99ab3-39d5-4b6a-a24f-8fa5805280e5 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:18:36.722926 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8ef99ab3-39d5-4b6a-a24f-8fa5805280e5 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:18:36.723367 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8ef99ab3-39d5-4b6a-a24f-8fa5805280e5 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:18:36.724130 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8ef99ab3-39d5-4b6a-a24f-8fa5805280e5 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:18:36.724602 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8ef99ab3-39d5-4b6a-a24f-8fa5805280e5 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:18:36.754728 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-8ef99ab3-39d5-4b6a-a24f-8fa5805280e5 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043723 Nov 09 20:18:36.755200 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 639/1305] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:18:36 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:18:37.765253 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-df8983a0-6e75-4a34-962e-0a2308650b46 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:18:37.766738 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-df8983a0-6e75-4a34-962e-0a2308650b46 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:18:37.772920 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-df8983a0-6e75-4a34-962e-0a2308650b46 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:18:37.773387 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-df8983a0-6e75-4a34-962e-0a2308650b46 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:18:37.774137 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-df8983a0-6e75-4a34-962e-0a2308650b46 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:18:37.774569 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-df8983a0-6e75-4a34-962e-0a2308650b46 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:18:37.802719 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-df8983a0-6e75-4a34-962e-0a2308650b46 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041160 Nov 09 20:18:37.803195 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 667/1306] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:18:37 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:18:38.813559 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-53ebbd17-9736-4f64-8265-2f898af97ba1 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:18:38.814456 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-53ebbd17-9736-4f64-8265-2f898af97ba1 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:18:38.820617 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-53ebbd17-9736-4f64-8265-2f898af97ba1 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:18:38.821054 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-53ebbd17-9736-4f64-8265-2f898af97ba1 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:18:38.821811 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-53ebbd17-9736-4f64-8265-2f898af97ba1 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:18:38.822235 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-53ebbd17-9736-4f64-8265-2f898af97ba1 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:18:38.850254 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-53ebbd17-9736-4f64-8265-2f898af97ba1 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040467 Nov 09 20:18:38.850793 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 640/1307] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:18:38 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:18:39.861936 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-7cdb9862-a70e-4969-b228-bd69110f2b69 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:18:39.862829 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-7cdb9862-a70e-4969-b228-bd69110f2b69 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:18:39.868954 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-7cdb9862-a70e-4969-b228-bd69110f2b69 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:18:39.869397 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-7cdb9862-a70e-4969-b228-bd69110f2b69 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:18:39.870156 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-7cdb9862-a70e-4969-b228-bd69110f2b69 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:18:39.870582 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-7cdb9862-a70e-4969-b228-bd69110f2b69 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:18:39.898880 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-7cdb9862-a70e-4969-b228-bd69110f2b69 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041544 Nov 09 20:18:39.899427 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 668/1308] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:18:39 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:18:40.910576 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-b0c508da-39b9-4641-bb5f-718e5ccc1f0b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:18:40.911527 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-b0c508da-39b9-4641-bb5f-718e5ccc1f0b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:18:40.917632 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b0c508da-39b9-4641-bb5f-718e5ccc1f0b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:18:40.918069 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b0c508da-39b9-4641-bb5f-718e5ccc1f0b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:18:40.918824 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b0c508da-39b9-4641-bb5f-718e5ccc1f0b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:18:40.919247 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b0c508da-39b9-4641-bb5f-718e5ccc1f0b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:18:40.947431 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-b0c508da-39b9-4641-bb5f-718e5ccc1f0b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041054 Nov 09 20:18:40.947968 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 641/1309] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:18:40 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:18:41.960927 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-1a4e1844-8d95-41ac-9d5b-7ca94e519845 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:18:41.961763 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-1a4e1844-8d95-41ac-9d5b-7ca94e519845 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:18:41.967895 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-1a4e1844-8d95-41ac-9d5b-7ca94e519845 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:18:41.968336 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-1a4e1844-8d95-41ac-9d5b-7ca94e519845 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:18:41.969121 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-1a4e1844-8d95-41ac-9d5b-7ca94e519845 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:18:41.970206 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-1a4e1844-8d95-41ac-9d5b-7ca94e519845 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:18:41.998329 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-1a4e1844-8d95-41ac-9d5b-7ca94e519845 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041208 Nov 09 20:18:41.998882 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 669/1310] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:18:41 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:18:43.009139 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-028469e8-8ccb-40f0-847e-12d58ea9d2a2 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:18:43.010077 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-028469e8-8ccb-40f0-847e-12d58ea9d2a2 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:18:43.016242 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-028469e8-8ccb-40f0-847e-12d58ea9d2a2 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:18:43.016863 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-028469e8-8ccb-40f0-847e-12d58ea9d2a2 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:18:43.017628 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-028469e8-8ccb-40f0-847e-12d58ea9d2a2 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:18:43.018060 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-028469e8-8ccb-40f0-847e-12d58ea9d2a2 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:18:43.046436 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-028469e8-8ccb-40f0-847e-12d58ea9d2a2 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040976 Nov 09 20:18:43.046975 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 642/1311] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:18:43 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:18:44.058379 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-6238b1ad-5fae-4493-9ea8-e45a607e7f35 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:18:44.059289 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-6238b1ad-5fae-4493-9ea8-e45a607e7f35 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:18:44.065985 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6238b1ad-5fae-4493-9ea8-e45a607e7f35 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:18:44.066434 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6238b1ad-5fae-4493-9ea8-e45a607e7f35 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:18:44.067217 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6238b1ad-5fae-4493-9ea8-e45a607e7f35 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:18:44.067654 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6238b1ad-5fae-4493-9ea8-e45a607e7f35 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:18:44.096508 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-6238b1ad-5fae-4493-9ea8-e45a607e7f35 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041816 Nov 09 20:18:44.097055 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 670/1312] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:18:44 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 20:18:45.106981 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-a1b73b4f-fa75-4a22-bd5d-3e1c9643337b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:18:45.107877 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-a1b73b4f-fa75-4a22-bd5d-3e1c9643337b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:18:45.114752 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a1b73b4f-fa75-4a22-bd5d-3e1c9643337b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:18:45.115194 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a1b73b4f-fa75-4a22-bd5d-3e1c9643337b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:18:45.115964 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a1b73b4f-fa75-4a22-bd5d-3e1c9643337b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:18:45.116389 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a1b73b4f-fa75-4a22-bd5d-3e1c9643337b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:18:45.144890 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-a1b73b4f-fa75-4a22-bd5d-3e1c9643337b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041581 Nov 09 20:18:45.145435 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 643/1313] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:18:45 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:18:46.156529 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-4103b404-9f46-4306-bd04-e96c491dbf9d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:18:46.157726 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-4103b404-9f46-4306-bd04-e96c491dbf9d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:18:46.163625 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-4103b404-9f46-4306-bd04-e96c491dbf9d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:18:46.164070 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-4103b404-9f46-4306-bd04-e96c491dbf9d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:18:46.164868 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-4103b404-9f46-4306-bd04-e96c491dbf9d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:18:46.165303 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-4103b404-9f46-4306-bd04-e96c491dbf9d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:18:46.194451 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-4103b404-9f46-4306-bd04-e96c491dbf9d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042042 Nov 09 20:18:46.194996 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 671/1314] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:18:46 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:18:47.205774 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-d07c0c07-3785-4b90-9e6b-0fcf94b775d1 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:18:47.206679 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-d07c0c07-3785-4b90-9e6b-0fcf94b775d1 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:18:47.212956 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d07c0c07-3785-4b90-9e6b-0fcf94b775d1 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:18:47.213405 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d07c0c07-3785-4b90-9e6b-0fcf94b775d1 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:18:47.214176 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d07c0c07-3785-4b90-9e6b-0fcf94b775d1 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:18:47.214610 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d07c0c07-3785-4b90-9e6b-0fcf94b775d1 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:18:47.244005 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-d07c0c07-3785-4b90-9e6b-0fcf94b775d1 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042067 Nov 09 20:18:47.244577 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 644/1315] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:18:47 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:18:48.255936 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-7fdbb0ce-d746-4755-8853-d720eb8195dd tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:18:48.256883 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-7fdbb0ce-d746-4755-8853-d720eb8195dd tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:18:48.263063 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-7fdbb0ce-d746-4755-8853-d720eb8195dd tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:18:48.263513 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-7fdbb0ce-d746-4755-8853-d720eb8195dd tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:18:48.264314 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-7fdbb0ce-d746-4755-8853-d720eb8195dd tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:18:48.264770 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-7fdbb0ce-d746-4755-8853-d720eb8195dd tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:18:48.293068 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-7fdbb0ce-d746-4755-8853-d720eb8195dd tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040918 Nov 09 20:18:48.293650 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 672/1316] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:18:48 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:18:49.305203 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-54eec87a-baea-4e99-b145-9e922fcbbcee tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:18:49.306113 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-54eec87a-baea-4e99-b145-9e922fcbbcee tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:18:49.312284 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-54eec87a-baea-4e99-b145-9e922fcbbcee tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:18:49.312764 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-54eec87a-baea-4e99-b145-9e922fcbbcee tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:18:49.313568 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-54eec87a-baea-4e99-b145-9e922fcbbcee tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:18:49.313995 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-54eec87a-baea-4e99-b145-9e922fcbbcee tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:18:49.341964 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-54eec87a-baea-4e99-b145-9e922fcbbcee tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040649 Nov 09 20:18:49.342507 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 645/1317] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:18:49 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:18:50.353958 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-3b1f2c11-462a-4d9d-a194-8c77db6bed6e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:18:50.354886 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-3b1f2c11-462a-4d9d-a194-8c77db6bed6e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:18:50.362275 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-3b1f2c11-462a-4d9d-a194-8c77db6bed6e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:18:50.362743 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-3b1f2c11-462a-4d9d-a194-8c77db6bed6e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:18:50.363614 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-3b1f2c11-462a-4d9d-a194-8c77db6bed6e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:18:50.364043 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-3b1f2c11-462a-4d9d-a194-8c77db6bed6e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:18:50.393114 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-3b1f2c11-462a-4d9d-a194-8c77db6bed6e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042799 Nov 09 20:18:50.393663 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 673/1318] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:18:50 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:18:51.404309 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-c0ae71cd-3040-4d40-8604-6377c66818be tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:18:51.405234 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-c0ae71cd-3040-4d40-8604-6377c66818be tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:18:51.412085 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c0ae71cd-3040-4d40-8604-6377c66818be tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:18:51.412630 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c0ae71cd-3040-4d40-8604-6377c66818be tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:18:51.413404 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c0ae71cd-3040-4d40-8604-6377c66818be tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:18:51.413826 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c0ae71cd-3040-4d40-8604-6377c66818be tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:18:51.443397 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-c0ae71cd-3040-4d40-8604-6377c66818be tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042670 Nov 09 20:18:51.443863 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 646/1319] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:18:51 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:18:52.453954 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-c8bd1683-d6ce-4957-936c-d5ea84f49fe5 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:18:52.455313 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-c8bd1683-d6ce-4957-936c-d5ea84f49fe5 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:18:52.461546 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c8bd1683-d6ce-4957-936c-d5ea84f49fe5 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:18:52.461991 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c8bd1683-d6ce-4957-936c-d5ea84f49fe5 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:18:52.462760 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c8bd1683-d6ce-4957-936c-d5ea84f49fe5 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:18:52.463187 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c8bd1683-d6ce-4957-936c-d5ea84f49fe5 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:18:52.492493 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-c8bd1683-d6ce-4957-936c-d5ea84f49fe5 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042337 Nov 09 20:18:52.493036 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 674/1320] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:18:52 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:18:53.504318 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-2176dd8a-5cdf-41b8-8a27-9a1ba38a8a0d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:18:53.505247 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-2176dd8a-5cdf-41b8-8a27-9a1ba38a8a0d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:18:53.511395 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2176dd8a-5cdf-41b8-8a27-9a1ba38a8a0d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:18:53.511840 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2176dd8a-5cdf-41b8-8a27-9a1ba38a8a0d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:18:53.512630 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2176dd8a-5cdf-41b8-8a27-9a1ba38a8a0d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:18:53.513061 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2176dd8a-5cdf-41b8-8a27-9a1ba38a8a0d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:18:53.542196 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-2176dd8a-5cdf-41b8-8a27-9a1ba38a8a0d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042295 Nov 09 20:18:53.542753 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 647/1321] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:18:53 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:18:54.553663 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-2b4ed313-0318-4e54-9101-41d0c2a7fadb tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:18:54.554490 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-2b4ed313-0318-4e54-9101-41d0c2a7fadb tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:18:54.560673 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-2b4ed313-0318-4e54-9101-41d0c2a7fadb tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:18:54.561261 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-2b4ed313-0318-4e54-9101-41d0c2a7fadb tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:18:54.562035 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-2b4ed313-0318-4e54-9101-41d0c2a7fadb tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:18:54.562466 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-2b4ed313-0318-4e54-9101-41d0c2a7fadb tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:18:54.591024 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-2b4ed313-0318-4e54-9101-41d0c2a7fadb tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041217 Nov 09 20:18:54.591575 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 675/1322] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:18:54 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:18:55.602229 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-b8776484-9bba-4e99-8262-58393a41fd3b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:18:55.603125 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-b8776484-9bba-4e99-8262-58393a41fd3b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:18:55.609240 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b8776484-9bba-4e99-8262-58393a41fd3b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:18:55.609937 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b8776484-9bba-4e99-8262-58393a41fd3b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:18:55.610921 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b8776484-9bba-4e99-8262-58393a41fd3b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:18:55.611364 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b8776484-9bba-4e99-8262-58393a41fd3b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:18:55.638643 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-b8776484-9bba-4e99-8262-58393a41fd3b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040155 Nov 09 20:18:55.639180 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 648/1323] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:18:55 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:18:56.650540 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-c4056529-878f-43b3-9e86-85d082f35e1d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:18:56.651451 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-c4056529-878f-43b3-9e86-85d082f35e1d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:18:56.658464 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c4056529-878f-43b3-9e86-85d082f35e1d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:18:56.658902 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c4056529-878f-43b3-9e86-85d082f35e1d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:18:56.659659 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c4056529-878f-43b3-9e86-85d082f35e1d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:18:56.660082 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c4056529-878f-43b3-9e86-85d082f35e1d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:18:56.688637 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-c4056529-878f-43b3-9e86-85d082f35e1d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041842 Nov 09 20:18:56.689177 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 676/1324] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:18:56 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:18:57.699942 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-e5d6cf8f-e096-4da4-95a9-401d1eca144f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:18:57.700888 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-e5d6cf8f-e096-4da4-95a9-401d1eca144f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:18:57.706861 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e5d6cf8f-e096-4da4-95a9-401d1eca144f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:18:57.707300 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e5d6cf8f-e096-4da4-95a9-401d1eca144f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:18:57.708054 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e5d6cf8f-e096-4da4-95a9-401d1eca144f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:18:57.708509 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e5d6cf8f-e096-4da4-95a9-401d1eca144f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:18:57.737222 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-e5d6cf8f-e096-4da4-95a9-401d1eca144f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041114 Nov 09 20:18:57.737761 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 649/1325] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:18:57 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:18:58.747710 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-7cbe081a-a099-44de-90fd-987cd99508d2 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:18:58.748654 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-7cbe081a-a099-44de-90fd-987cd99508d2 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:18:58.755319 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-7cbe081a-a099-44de-90fd-987cd99508d2 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:18:58.755772 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-7cbe081a-a099-44de-90fd-987cd99508d2 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:18:58.756612 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-7cbe081a-a099-44de-90fd-987cd99508d2 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:18:58.757050 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-7cbe081a-a099-44de-90fd-987cd99508d2 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:18:58.785716 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-7cbe081a-a099-44de-90fd-987cd99508d2 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041740 Nov 09 20:18:58.786267 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 677/1326] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:18:58 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:18:59.797044 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-43b1dff6-3399-45ec-a732-e69b74e72e0b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:18:59.798547 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-43b1dff6-3399-45ec-a732-e69b74e72e0b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:18:59.805074 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-43b1dff6-3399-45ec-a732-e69b74e72e0b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:18:59.805519 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-43b1dff6-3399-45ec-a732-e69b74e72e0b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:18:59.806289 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-43b1dff6-3399-45ec-a732-e69b74e72e0b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:18:59.806718 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-43b1dff6-3399-45ec-a732-e69b74e72e0b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:18:59.839635 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-43b1dff6-3399-45ec-a732-e69b74e72e0b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046418 Nov 09 20:18:59.840193 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 650/1327] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:18:59 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:19:00.851320 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-b8aec5a8-a17e-4427-b39b-bb6c810b758e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:19:00.852229 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-b8aec5a8-a17e-4427-b39b-bb6c810b758e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:19:00.858583 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b8aec5a8-a17e-4427-b39b-bb6c810b758e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:19:00.859035 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b8aec5a8-a17e-4427-b39b-bb6c810b758e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:19:00.860091 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b8aec5a8-a17e-4427-b39b-bb6c810b758e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:19:00.861083 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b8aec5a8-a17e-4427-b39b-bb6c810b758e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:19:00.889531 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-b8aec5a8-a17e-4427-b39b-bb6c810b758e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041972 Nov 09 20:19:00.890083 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 678/1328] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:19:00 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:19:01.900710 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-b0cd8994-444c-43b1-b68c-59dbc0c712fd tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:19:01.901618 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-b0cd8994-444c-43b1-b68c-59dbc0c712fd tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:19:01.907832 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b0cd8994-444c-43b1-b68c-59dbc0c712fd tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:19:01.908280 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b0cd8994-444c-43b1-b68c-59dbc0c712fd tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:19:01.909099 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b0cd8994-444c-43b1-b68c-59dbc0c712fd tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:19:01.909539 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b0cd8994-444c-43b1-b68c-59dbc0c712fd tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:19:01.937323 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-b0cd8994-444c-43b1-b68c-59dbc0c712fd tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040367 Nov 09 20:19:01.937873 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 651/1329] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:19:01 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:19:02.949183 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-aebb4902-5e75-4f28-b82f-b1c24fcf3b93 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:19:02.950005 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-aebb4902-5e75-4f28-b82f-b1c24fcf3b93 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:19:02.956699 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-aebb4902-5e75-4f28-b82f-b1c24fcf3b93 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:19:02.957148 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-aebb4902-5e75-4f28-b82f-b1c24fcf3b93 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:19:02.957920 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-aebb4902-5e75-4f28-b82f-b1c24fcf3b93 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:19:02.958353 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-aebb4902-5e75-4f28-b82f-b1c24fcf3b93 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:19:02.986672 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-aebb4902-5e75-4f28-b82f-b1c24fcf3b93 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041264 Nov 09 20:19:02.987209 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 679/1330] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:19:02 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:19:03.997828 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-57751a3b-001b-492b-86e7-5de328c61ce6 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:19:03.998711 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-57751a3b-001b-492b-86e7-5de328c61ce6 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:19:04.005519 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-57751a3b-001b-492b-86e7-5de328c61ce6 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:19:04.005957 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-57751a3b-001b-492b-86e7-5de328c61ce6 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:19:04.006714 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-57751a3b-001b-492b-86e7-5de328c61ce6 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:19:04.007138 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-57751a3b-001b-492b-86e7-5de328c61ce6 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:19:04.035329 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-57751a3b-001b-492b-86e7-5de328c61ce6 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041261 Nov 09 20:19:04.035912 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 652/1331] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:19:03 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:19:05.045915 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-a8c64f6b-b307-4070-8dc0-68c2d6fbd049 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:19:05.046824 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-a8c64f6b-b307-4070-8dc0-68c2d6fbd049 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:19:05.053913 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a8c64f6b-b307-4070-8dc0-68c2d6fbd049 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:19:05.054360 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a8c64f6b-b307-4070-8dc0-68c2d6fbd049 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:19:05.055125 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a8c64f6b-b307-4070-8dc0-68c2d6fbd049 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:19:05.055554 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a8c64f6b-b307-4070-8dc0-68c2d6fbd049 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:19:05.083857 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-a8c64f6b-b307-4070-8dc0-68c2d6fbd049 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041780 Nov 09 20:19:05.084394 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 680/1332] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:19:05 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:19:06.095022 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-613dea7b-6eeb-40a4-ae0b-2069865ec5f7 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:19:06.095935 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-613dea7b-6eeb-40a4-ae0b-2069865ec5f7 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:19:06.102179 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-613dea7b-6eeb-40a4-ae0b-2069865ec5f7 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:19:06.102630 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-613dea7b-6eeb-40a4-ae0b-2069865ec5f7 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:19:06.103397 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-613dea7b-6eeb-40a4-ae0b-2069865ec5f7 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:19:06.103827 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-613dea7b-6eeb-40a4-ae0b-2069865ec5f7 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:19:06.131950 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-613dea7b-6eeb-40a4-ae0b-2069865ec5f7 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040702 Nov 09 20:19:06.132512 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 653/1333] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:19:06 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:19:07.143506 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-dba5e1af-5214-452d-85e4-210cc97f0c00 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:19:07.144457 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-dba5e1af-5214-452d-85e4-210cc97f0c00 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:19:07.150625 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-dba5e1af-5214-452d-85e4-210cc97f0c00 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:19:07.151065 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-dba5e1af-5214-452d-85e4-210cc97f0c00 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:19:07.151830 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-dba5e1af-5214-452d-85e4-210cc97f0c00 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:19:07.152291 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-dba5e1af-5214-452d-85e4-210cc97f0c00 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:19:07.182339 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-dba5e1af-5214-452d-85e4-210cc97f0c00 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042748 Nov 09 20:19:07.182890 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 681/1334] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:19:07 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:19:08.193881 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-70228f7a-e8be-4e2e-8055-66ced8a9701e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:19:08.194726 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-70228f7a-e8be-4e2e-8055-66ced8a9701e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:19:08.200859 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-70228f7a-e8be-4e2e-8055-66ced8a9701e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:19:08.201300 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-70228f7a-e8be-4e2e-8055-66ced8a9701e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:19:08.202053 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-70228f7a-e8be-4e2e-8055-66ced8a9701e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:19:08.202476 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-70228f7a-e8be-4e2e-8055-66ced8a9701e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:19:08.230686 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-70228f7a-e8be-4e2e-8055-66ced8a9701e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040925 Nov 09 20:19:08.231225 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 654/1335] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:19:08 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:19:09.242490 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-043baf69-fef2-4255-8041-92dc122129cc tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:19:09.243341 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-043baf69-fef2-4255-8041-92dc122129cc tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:19:09.249524 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-043baf69-fef2-4255-8041-92dc122129cc tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:19:09.249970 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-043baf69-fef2-4255-8041-92dc122129cc tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:19:09.250733 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-043baf69-fef2-4255-8041-92dc122129cc tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:19:09.251455 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-043baf69-fef2-4255-8041-92dc122129cc tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:19:09.279919 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-043baf69-fef2-4255-8041-92dc122129cc tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041198 Nov 09 20:19:09.280490 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 682/1336] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:19:09 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:19:10.291815 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-b7d21025-4277-4b14-8655-113e91a63c0d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:19:10.292797 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-b7d21025-4277-4b14-8655-113e91a63c0d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:19:10.298961 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b7d21025-4277-4b14-8655-113e91a63c0d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:19:10.299402 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b7d21025-4277-4b14-8655-113e91a63c0d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:19:10.300157 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b7d21025-4277-4b14-8655-113e91a63c0d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:19:10.300618 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b7d21025-4277-4b14-8655-113e91a63c0d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:19:10.328191 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-b7d21025-4277-4b14-8655-113e91a63c0d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040170 Nov 09 20:19:10.328759 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 655/1337] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:19:10 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:19:11.340439 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-198be70a-70a1-4751-97c8-fd7b1b9437f0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:19:11.341279 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-198be70a-70a1-4751-97c8-fd7b1b9437f0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:19:11.347708 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-198be70a-70a1-4751-97c8-fd7b1b9437f0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:19:11.348157 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-198be70a-70a1-4751-97c8-fd7b1b9437f0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:19:11.348966 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-198be70a-70a1-4751-97c8-fd7b1b9437f0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:19:11.349406 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-198be70a-70a1-4751-97c8-fd7b1b9437f0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:19:11.378915 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-198be70a-70a1-4751-97c8-fd7b1b9437f0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042371 Nov 09 20:19:11.379470 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 683/1338] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:19:11 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:19:12.390375 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-016518b8-295d-4dc9-b6dd-9ee9dc5fa1e5 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:19:12.391245 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-016518b8-295d-4dc9-b6dd-9ee9dc5fa1e5 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:19:12.397962 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-016518b8-295d-4dc9-b6dd-9ee9dc5fa1e5 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:19:12.398406 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-016518b8-295d-4dc9-b6dd-9ee9dc5fa1e5 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:19:12.399172 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-016518b8-295d-4dc9-b6dd-9ee9dc5fa1e5 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:19:12.399605 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-016518b8-295d-4dc9-b6dd-9ee9dc5fa1e5 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:19:12.427515 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-016518b8-295d-4dc9-b6dd-9ee9dc5fa1e5 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040928 Nov 09 20:19:12.428063 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 656/1339] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:19:12 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:19:13.438593 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-80b0d6c3-2c7c-4a9c-b781-7cf2d0cb957f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:19:13.439541 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-80b0d6c3-2c7c-4a9c-b781-7cf2d0cb957f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:19:13.445671 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-80b0d6c3-2c7c-4a9c-b781-7cf2d0cb957f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:19:13.446112 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-80b0d6c3-2c7c-4a9c-b781-7cf2d0cb957f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:19:13.446868 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-80b0d6c3-2c7c-4a9c-b781-7cf2d0cb957f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:19:13.447294 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-80b0d6c3-2c7c-4a9c-b781-7cf2d0cb957f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:19:13.476344 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-80b0d6c3-2c7c-4a9c-b781-7cf2d0cb957f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041468 Nov 09 20:19:13.477128 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 684/1340] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:19:13 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:19:14.487892 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-26bb4d83-4ea4-4d64-857c-85762378d2c7 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:19:14.488739 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-26bb4d83-4ea4-4d64-857c-85762378d2c7 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:19:14.495280 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-26bb4d83-4ea4-4d64-857c-85762378d2c7 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:19:14.495727 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-26bb4d83-4ea4-4d64-857c-85762378d2c7 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:19:14.496525 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-26bb4d83-4ea4-4d64-857c-85762378d2c7 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:19:14.496955 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-26bb4d83-4ea4-4d64-857c-85762378d2c7 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:19:14.527421 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-26bb4d83-4ea4-4d64-857c-85762378d2c7 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043988 Nov 09 20:19:14.528264 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 657/1341] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:19:14 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:19:15.538876 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-5e07cccd-6bb3-4e5e-84db-7d4d7c878e8c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:19:15.539696 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-5e07cccd-6bb3-4e5e-84db-7d4d7c878e8c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:19:15.545677 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-5e07cccd-6bb3-4e5e-84db-7d4d7c878e8c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:19:15.546124 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-5e07cccd-6bb3-4e5e-84db-7d4d7c878e8c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:19:15.546891 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-5e07cccd-6bb3-4e5e-84db-7d4d7c878e8c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:19:15.547321 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-5e07cccd-6bb3-4e5e-84db-7d4d7c878e8c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:19:15.575917 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-5e07cccd-6bb3-4e5e-84db-7d4d7c878e8c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040896 Nov 09 20:19:15.576485 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 685/1342] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:19:15 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:19:16.587681 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-d17c9aa4-3ae7-49cd-9f4e-e759f5bfb9f7 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:19:16.588581 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-d17c9aa4-3ae7-49cd-9f4e-e759f5bfb9f7 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:19:16.594867 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d17c9aa4-3ae7-49cd-9f4e-e759f5bfb9f7 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:19:16.595318 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d17c9aa4-3ae7-49cd-9f4e-e759f5bfb9f7 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:19:16.596094 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d17c9aa4-3ae7-49cd-9f4e-e759f5bfb9f7 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:19:16.597258 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d17c9aa4-3ae7-49cd-9f4e-e759f5bfb9f7 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:19:16.625076 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-d17c9aa4-3ae7-49cd-9f4e-e759f5bfb9f7 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041268 Nov 09 20:19:16.625627 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 658/1343] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:19:16 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:19:17.635600 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-5934a1e8-ef06-46d9-ab6f-d5b8101327eb tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:19:17.636535 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-5934a1e8-ef06-46d9-ab6f-d5b8101327eb tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:19:17.642666 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-5934a1e8-ef06-46d9-ab6f-d5b8101327eb tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:19:17.643110 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-5934a1e8-ef06-46d9-ab6f-d5b8101327eb tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:19:17.645022 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-5934a1e8-ef06-46d9-ab6f-d5b8101327eb tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:19:17.645458 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-5934a1e8-ef06-46d9-ab6f-d5b8101327eb tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:19:17.672989 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-5934a1e8-ef06-46d9-ab6f-d5b8101327eb tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041137 Nov 09 20:19:17.673536 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 686/1344] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:19:17 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:19:18.684909 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-af61dad0-9b60-4126-ad6c-bdfeafc70e02 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:19:18.685846 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-af61dad0-9b60-4126-ad6c-bdfeafc70e02 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:19:18.692133 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-af61dad0-9b60-4126-ad6c-bdfeafc70e02 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:19:18.692607 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-af61dad0-9b60-4126-ad6c-bdfeafc70e02 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:19:18.693369 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-af61dad0-9b60-4126-ad6c-bdfeafc70e02 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:19:18.693793 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-af61dad0-9b60-4126-ad6c-bdfeafc70e02 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:19:18.723075 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-af61dad0-9b60-4126-ad6c-bdfeafc70e02 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041790 Nov 09 20:19:18.723609 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 659/1345] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:19:18 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:19:19.056858 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 09 20:19:19.057407 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: Tue Nov 9 20:19:19 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 09 20:19:19.734106 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-11306818-6487-4419-b049-1e87d460a52a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:19:19.735197 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-11306818-6487-4419-b049-1e87d460a52a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:19:19.741897 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-11306818-6487-4419-b049-1e87d460a52a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:19:19.742335 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-11306818-6487-4419-b049-1e87d460a52a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:19:19.743090 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-11306818-6487-4419-b049-1e87d460a52a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:19:19.743512 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-11306818-6487-4419-b049-1e87d460a52a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:19:19.771633 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-11306818-6487-4419-b049-1e87d460a52a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041329 Nov 09 20:19:19.772166 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 687/1346] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:19:19 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:19:20.782698 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-b9a5d22b-4181-4752-ba67-1135bdd2674b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:19:20.783627 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-b9a5d22b-4181-4752-ba67-1135bdd2674b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:19:20.789825 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b9a5d22b-4181-4752-ba67-1135bdd2674b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:19:20.790268 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b9a5d22b-4181-4752-ba67-1135bdd2674b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:19:20.791031 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b9a5d22b-4181-4752-ba67-1135bdd2674b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:19:20.791458 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b9a5d22b-4181-4752-ba67-1135bdd2674b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:19:20.820457 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-b9a5d22b-4181-4752-ba67-1135bdd2674b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041397 Nov 09 20:19:20.821135 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 660/1347] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:19:20 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:19:21.831041 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-ceb48433-3fb1-4d6d-bda4-787c1e128dd7 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:19:21.831903 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-ceb48433-3fb1-4d6d-bda4-787c1e128dd7 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:19:21.838137 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ceb48433-3fb1-4d6d-bda4-787c1e128dd7 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:19:21.838585 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ceb48433-3fb1-4d6d-bda4-787c1e128dd7 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:19:21.839358 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ceb48433-3fb1-4d6d-bda4-787c1e128dd7 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:19:21.839789 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ceb48433-3fb1-4d6d-bda4-787c1e128dd7 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:19:21.869518 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-ceb48433-3fb1-4d6d-bda4-787c1e128dd7 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042371 Nov 09 20:19:21.870066 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 688/1348] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:19:21 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:19:22.881405 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-ff404faf-f58d-447e-9100-5ed5fe9ca724 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:19:22.882284 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-ff404faf-f58d-447e-9100-5ed5fe9ca724 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:19:22.888342 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ff404faf-f58d-447e-9100-5ed5fe9ca724 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:19:22.888814 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ff404faf-f58d-447e-9100-5ed5fe9ca724 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:19:22.889572 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ff404faf-f58d-447e-9100-5ed5fe9ca724 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:19:22.889996 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ff404faf-f58d-447e-9100-5ed5fe9ca724 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:19:22.918399 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-ff404faf-f58d-447e-9100-5ed5fe9ca724 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041471 Nov 09 20:19:22.918936 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 661/1349] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:19:22 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:19:23.929669 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-3e6c3973-f988-48b5-ae55-a8f92905eae4 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:19:23.930506 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-3e6c3973-f988-48b5-ae55-a8f92905eae4 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:19:23.936704 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-3e6c3973-f988-48b5-ae55-a8f92905eae4 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:19:23.937154 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-3e6c3973-f988-48b5-ae55-a8f92905eae4 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:19:23.937920 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-3e6c3973-f988-48b5-ae55-a8f92905eae4 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:19:23.938350 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-3e6c3973-f988-48b5-ae55-a8f92905eae4 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:19:23.966369 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-3e6c3973-f988-48b5-ae55-a8f92905eae4 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040461 Nov 09 20:19:23.966906 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 689/1350] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:19:23 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:19:24.977752 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-c7a5f902-b61c-40d5-9261-53feecf8936f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:19:24.978562 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-c7a5f902-b61c-40d5-9261-53feecf8936f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:19:24.985453 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c7a5f902-b61c-40d5-9261-53feecf8936f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:19:24.985887 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c7a5f902-b61c-40d5-9261-53feecf8936f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:19:24.986645 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c7a5f902-b61c-40d5-9261-53feecf8936f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:19:24.987611 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c7a5f902-b61c-40d5-9261-53feecf8936f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:19:25.016287 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-c7a5f902-b61c-40d5-9261-53feecf8936f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042385 Nov 09 20:19:25.016872 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 662/1351] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:19:24 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:19:25.573661 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 09 20:19:25.574163 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: Tue Nov 9 20:19:25 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 09 20:19:26.026626 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-853cbe18-5e49-4686-ac47-149506fbd0d5 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:19:26.027560 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-853cbe18-5e49-4686-ac47-149506fbd0d5 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:19:26.033993 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-853cbe18-5e49-4686-ac47-149506fbd0d5 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:19:26.034782 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-853cbe18-5e49-4686-ac47-149506fbd0d5 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:19:26.035570 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-853cbe18-5e49-4686-ac47-149506fbd0d5 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:19:26.036005 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-853cbe18-5e49-4686-ac47-149506fbd0d5 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:19:26.068721 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-853cbe18-5e49-4686-ac47-149506fbd0d5 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045613 Nov 09 20:19:26.069269 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 690/1352] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:19:26 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:19:27.079311 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-fab13c3d-7845-4196-a808-604b79c1039a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:19:27.080163 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-fab13c3d-7845-4196-a808-604b79c1039a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:19:27.086267 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fab13c3d-7845-4196-a808-604b79c1039a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:19:27.086703 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fab13c3d-7845-4196-a808-604b79c1039a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:19:27.087460 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fab13c3d-7845-4196-a808-604b79c1039a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:19:27.087885 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fab13c3d-7845-4196-a808-604b79c1039a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:19:27.116068 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-fab13c3d-7845-4196-a808-604b79c1039a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040660 Nov 09 20:19:27.116638 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 663/1353] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:19:27 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:19:28.127129 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-dce70871-8664-4910-a315-6bd2497c36ff tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:19:28.128509 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-dce70871-8664-4910-a315-6bd2497c36ff tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:19:28.134688 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-dce70871-8664-4910-a315-6bd2497c36ff tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:19:28.135128 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-dce70871-8664-4910-a315-6bd2497c36ff tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:19:28.135889 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-dce70871-8664-4910-a315-6bd2497c36ff tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:19:28.136312 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-dce70871-8664-4910-a315-6bd2497c36ff tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:19:28.165671 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-dce70871-8664-4910-a315-6bd2497c36ff tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042301 Nov 09 20:19:28.166219 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 691/1354] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:19:28 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:19:29.176964 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-97852c07-80a5-4eb2-ab2e-404e6f8651c9 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:19:29.177779 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-97852c07-80a5-4eb2-ab2e-404e6f8651c9 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:19:29.183873 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-97852c07-80a5-4eb2-ab2e-404e6f8651c9 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:19:29.184316 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-97852c07-80a5-4eb2-ab2e-404e6f8651c9 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:19:29.185110 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-97852c07-80a5-4eb2-ab2e-404e6f8651c9 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:19:29.185539 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-97852c07-80a5-4eb2-ab2e-404e6f8651c9 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:19:29.215583 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-97852c07-80a5-4eb2-ab2e-404e6f8651c9 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042396 Nov 09 20:19:29.216130 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 664/1355] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:19:29 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 20:19:30.227802 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-3f70999a-27f1-4d06-8b79-21980a5bde6f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:19:30.228667 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-3f70999a-27f1-4d06-8b79-21980a5bde6f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:19:30.235340 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-3f70999a-27f1-4d06-8b79-21980a5bde6f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:19:30.235785 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-3f70999a-27f1-4d06-8b79-21980a5bde6f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:19:30.236579 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-3f70999a-27f1-4d06-8b79-21980a5bde6f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:19:30.237006 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-3f70999a-27f1-4d06-8b79-21980a5bde6f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:19:30.266516 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-3f70999a-27f1-4d06-8b79-21980a5bde6f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043597 Nov 09 20:19:30.267072 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 692/1356] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:19:30 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:19:31.278248 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-35717e5a-98e0-4e07-9961-eb1497295558 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:19:31.279067 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-35717e5a-98e0-4e07-9961-eb1497295558 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:19:31.285376 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-35717e5a-98e0-4e07-9961-eb1497295558 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:19:31.285913 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-35717e5a-98e0-4e07-9961-eb1497295558 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:19:31.286705 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-35717e5a-98e0-4e07-9961-eb1497295558 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:19:31.287133 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-35717e5a-98e0-4e07-9961-eb1497295558 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:19:31.314864 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-35717e5a-98e0-4e07-9961-eb1497295558 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040515 Nov 09 20:19:31.315415 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 665/1357] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:19:31 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:19:32.177798 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 09 20:19:32.178020 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: Tue Nov 9 20:19:32 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 09 20:19:32.326613 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-6dad052c-8b6a-47ca-b935-733e1ce837a2 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:19:32.327445 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-6dad052c-8b6a-47ca-b935-733e1ce837a2 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:19:32.334099 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6dad052c-8b6a-47ca-b935-733e1ce837a2 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:19:32.334532 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6dad052c-8b6a-47ca-b935-733e1ce837a2 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:19:32.335293 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6dad052c-8b6a-47ca-b935-733e1ce837a2 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:19:32.335717 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6dad052c-8b6a-47ca-b935-733e1ce837a2 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:19:32.364077 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-6dad052c-8b6a-47ca-b935-733e1ce837a2 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041295 Nov 09 20:19:32.364633 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 693/1358] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:19:32 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:19:33.375291 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-c9c979b4-37aa-4e3e-a70a-d3d81c33334e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:19:33.376203 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-c9c979b4-37aa-4e3e-a70a-d3d81c33334e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:19:33.382837 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c9c979b4-37aa-4e3e-a70a-d3d81c33334e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:19:33.383280 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c9c979b4-37aa-4e3e-a70a-d3d81c33334e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:19:33.384048 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c9c979b4-37aa-4e3e-a70a-d3d81c33334e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:19:33.384511 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c9c979b4-37aa-4e3e-a70a-d3d81c33334e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:19:33.413135 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-c9c979b4-37aa-4e3e-a70a-d3d81c33334e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041595 Nov 09 20:19:33.413673 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 666/1359] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:19:33 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:19:34.424440 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-94d96d96-5346-4f1f-a8b5-57df8fdca62b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:19:34.425264 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-94d96d96-5346-4f1f-a8b5-57df8fdca62b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:19:34.431483 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-94d96d96-5346-4f1f-a8b5-57df8fdca62b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:19:34.431929 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-94d96d96-5346-4f1f-a8b5-57df8fdca62b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:19:34.432730 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-94d96d96-5346-4f1f-a8b5-57df8fdca62b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:19:34.433167 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-94d96d96-5346-4f1f-a8b5-57df8fdca62b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:19:34.461468 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-94d96d96-5346-4f1f-a8b5-57df8fdca62b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040853 Nov 09 20:19:34.462056 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 694/1360] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:19:34 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:19:35.473326 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-8e7a30f7-dfcd-4034-9d7e-87eff8114110 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:19:35.474262 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-8e7a30f7-dfcd-4034-9d7e-87eff8114110 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:19:35.480442 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8e7a30f7-dfcd-4034-9d7e-87eff8114110 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:19:35.480883 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8e7a30f7-dfcd-4034-9d7e-87eff8114110 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:19:35.481643 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8e7a30f7-dfcd-4034-9d7e-87eff8114110 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:19:35.482066 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8e7a30f7-dfcd-4034-9d7e-87eff8114110 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:19:35.510278 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-8e7a30f7-dfcd-4034-9d7e-87eff8114110 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041420 Nov 09 20:19:35.510808 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 667/1361] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:19:35 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:19:36.521839 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-d0de4f93-4c17-4ea0-8cbd-3b7f93b8cae0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:19:36.522983 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-d0de4f93-4c17-4ea0-8cbd-3b7f93b8cae0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:19:36.529125 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d0de4f93-4c17-4ea0-8cbd-3b7f93b8cae0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:19:36.529571 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d0de4f93-4c17-4ea0-8cbd-3b7f93b8cae0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:19:36.530340 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d0de4f93-4c17-4ea0-8cbd-3b7f93b8cae0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:19:36.530768 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d0de4f93-4c17-4ea0-8cbd-3b7f93b8cae0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:19:36.560096 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-d0de4f93-4c17-4ea0-8cbd-3b7f93b8cae0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042472 Nov 09 20:19:36.560678 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 695/1362] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:19:36 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:19:37.201515 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 09 20:19:37.202090 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: Tue Nov 9 20:19:37 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 09 20:19:37.571795 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-e82488c9-4785-4fca-98b3-85e4082057f8 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:19:37.572640 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-e82488c9-4785-4fca-98b3-85e4082057f8 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:19:37.578812 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e82488c9-4785-4fca-98b3-85e4082057f8 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:19:37.579252 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e82488c9-4785-4fca-98b3-85e4082057f8 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:19:37.580007 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e82488c9-4785-4fca-98b3-85e4082057f8 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:19:37.580450 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e82488c9-4785-4fca-98b3-85e4082057f8 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:19:37.609209 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-e82488c9-4785-4fca-98b3-85e4082057f8 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041155 Nov 09 20:19:37.609757 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 668/1363] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:19:37 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 20:19:38.621316 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-b3b889fe-5804-46a5-a947-1c47e0a583ef tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:19:38.622226 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-b3b889fe-5804-46a5-a947-1c47e0a583ef tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:19:38.628317 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b3b889fe-5804-46a5-a947-1c47e0a583ef tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:19:38.629289 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b3b889fe-5804-46a5-a947-1c47e0a583ef tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:19:38.630643 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b3b889fe-5804-46a5-a947-1c47e0a583ef tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:19:38.631076 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b3b889fe-5804-46a5-a947-1c47e0a583ef tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:19:38.659642 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-b3b889fe-5804-46a5-a947-1c47e0a583ef tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042117 Nov 09 20:19:38.660354 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 696/1364] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:19:38 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:19:39.670950 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-fd6776b6-9281-4304-8e4b-07843d1edc5b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:19:39.671847 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-fd6776b6-9281-4304-8e4b-07843d1edc5b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:19:39.677985 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fd6776b6-9281-4304-8e4b-07843d1edc5b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:19:39.678424 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fd6776b6-9281-4304-8e4b-07843d1edc5b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:19:39.679181 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fd6776b6-9281-4304-8e4b-07843d1edc5b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:19:39.679605 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fd6776b6-9281-4304-8e4b-07843d1edc5b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:19:39.706674 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-fd6776b6-9281-4304-8e4b-07843d1edc5b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039474 Nov 09 20:19:39.707769 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 669/1365] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:19:39 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:19:40.718845 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-0e9fa1fa-d6a7-4790-a07f-501738a5bee8 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:19:40.719735 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-0e9fa1fa-d6a7-4790-a07f-501738a5bee8 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:19:40.727783 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-0e9fa1fa-d6a7-4790-a07f-501738a5bee8 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:19:40.728224 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-0e9fa1fa-d6a7-4790-a07f-501738a5bee8 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:19:40.729036 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-0e9fa1fa-d6a7-4790-a07f-501738a5bee8 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:19:40.729464 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-0e9fa1fa-d6a7-4790-a07f-501738a5bee8 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:19:40.757804 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-0e9fa1fa-d6a7-4790-a07f-501738a5bee8 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042685 Nov 09 20:19:40.758338 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 697/1366] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:19:40 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:19:41.768877 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-da0dc859-f42d-4b02-ba59-3347baa7ad5b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:19:41.770285 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-da0dc859-f42d-4b02-ba59-3347baa7ad5b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:19:41.776473 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-da0dc859-f42d-4b02-ba59-3347baa7ad5b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:19:41.776930 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-da0dc859-f42d-4b02-ba59-3347baa7ad5b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:19:41.777700 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-da0dc859-f42d-4b02-ba59-3347baa7ad5b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:19:41.778133 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-da0dc859-f42d-4b02-ba59-3347baa7ad5b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:19:41.806039 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-da0dc859-f42d-4b02-ba59-3347baa7ad5b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040916 Nov 09 20:19:41.806579 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 670/1367] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:19:41 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:19:42.818126 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-75d915ec-2795-400d-b513-8efa3cd32648 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:19:42.818967 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-75d915ec-2795-400d-b513-8efa3cd32648 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:19:42.825210 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-75d915ec-2795-400d-b513-8efa3cd32648 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:19:42.825660 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-75d915ec-2795-400d-b513-8efa3cd32648 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:19:42.826431 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-75d915ec-2795-400d-b513-8efa3cd32648 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:19:42.826864 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-75d915ec-2795-400d-b513-8efa3cd32648 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:19:42.855079 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-75d915ec-2795-400d-b513-8efa3cd32648 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041508 Nov 09 20:19:42.855630 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 698/1368] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:19:42 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:19:43.866729 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-71936483-9a0a-40f8-9a8a-35f5f865d46f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:19:43.867545 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-71936483-9a0a-40f8-9a8a-35f5f865d46f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:19:43.873717 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-71936483-9a0a-40f8-9a8a-35f5f865d46f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:19:43.874156 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-71936483-9a0a-40f8-9a8a-35f5f865d46f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:19:43.874906 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-71936483-9a0a-40f8-9a8a-35f5f865d46f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:19:43.875328 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-71936483-9a0a-40f8-9a8a-35f5f865d46f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:19:43.903927 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-71936483-9a0a-40f8-9a8a-35f5f865d46f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041171 Nov 09 20:19:43.904482 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 671/1369] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:19:43 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:19:44.915777 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-d4ddd23a-5895-4a7b-a7e3-a362d5b3a64e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:19:44.916621 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-d4ddd23a-5895-4a7b-a7e3-a362d5b3a64e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:19:44.922670 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d4ddd23a-5895-4a7b-a7e3-a362d5b3a64e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:19:44.923110 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d4ddd23a-5895-4a7b-a7e3-a362d5b3a64e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:19:44.923868 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d4ddd23a-5895-4a7b-a7e3-a362d5b3a64e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:19:44.924299 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d4ddd23a-5895-4a7b-a7e3-a362d5b3a64e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:19:44.952339 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-d4ddd23a-5895-4a7b-a7e3-a362d5b3a64e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040388 Nov 09 20:19:44.952910 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 699/1370] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:19:44 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 20:19:45.963291 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-78a14482-9ed0-451d-bba9-d8653ccb5274 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:19:45.964120 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-78a14482-9ed0-451d-bba9-d8653ccb5274 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:19:45.970453 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-78a14482-9ed0-451d-bba9-d8653ccb5274 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:19:45.970894 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-78a14482-9ed0-451d-bba9-d8653ccb5274 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:19:45.971653 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-78a14482-9ed0-451d-bba9-d8653ccb5274 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:19:45.972106 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-78a14482-9ed0-451d-bba9-d8653ccb5274 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:19:46.002530 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-78a14482-9ed0-451d-bba9-d8653ccb5274 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043084 Nov 09 20:19:46.003066 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 672/1371] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:19:45 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:19:47.014091 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-186b5d18-d6ba-4593-a8bc-0daf862ba701 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:19:47.014908 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-186b5d18-d6ba-4593-a8bc-0daf862ba701 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:19:47.021432 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-186b5d18-d6ba-4593-a8bc-0daf862ba701 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:19:47.021875 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-186b5d18-d6ba-4593-a8bc-0daf862ba701 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:19:47.022634 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-186b5d18-d6ba-4593-a8bc-0daf862ba701 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:19:47.023059 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-186b5d18-d6ba-4593-a8bc-0daf862ba701 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:19:47.050518 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-186b5d18-d6ba-4593-a8bc-0daf862ba701 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040427 Nov 09 20:19:47.051325 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 700/1372] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:19:47 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:19:48.062095 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-21a81cad-700f-463f-8b34-30691bb841e4 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:19:48.062940 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-21a81cad-700f-463f-8b34-30691bb841e4 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:19:48.069159 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-21a81cad-700f-463f-8b34-30691bb841e4 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:19:48.069609 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-21a81cad-700f-463f-8b34-30691bb841e4 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:19:48.070383 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-21a81cad-700f-463f-8b34-30691bb841e4 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:19:48.070818 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-21a81cad-700f-463f-8b34-30691bb841e4 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:19:48.099660 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-21a81cad-700f-463f-8b34-30691bb841e4 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041348 Nov 09 20:19:48.100200 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 673/1373] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:19:48 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:19:49.110046 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-ac9adbf9-44a6-4a67-8c08-fb93d51ad56f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:19:49.111163 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-ac9adbf9-44a6-4a67-8c08-fb93d51ad56f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:19:49.117783 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ac9adbf9-44a6-4a67-8c08-fb93d51ad56f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:19:49.118291 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ac9adbf9-44a6-4a67-8c08-fb93d51ad56f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:19:49.119057 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ac9adbf9-44a6-4a67-8c08-fb93d51ad56f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:19:49.119483 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ac9adbf9-44a6-4a67-8c08-fb93d51ad56f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:19:49.149652 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-ac9adbf9-44a6-4a67-8c08-fb93d51ad56f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043408 Nov 09 20:19:49.150206 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 701/1374] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:19:49 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:19:50.160984 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-a3a17ecc-cff9-4e7d-92a7-740165a13b83 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:19:50.161940 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-a3a17ecc-cff9-4e7d-92a7-740165a13b83 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:19:50.168278 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a3a17ecc-cff9-4e7d-92a7-740165a13b83 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:19:50.168753 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a3a17ecc-cff9-4e7d-92a7-740165a13b83 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:19:50.169648 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a3a17ecc-cff9-4e7d-92a7-740165a13b83 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:19:50.170001 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a3a17ecc-cff9-4e7d-92a7-740165a13b83 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:19:50.200018 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-a3a17ecc-cff9-4e7d-92a7-740165a13b83 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043540 Nov 09 20:19:50.200897 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 674/1375] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:19:50 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:19:51.211386 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-a19f2237-86a2-4bf5-87b2-9b4136ac3e75 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:19:51.212289 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-a19f2237-86a2-4bf5-87b2-9b4136ac3e75 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:19:51.218382 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a19f2237-86a2-4bf5-87b2-9b4136ac3e75 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:19:51.218818 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a19f2237-86a2-4bf5-87b2-9b4136ac3e75 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:19:51.219574 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a19f2237-86a2-4bf5-87b2-9b4136ac3e75 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:19:51.220032 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a19f2237-86a2-4bf5-87b2-9b4136ac3e75 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:19:51.249640 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-a19f2237-86a2-4bf5-87b2-9b4136ac3e75 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041969 Nov 09 20:19:51.250184 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 702/1376] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:19:51 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:19:52.260775 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-5ebea242-9cdd-43d7-96d1-d0cb2d233dd2 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:19:52.261598 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-5ebea242-9cdd-43d7-96d1-d0cb2d233dd2 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:19:52.267678 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5ebea242-9cdd-43d7-96d1-d0cb2d233dd2 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:19:52.268115 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5ebea242-9cdd-43d7-96d1-d0cb2d233dd2 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:19:52.268900 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5ebea242-9cdd-43d7-96d1-d0cb2d233dd2 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:19:52.269955 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5ebea242-9cdd-43d7-96d1-d0cb2d233dd2 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:19:52.297425 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-5ebea242-9cdd-43d7-96d1-d0cb2d233dd2 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040366 Nov 09 20:19:52.297968 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 675/1377] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:19:52 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:19:53.309043 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-ef16fa88-f8a1-4f00-ac68-2547c2d646db tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:19:53.309951 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-ef16fa88-f8a1-4f00-ac68-2547c2d646db tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:19:53.316218 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ef16fa88-f8a1-4f00-ac68-2547c2d646db tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:19:53.317423 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ef16fa88-f8a1-4f00-ac68-2547c2d646db tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:19:53.318185 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ef16fa88-f8a1-4f00-ac68-2547c2d646db tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:19:53.318620 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ef16fa88-f8a1-4f00-ac68-2547c2d646db tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:19:53.346931 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-ef16fa88-f8a1-4f00-ac68-2547c2d646db tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041717 Nov 09 20:19:53.347602 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 703/1378] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:19:53 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:19:54.358283 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-778eae99-1a55-4bd5-8f71-3894293158af tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:19:54.359215 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-778eae99-1a55-4bd5-8f71-3894293158af tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:19:54.365882 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-778eae99-1a55-4bd5-8f71-3894293158af tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:19:54.366321 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-778eae99-1a55-4bd5-8f71-3894293158af tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:19:54.367077 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-778eae99-1a55-4bd5-8f71-3894293158af tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:19:54.367500 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-778eae99-1a55-4bd5-8f71-3894293158af tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:19:54.396356 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-778eae99-1a55-4bd5-8f71-3894293158af tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041786 Nov 09 20:19:54.396859 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 676/1379] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:19:54 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:19:55.407327 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-ce58d53b-e461-48ab-9905-4b877e3b1229 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:19:55.408236 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-ce58d53b-e461-48ab-9905-4b877e3b1229 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:19:55.415206 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ce58d53b-e461-48ab-9905-4b877e3b1229 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:19:55.415591 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ce58d53b-e461-48ab-9905-4b877e3b1229 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:19:55.416368 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ce58d53b-e461-48ab-9905-4b877e3b1229 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:19:55.416827 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ce58d53b-e461-48ab-9905-4b877e3b1229 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:19:55.593333 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-ce58d53b-e461-48ab-9905-4b877e3b1229 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.189635 Nov 09 20:19:55.593878 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 704/1380] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:19:55 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:19:56.604533 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-bf96c08a-ba51-4762-b22d-e8d755c11646 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:19:56.605434 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-bf96c08a-ba51-4762-b22d-e8d755c11646 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:19:56.611465 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bf96c08a-ba51-4762-b22d-e8d755c11646 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:19:56.611901 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bf96c08a-ba51-4762-b22d-e8d755c11646 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:19:56.612773 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bf96c08a-ba51-4762-b22d-e8d755c11646 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:19:56.613890 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bf96c08a-ba51-4762-b22d-e8d755c11646 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:19:56.642198 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-bf96c08a-ba51-4762-b22d-e8d755c11646 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041404 Nov 09 20:19:56.642753 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 677/1381] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:19:56 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:19:57.653538 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-1938e9a8-59e8-4181-9211-c4f14165de0a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:19:57.654441 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-1938e9a8-59e8-4181-9211-c4f14165de0a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:19:57.660884 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-1938e9a8-59e8-4181-9211-c4f14165de0a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:19:57.661333 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-1938e9a8-59e8-4181-9211-c4f14165de0a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:19:57.662103 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-1938e9a8-59e8-4181-9211-c4f14165de0a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:19:57.662537 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-1938e9a8-59e8-4181-9211-c4f14165de0a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:19:57.690771 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-1938e9a8-59e8-4181-9211-c4f14165de0a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040934 Nov 09 20:19:57.692117 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 705/1382] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:19:57 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:19:58.702761 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-ee4d8ba7-bf22-4f28-82ca-e93c72620485 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:19:58.703665 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-ee4d8ba7-bf22-4f28-82ca-e93c72620485 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:19:58.710207 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ee4d8ba7-bf22-4f28-82ca-e93c72620485 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:19:58.710651 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ee4d8ba7-bf22-4f28-82ca-e93c72620485 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:19:58.711419 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ee4d8ba7-bf22-4f28-82ca-e93c72620485 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:19:58.711846 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ee4d8ba7-bf22-4f28-82ca-e93c72620485 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:19:58.741647 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-ee4d8ba7-bf22-4f28-82ca-e93c72620485 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042586 Nov 09 20:19:58.742180 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 678/1383] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:19:58 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:19:59.753025 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-835df99d-a010-4dda-90b3-a2500533360f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:19:59.754434 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-835df99d-a010-4dda-90b3-a2500533360f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:19:59.760746 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-835df99d-a010-4dda-90b3-a2500533360f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:19:59.761199 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-835df99d-a010-4dda-90b3-a2500533360f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:19:59.761976 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-835df99d-a010-4dda-90b3-a2500533360f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:19:59.762412 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-835df99d-a010-4dda-90b3-a2500533360f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:19:59.791015 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-835df99d-a010-4dda-90b3-a2500533360f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041914 Nov 09 20:19:59.791551 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 706/1384] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:19:59 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:20:00.802616 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-ce23b4bd-921b-4b26-ad60-cd35587ca9b6 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:20:00.803520 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-ce23b4bd-921b-4b26-ad60-cd35587ca9b6 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:20:00.809707 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ce23b4bd-921b-4b26-ad60-cd35587ca9b6 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:20:00.810151 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ce23b4bd-921b-4b26-ad60-cd35587ca9b6 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:20:00.810914 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ce23b4bd-921b-4b26-ad60-cd35587ca9b6 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:20:00.811341 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ce23b4bd-921b-4b26-ad60-cd35587ca9b6 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:20:00.839949 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-ce23b4bd-921b-4b26-ad60-cd35587ca9b6 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041569 Nov 09 20:20:00.840510 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 679/1385] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:20:00 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:20:01.851438 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-091f5bac-4abd-4f5e-a9e7-0fc13b77034d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:20:01.852362 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-091f5bac-4abd-4f5e-a9e7-0fc13b77034d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:20:01.858565 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-091f5bac-4abd-4f5e-a9e7-0fc13b77034d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:20:01.859008 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-091f5bac-4abd-4f5e-a9e7-0fc13b77034d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:20:01.859782 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-091f5bac-4abd-4f5e-a9e7-0fc13b77034d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:20:01.860211 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-091f5bac-4abd-4f5e-a9e7-0fc13b77034d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:20:01.889531 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-091f5bac-4abd-4f5e-a9e7-0fc13b77034d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042448 Nov 09 20:20:01.890062 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 707/1386] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:20:01 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:20:02.900819 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-d76f2438-cc90-4200-8472-cd86854c39b2 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:20:02.902765 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-d76f2438-cc90-4200-8472-cd86854c39b2 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:20:02.908906 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d76f2438-cc90-4200-8472-cd86854c39b2 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:20:02.909353 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d76f2438-cc90-4200-8472-cd86854c39b2 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:20:02.910183 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d76f2438-cc90-4200-8472-cd86854c39b2 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:20:02.911259 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d76f2438-cc90-4200-8472-cd86854c39b2 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:20:02.938918 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-d76f2438-cc90-4200-8472-cd86854c39b2 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041786 Nov 09 20:20:02.939454 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 680/1387] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:20:02 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:20:03.949863 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-0e8db788-f939-4855-9563-d74345f564da tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:20:03.950762 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-0e8db788-f939-4855-9563-d74345f564da tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:20:03.956970 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-0e8db788-f939-4855-9563-d74345f564da tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:20:03.957494 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-0e8db788-f939-4855-9563-d74345f564da tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:20:03.958323 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-0e8db788-f939-4855-9563-d74345f564da tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:20:03.958748 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-0e8db788-f939-4855-9563-d74345f564da tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:20:03.987157 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-0e8db788-f939-4855-9563-d74345f564da tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041015 Nov 09 20:20:03.987690 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 708/1388] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:20:03 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 20:20:04.999310 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-16df0ea8-33ca-4a0b-b64b-d00242e63a25 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:20:05.000132 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-16df0ea8-33ca-4a0b-b64b-d00242e63a25 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:20:05.006453 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-16df0ea8-33ca-4a0b-b64b-d00242e63a25 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:20:05.006905 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-16df0ea8-33ca-4a0b-b64b-d00242e63a25 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:20:05.007671 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-16df0ea8-33ca-4a0b-b64b-d00242e63a25 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:20:05.008101 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-16df0ea8-33ca-4a0b-b64b-d00242e63a25 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:20:05.035365 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-16df0ea8-33ca-4a0b-b64b-d00242e63a25 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039943 Nov 09 20:20:05.036550 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 681/1389] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:20:04 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:20:06.047162 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-5fb6eea0-6be4-4536-a97c-0615dd1c634c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:20:06.047994 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-5fb6eea0-6be4-4536-a97c-0615dd1c634c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:20:06.054714 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-5fb6eea0-6be4-4536-a97c-0615dd1c634c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:20:06.055166 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-5fb6eea0-6be4-4536-a97c-0615dd1c634c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:20:06.055940 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-5fb6eea0-6be4-4536-a97c-0615dd1c634c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:20:06.056375 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-5fb6eea0-6be4-4536-a97c-0615dd1c634c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:20:06.085096 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-5fb6eea0-6be4-4536-a97c-0615dd1c634c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041686 Nov 09 20:20:06.085633 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 709/1390] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:20:06 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:20:07.096228 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-be03995f-056d-4412-96c6-7fa94cdff0d4 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:20:07.097147 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-be03995f-056d-4412-96c6-7fa94cdff0d4 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:20:07.103798 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-be03995f-056d-4412-96c6-7fa94cdff0d4 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:20:07.104233 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-be03995f-056d-4412-96c6-7fa94cdff0d4 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:20:07.105031 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-be03995f-056d-4412-96c6-7fa94cdff0d4 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:20:07.105462 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-be03995f-056d-4412-96c6-7fa94cdff0d4 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:20:07.133966 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-be03995f-056d-4412-96c6-7fa94cdff0d4 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041398 Nov 09 20:20:07.134496 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 682/1391] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:20:07 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:20:08.144283 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-27a47d69-3359-4c0f-b66f-f22ff9c61cee tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:20:08.145458 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-27a47d69-3359-4c0f-b66f-f22ff9c61cee tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:20:08.151608 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-27a47d69-3359-4c0f-b66f-f22ff9c61cee tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:20:08.152056 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-27a47d69-3359-4c0f-b66f-f22ff9c61cee tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:20:08.152856 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-27a47d69-3359-4c0f-b66f-f22ff9c61cee tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:20:08.153290 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-27a47d69-3359-4c0f-b66f-f22ff9c61cee tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:20:08.183011 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-27a47d69-3359-4c0f-b66f-f22ff9c61cee tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042425 Nov 09 20:20:08.183548 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 710/1392] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:20:08 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:20:09.194520 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-3fdf35e8-e5f1-473e-a1da-26fec2e1f449 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:20:09.195427 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-3fdf35e8-e5f1-473e-a1da-26fec2e1f449 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:20:09.201803 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3fdf35e8-e5f1-473e-a1da-26fec2e1f449 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:20:09.202247 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3fdf35e8-e5f1-473e-a1da-26fec2e1f449 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:20:09.203010 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3fdf35e8-e5f1-473e-a1da-26fec2e1f449 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:20:09.203482 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3fdf35e8-e5f1-473e-a1da-26fec2e1f449 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:20:09.233095 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-3fdf35e8-e5f1-473e-a1da-26fec2e1f449 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042545 Nov 09 20:20:09.233647 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 683/1393] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:20:09 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:20:10.245081 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-34ed1bf8-f7f3-4e6c-8916-324339031639 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:20:10.245902 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-34ed1bf8-f7f3-4e6c-8916-324339031639 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:20:10.252071 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-34ed1bf8-f7f3-4e6c-8916-324339031639 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:20:10.252557 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-34ed1bf8-f7f3-4e6c-8916-324339031639 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:20:10.253330 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-34ed1bf8-f7f3-4e6c-8916-324339031639 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:20:10.253769 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-34ed1bf8-f7f3-4e6c-8916-324339031639 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:20:10.281777 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-34ed1bf8-f7f3-4e6c-8916-324339031639 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040467 Nov 09 20:20:10.282318 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 711/1394] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:20:10 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:20:11.293592 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-1dd457f0-e1df-4cb8-91a9-ec4f64dc74b3 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:20:11.294527 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-1dd457f0-e1df-4cb8-91a9-ec4f64dc74b3 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:20:11.300707 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1dd457f0-e1df-4cb8-91a9-ec4f64dc74b3 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:20:11.301719 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1dd457f0-e1df-4cb8-91a9-ec4f64dc74b3 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:20:11.302680 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1dd457f0-e1df-4cb8-91a9-ec4f64dc74b3 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:20:11.303114 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1dd457f0-e1df-4cb8-91a9-ec4f64dc74b3 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:20:11.332096 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-1dd457f0-e1df-4cb8-91a9-ec4f64dc74b3 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042251 Nov 09 20:20:11.332924 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 684/1395] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:20:11 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:20:12.343529 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-19375a59-7279-4fec-9dcc-226fb513779b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:20:12.344473 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-19375a59-7279-4fec-9dcc-226fb513779b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:20:12.351094 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-19375a59-7279-4fec-9dcc-226fb513779b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:20:12.351547 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-19375a59-7279-4fec-9dcc-226fb513779b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:20:12.352311 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-19375a59-7279-4fec-9dcc-226fb513779b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:20:12.352779 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-19375a59-7279-4fec-9dcc-226fb513779b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:20:12.381700 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-19375a59-7279-4fec-9dcc-226fb513779b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041913 Nov 09 20:20:12.382236 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 712/1396] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:20:12 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:20:13.392953 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-255264ab-4de3-4ef9-aca6-fe6039fd8400 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:20:13.393857 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-255264ab-4de3-4ef9-aca6-fe6039fd8400 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:20:13.400987 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-255264ab-4de3-4ef9-aca6-fe6039fd8400 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:20:13.401433 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-255264ab-4de3-4ef9-aca6-fe6039fd8400 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:20:13.402194 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-255264ab-4de3-4ef9-aca6-fe6039fd8400 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:20:13.402621 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-255264ab-4de3-4ef9-aca6-fe6039fd8400 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:20:13.431335 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-255264ab-4de3-4ef9-aca6-fe6039fd8400 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042189 Nov 09 20:20:13.431870 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 685/1397] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:20:13 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:20:14.443456 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-020e1f0f-9715-413a-bd45-ee9edd8a7add tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:20:14.444288 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-020e1f0f-9715-413a-bd45-ee9edd8a7add tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:20:14.450779 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-020e1f0f-9715-413a-bd45-ee9edd8a7add tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:20:14.451231 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-020e1f0f-9715-413a-bd45-ee9edd8a7add tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:20:14.452006 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-020e1f0f-9715-413a-bd45-ee9edd8a7add tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:20:14.452532 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-020e1f0f-9715-413a-bd45-ee9edd8a7add tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:20:14.481349 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-020e1f0f-9715-413a-bd45-ee9edd8a7add tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042558 Nov 09 20:20:14.481882 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 713/1398] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:20:14 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:20:15.492615 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-61543e1b-f209-47dc-a535-48f80f38ad6c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:20:15.493465 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-61543e1b-f209-47dc-a535-48f80f38ad6c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:20:15.499536 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-61543e1b-f209-47dc-a535-48f80f38ad6c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:20:15.499971 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-61543e1b-f209-47dc-a535-48f80f38ad6c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:20:15.500763 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-61543e1b-f209-47dc-a535-48f80f38ad6c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:20:15.501172 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-61543e1b-f209-47dc-a535-48f80f38ad6c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:20:15.529935 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-61543e1b-f209-47dc-a535-48f80f38ad6c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041179 Nov 09 20:20:15.530472 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 686/1399] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:20:15 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:20:16.542054 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-7a0f9ce0-0d3d-4e76-a239-5e7ace92e452 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:20:16.542916 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-7a0f9ce0-0d3d-4e76-a239-5e7ace92e452 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:20:16.548662 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-7a0f9ce0-0d3d-4e76-a239-5e7ace92e452 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:20:16.549119 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-7a0f9ce0-0d3d-4e76-a239-5e7ace92e452 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:20:16.549890 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-7a0f9ce0-0d3d-4e76-a239-5e7ace92e452 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:20:16.550321 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-7a0f9ce0-0d3d-4e76-a239-5e7ace92e452 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:20:16.577903 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-7a0f9ce0-0d3d-4e76-a239-5e7ace92e452 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039854 Nov 09 20:20:16.578439 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 714/1400] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:20:16 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:20:17.589164 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-7f54019f-7b31-4bee-82af-d53128063652 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:20:17.590001 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-7f54019f-7b31-4bee-82af-d53128063652 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:20:17.596259 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7f54019f-7b31-4bee-82af-d53128063652 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:20:17.596765 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7f54019f-7b31-4bee-82af-d53128063652 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:20:17.597535 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7f54019f-7b31-4bee-82af-d53128063652 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:20:17.598472 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7f54019f-7b31-4bee-82af-d53128063652 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:20:17.627395 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-7f54019f-7b31-4bee-82af-d53128063652 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042010 Nov 09 20:20:17.627952 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 687/1401] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:20:17 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:20:18.638760 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-4f30e02e-3780-4d5a-af88-b939441008ee tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:20:18.639662 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-4f30e02e-3780-4d5a-af88-b939441008ee tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:20:18.645960 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-4f30e02e-3780-4d5a-af88-b939441008ee tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:20:18.646402 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-4f30e02e-3780-4d5a-af88-b939441008ee tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:20:18.647159 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-4f30e02e-3780-4d5a-af88-b939441008ee tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:20:18.647586 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-4f30e02e-3780-4d5a-af88-b939441008ee tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:20:18.675441 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-4f30e02e-3780-4d5a-af88-b939441008ee tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040365 Nov 09 20:20:18.676616 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 715/1402] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:20:18 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:20:19.687444 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-4883f7d7-2308-45da-9217-3ee7835f7834 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:20:19.688348 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-4883f7d7-2308-45da-9217-3ee7835f7834 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:20:19.695384 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4883f7d7-2308-45da-9217-3ee7835f7834 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:20:19.695838 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4883f7d7-2308-45da-9217-3ee7835f7834 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:20:19.696676 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4883f7d7-2308-45da-9217-3ee7835f7834 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:20:19.697114 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4883f7d7-2308-45da-9217-3ee7835f7834 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:20:19.725073 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-4883f7d7-2308-45da-9217-3ee7835f7834 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041491 Nov 09 20:20:19.725613 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 688/1403] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:20:19 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:20:20.736207 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-9a8bf924-ecd0-46b6-8b83-bd3b4513c930 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:20:20.737159 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-9a8bf924-ecd0-46b6-8b83-bd3b4513c930 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:20:20.744256 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-9a8bf924-ecd0-46b6-8b83-bd3b4513c930 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:20:20.744737 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-9a8bf924-ecd0-46b6-8b83-bd3b4513c930 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:20:20.745510 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-9a8bf924-ecd0-46b6-8b83-bd3b4513c930 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:20:20.745941 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-9a8bf924-ecd0-46b6-8b83-bd3b4513c930 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:20:20.774089 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-9a8bf924-ecd0-46b6-8b83-bd3b4513c930 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041863 Nov 09 20:20:20.774634 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 716/1404] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:20:20 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:20:21.784455 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-eb35f5bb-6647-456e-a44e-97e8bfad19ed tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:20:21.785361 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-eb35f5bb-6647-456e-a44e-97e8bfad19ed tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:20:21.792236 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-eb35f5bb-6647-456e-a44e-97e8bfad19ed tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:20:21.792652 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-eb35f5bb-6647-456e-a44e-97e8bfad19ed tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:20:21.793410 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-eb35f5bb-6647-456e-a44e-97e8bfad19ed tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:20:21.793835 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-eb35f5bb-6647-456e-a44e-97e8bfad19ed tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:20:21.821452 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-eb35f5bb-6647-456e-a44e-97e8bfad19ed tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040723 Nov 09 20:20:21.821984 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 689/1405] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:20:21 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:20:22.832751 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-99189f7e-8ab5-4a77-8cc2-3da01ee67583 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:20:22.833806 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-99189f7e-8ab5-4a77-8cc2-3da01ee67583 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:20:22.840223 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-99189f7e-8ab5-4a77-8cc2-3da01ee67583 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:20:22.840701 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-99189f7e-8ab5-4a77-8cc2-3da01ee67583 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:20:22.841558 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-99189f7e-8ab5-4a77-8cc2-3da01ee67583 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:20:22.841998 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-99189f7e-8ab5-4a77-8cc2-3da01ee67583 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:20:22.871906 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-99189f7e-8ab5-4a77-8cc2-3da01ee67583 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043021 Nov 09 20:20:22.872469 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 717/1406] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:20:22 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:20:23.883773 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-cb7d8266-014c-47a4-93b4-d98e06dd6f05 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:20:23.884719 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-cb7d8266-014c-47a4-93b4-d98e06dd6f05 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:20:23.890964 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cb7d8266-014c-47a4-93b4-d98e06dd6f05 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:20:23.891419 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cb7d8266-014c-47a4-93b4-d98e06dd6f05 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:20:23.892191 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cb7d8266-014c-47a4-93b4-d98e06dd6f05 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:20:23.892720 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cb7d8266-014c-47a4-93b4-d98e06dd6f05 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:20:23.920508 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-cb7d8266-014c-47a4-93b4-d98e06dd6f05 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041257 Nov 09 20:20:23.921059 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 690/1407] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:20:23 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:20:24.932605 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-e507bf72-d1d7-40fa-ae95-8ffd3331ac51 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:20:24.933538 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-e507bf72-d1d7-40fa-ae95-8ffd3331ac51 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:20:24.939885 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e507bf72-d1d7-40fa-ae95-8ffd3331ac51 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:20:24.940335 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e507bf72-d1d7-40fa-ae95-8ffd3331ac51 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:20:24.941148 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e507bf72-d1d7-40fa-ae95-8ffd3331ac51 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:20:24.941582 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e507bf72-d1d7-40fa-ae95-8ffd3331ac51 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:20:24.970031 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-e507bf72-d1d7-40fa-ae95-8ffd3331ac51 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041227 Nov 09 20:20:24.970558 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 718/1408] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:20:24 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:20:25.981586 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-3302f211-ea76-4254-aa71-258a1c9813c1 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:20:25.982474 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-3302f211-ea76-4254-aa71-258a1c9813c1 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:20:25.988512 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3302f211-ea76-4254-aa71-258a1c9813c1 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:20:25.988954 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3302f211-ea76-4254-aa71-258a1c9813c1 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:20:25.989711 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3302f211-ea76-4254-aa71-258a1c9813c1 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:20:25.990142 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3302f211-ea76-4254-aa71-258a1c9813c1 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:20:26.018218 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-3302f211-ea76-4254-aa71-258a1c9813c1 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040422 Nov 09 20:20:26.018760 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 691/1409] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:20:25 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:20:27.030168 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-b62cd26c-8a0f-4eb4-9a2e-20c12a3c9341 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:20:27.031060 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-b62cd26c-8a0f-4eb4-9a2e-20c12a3c9341 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:20:27.037459 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b62cd26c-8a0f-4eb4-9a2e-20c12a3c9341 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:20:27.037907 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b62cd26c-8a0f-4eb4-9a2e-20c12a3c9341 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:20:27.038755 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b62cd26c-8a0f-4eb4-9a2e-20c12a3c9341 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:20:27.039187 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b62cd26c-8a0f-4eb4-9a2e-20c12a3c9341 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:20:27.066934 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-b62cd26c-8a0f-4eb4-9a2e-20c12a3c9341 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040524 Nov 09 20:20:27.067408 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 719/1410] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:20:27 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:20:28.078929 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-39a64cf8-3dae-44a4-9220-69156c3a2638 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:20:28.079776 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-39a64cf8-3dae-44a4-9220-69156c3a2638 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:20:28.086623 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-39a64cf8-3dae-44a4-9220-69156c3a2638 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:20:28.087072 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-39a64cf8-3dae-44a4-9220-69156c3a2638 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:20:28.087839 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-39a64cf8-3dae-44a4-9220-69156c3a2638 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:20:28.088271 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-39a64cf8-3dae-44a4-9220-69156c3a2638 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:20:28.115999 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-39a64cf8-3dae-44a4-9220-69156c3a2638 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040860 Nov 09 20:20:28.116574 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 692/1411] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:20:28 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:20:29.126885 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-7468e0c6-3563-430a-a727-87d7f11f3c96 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:20:29.127809 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-7468e0c6-3563-430a-a727-87d7f11f3c96 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:20:29.135123 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-7468e0c6-3563-430a-a727-87d7f11f3c96 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:20:29.135713 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-7468e0c6-3563-430a-a727-87d7f11f3c96 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:20:29.136597 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-7468e0c6-3563-430a-a727-87d7f11f3c96 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:20:29.137096 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-7468e0c6-3563-430a-a727-87d7f11f3c96 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:20:29.165519 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-7468e0c6-3563-430a-a727-87d7f11f3c96 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042329 Nov 09 20:20:29.166063 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 720/1412] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:20:29 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:20:30.176724 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-96ff0f17-7fa8-469c-9265-d6eb53331070 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:20:30.177651 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-96ff0f17-7fa8-469c-9265-d6eb53331070 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:20:30.183734 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-96ff0f17-7fa8-469c-9265-d6eb53331070 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:20:30.184172 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-96ff0f17-7fa8-469c-9265-d6eb53331070 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:20:30.184991 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-96ff0f17-7fa8-469c-9265-d6eb53331070 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:20:30.185412 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-96ff0f17-7fa8-469c-9265-d6eb53331070 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:20:30.214010 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-96ff0f17-7fa8-469c-9265-d6eb53331070 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040985 Nov 09 20:20:30.214562 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 693/1413] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:20:30 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:20:31.224914 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-2c5b604c-a914-4bc8-964c-063550d9e641 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:20:31.225845 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-2c5b604c-a914-4bc8-964c-063550d9e641 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:20:31.232003 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-2c5b604c-a914-4bc8-964c-063550d9e641 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:20:31.232474 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-2c5b604c-a914-4bc8-964c-063550d9e641 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:20:31.233240 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-2c5b604c-a914-4bc8-964c-063550d9e641 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:20:31.233675 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-2c5b604c-a914-4bc8-964c-063550d9e641 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:20:31.263289 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-2c5b604c-a914-4bc8-964c-063550d9e641 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042667 Nov 09 20:20:31.263832 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 721/1414] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:20:31 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:20:32.274256 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-8975168f-7faa-4a4f-a538-7afc7aa55b06 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:20:32.275083 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-8975168f-7faa-4a4f-a538-7afc7aa55b06 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:20:32.281308 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8975168f-7faa-4a4f-a538-7afc7aa55b06 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:20:32.281755 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8975168f-7faa-4a4f-a538-7afc7aa55b06 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:20:32.282527 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8975168f-7faa-4a4f-a538-7afc7aa55b06 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:20:32.282958 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8975168f-7faa-4a4f-a538-7afc7aa55b06 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:20:32.311404 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-8975168f-7faa-4a4f-a538-7afc7aa55b06 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041031 Nov 09 20:20:32.311946 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 694/1415] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:20:32 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:20:33.323361 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-6141c1f7-ec62-4001-a616-14cf7cecfa52 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:20:33.324300 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-6141c1f7-ec62-4001-a616-14cf7cecfa52 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:20:33.331199 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6141c1f7-ec62-4001-a616-14cf7cecfa52 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:20:33.331658 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6141c1f7-ec62-4001-a616-14cf7cecfa52 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:20:33.332478 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6141c1f7-ec62-4001-a616-14cf7cecfa52 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:20:33.332915 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6141c1f7-ec62-4001-a616-14cf7cecfa52 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:20:33.362900 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-6141c1f7-ec62-4001-a616-14cf7cecfa52 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043294 Nov 09 20:20:33.363459 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 722/1416] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:20:33 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:20:34.374756 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-40e598ad-d555-48d6-a264-1ed3153ddff0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:20:34.375651 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-40e598ad-d555-48d6-a264-1ed3153ddff0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:20:34.381843 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-40e598ad-d555-48d6-a264-1ed3153ddff0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:20:34.382282 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-40e598ad-d555-48d6-a264-1ed3153ddff0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:20:34.383038 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-40e598ad-d555-48d6-a264-1ed3153ddff0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:20:34.383461 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-40e598ad-d555-48d6-a264-1ed3153ddff0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:20:34.411251 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-40e598ad-d555-48d6-a264-1ed3153ddff0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040320 Nov 09 20:20:34.411785 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 695/1417] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:20:34 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:20:35.423095 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-e69e543f-d91e-49a8-9172-7e8e745e8d69 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:20:35.423999 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-e69e543f-d91e-49a8-9172-7e8e745e8d69 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:20:35.430903 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e69e543f-d91e-49a8-9172-7e8e745e8d69 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:20:35.431349 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e69e543f-d91e-49a8-9172-7e8e745e8d69 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:20:35.432120 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e69e543f-d91e-49a8-9172-7e8e745e8d69 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:20:35.432596 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e69e543f-d91e-49a8-9172-7e8e745e8d69 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:20:35.460497 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-e69e543f-d91e-49a8-9172-7e8e745e8d69 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041116 Nov 09 20:20:35.461039 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 723/1418] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:20:35 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:20:36.471179 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-c1fd7316-9ec2-4fd0-adbb-0878c1f05cfe tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:20:36.472014 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-c1fd7316-9ec2-4fd0-adbb-0878c1f05cfe tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:20:36.478581 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c1fd7316-9ec2-4fd0-adbb-0878c1f05cfe tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:20:36.479027 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c1fd7316-9ec2-4fd0-adbb-0878c1f05cfe tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:20:36.479802 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c1fd7316-9ec2-4fd0-adbb-0878c1f05cfe tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:20:36.480234 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c1fd7316-9ec2-4fd0-adbb-0878c1f05cfe tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:20:36.509594 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-c1fd7316-9ec2-4fd0-adbb-0878c1f05cfe tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042273 Nov 09 20:20:36.510155 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 696/1419] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:20:36 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:20:37.521145 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-348bd02a-3c2a-498d-a744-bd5f70bd6635 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:20:37.521978 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-348bd02a-3c2a-498d-a744-bd5f70bd6635 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:20:37.528112 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-348bd02a-3c2a-498d-a744-bd5f70bd6635 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:20:37.528604 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-348bd02a-3c2a-498d-a744-bd5f70bd6635 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:20:37.529389 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-348bd02a-3c2a-498d-a744-bd5f70bd6635 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:20:37.529822 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-348bd02a-3c2a-498d-a744-bd5f70bd6635 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:20:37.558110 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-348bd02a-3c2a-498d-a744-bd5f70bd6635 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040803 Nov 09 20:20:37.558649 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 724/1420] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:20:37 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:20:38.569473 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-9a8978c5-f8d4-4a30-9708-fb3f6144a224 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:20:38.570345 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-9a8978c5-f8d4-4a30-9708-fb3f6144a224 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:20:38.576525 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9a8978c5-f8d4-4a30-9708-fb3f6144a224 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:20:38.576972 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9a8978c5-f8d4-4a30-9708-fb3f6144a224 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:20:38.577741 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9a8978c5-f8d4-4a30-9708-fb3f6144a224 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:20:38.578170 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9a8978c5-f8d4-4a30-9708-fb3f6144a224 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:20:38.606279 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-9a8978c5-f8d4-4a30-9708-fb3f6144a224 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041154 Nov 09 20:20:38.606816 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 697/1421] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:20:38 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:20:39.617742 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-6480bb6f-ba2f-46b8-9dc8-de4c86af7b5c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:20:39.618642 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-6480bb6f-ba2f-46b8-9dc8-de4c86af7b5c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:20:39.624826 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6480bb6f-ba2f-46b8-9dc8-de4c86af7b5c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:20:39.625283 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6480bb6f-ba2f-46b8-9dc8-de4c86af7b5c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:20:39.626055 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6480bb6f-ba2f-46b8-9dc8-de4c86af7b5c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:20:39.626491 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6480bb6f-ba2f-46b8-9dc8-de4c86af7b5c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:20:39.655198 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-6480bb6f-ba2f-46b8-9dc8-de4c86af7b5c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041386 Nov 09 20:20:39.655791 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 725/1422] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:20:39 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:20:40.667303 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-ffeacb95-9d38-47ee-be58-daf120d1eecf tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:20:40.668213 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-ffeacb95-9d38-47ee-be58-daf120d1eecf tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:20:40.674469 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ffeacb95-9d38-47ee-be58-daf120d1eecf tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:20:40.674914 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ffeacb95-9d38-47ee-be58-daf120d1eecf tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:20:40.675681 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ffeacb95-9d38-47ee-be58-daf120d1eecf tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:20:40.676112 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ffeacb95-9d38-47ee-be58-daf120d1eecf tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:20:40.704567 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-ffeacb95-9d38-47ee-be58-daf120d1eecf tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041023 Nov 09 20:20:40.705111 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 698/1423] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:20:40 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:20:41.714916 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-3283f88e-b54e-4950-b0b2-0b35a492a4c6 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:20:41.715813 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-3283f88e-b54e-4950-b0b2-0b35a492a4c6 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:20:41.722095 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-3283f88e-b54e-4950-b0b2-0b35a492a4c6 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:20:41.722535 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-3283f88e-b54e-4950-b0b2-0b35a492a4c6 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:20:41.723300 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-3283f88e-b54e-4950-b0b2-0b35a492a4c6 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:20:41.723727 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-3283f88e-b54e-4950-b0b2-0b35a492a4c6 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:20:41.752754 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-3283f88e-b54e-4950-b0b2-0b35a492a4c6 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041537 Nov 09 20:20:41.753288 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 726/1424] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:20:41 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:20:42.764185 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-110eb902-f735-4791-9965-c1fb7301ca98 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:20:42.765124 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-110eb902-f735-4791-9965-c1fb7301ca98 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:20:42.771931 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-110eb902-f735-4791-9965-c1fb7301ca98 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:20:42.772425 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-110eb902-f735-4791-9965-c1fb7301ca98 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:20:42.773263 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-110eb902-f735-4791-9965-c1fb7301ca98 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:20:42.773696 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-110eb902-f735-4791-9965-c1fb7301ca98 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:20:42.802096 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-110eb902-f735-4791-9965-c1fb7301ca98 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041592 Nov 09 20:20:42.802580 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 699/1425] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:20:42 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:20:43.812556 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-8ec544ae-73e5-4714-b1d6-40c73cff3683 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:20:43.813382 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-8ec544ae-73e5-4714-b1d6-40c73cff3683 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:20:43.820276 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-8ec544ae-73e5-4714-b1d6-40c73cff3683 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:20:43.820756 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-8ec544ae-73e5-4714-b1d6-40c73cff3683 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:20:43.821527 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-8ec544ae-73e5-4714-b1d6-40c73cff3683 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:20:43.821954 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-8ec544ae-73e5-4714-b1d6-40c73cff3683 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:20:43.850323 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-8ec544ae-73e5-4714-b1d6-40c73cff3683 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041546 Nov 09 20:20:43.850857 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 727/1426] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:20:43 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:20:44.862326 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-96661233-b0fd-4d06-ac8f-1320d13903cd tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:20:44.863315 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-96661233-b0fd-4d06-ac8f-1320d13903cd tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:20:44.870339 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-96661233-b0fd-4d06-ac8f-1320d13903cd tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:20:44.870812 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-96661233-b0fd-4d06-ac8f-1320d13903cd tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:20:44.871601 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-96661233-b0fd-4d06-ac8f-1320d13903cd tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:20:44.872034 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-96661233-b0fd-4d06-ac8f-1320d13903cd tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:20:44.905642 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-96661233-b0fd-4d06-ac8f-1320d13903cd tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047372 Nov 09 20:20:44.906233 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 700/1427] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:20:44 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:20:45.917969 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-52486df0-e318-4aea-926a-2c7e4f6b4ae2 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:20:45.918918 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-52486df0-e318-4aea-926a-2c7e4f6b4ae2 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:20:45.924776 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-52486df0-e318-4aea-926a-2c7e4f6b4ae2 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:20:45.925231 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-52486df0-e318-4aea-926a-2c7e4f6b4ae2 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:20:45.926006 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-52486df0-e318-4aea-926a-2c7e4f6b4ae2 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:20:45.926441 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-52486df0-e318-4aea-926a-2c7e4f6b4ae2 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:20:45.955021 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-52486df0-e318-4aea-926a-2c7e4f6b4ae2 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041265 Nov 09 20:20:45.955573 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 728/1428] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:20:45 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 20:20:46.966919 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-f50ff06e-653b-4170-91ae-b9790ec5f199 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:20:46.967742 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-f50ff06e-653b-4170-91ae-b9790ec5f199 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:20:46.973924 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f50ff06e-653b-4170-91ae-b9790ec5f199 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:20:46.975045 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f50ff06e-653b-4170-91ae-b9790ec5f199 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:20:46.975816 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f50ff06e-653b-4170-91ae-b9790ec5f199 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:20:46.976242 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f50ff06e-653b-4170-91ae-b9790ec5f199 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:20:47.004838 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-f50ff06e-653b-4170-91ae-b9790ec5f199 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041673 Nov 09 20:20:47.005393 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 701/1429] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:20:46 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:20:48.015853 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-27cd0840-e335-4899-b6f5-2c057c96fbe0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:20:48.016703 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-27cd0840-e335-4899-b6f5-2c057c96fbe0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:20:48.022972 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-27cd0840-e335-4899-b6f5-2c057c96fbe0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:20:48.023409 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-27cd0840-e335-4899-b6f5-2c057c96fbe0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:20:48.024173 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-27cd0840-e335-4899-b6f5-2c057c96fbe0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:20:48.024634 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-27cd0840-e335-4899-b6f5-2c057c96fbe0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:20:48.054788 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-27cd0840-e335-4899-b6f5-2c057c96fbe0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042999 Nov 09 20:20:48.055341 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 729/1430] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:20:48 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:20:49.066170 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-cd1e82eb-cc83-44ef-af01-21a53fcec28d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:20:49.067022 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-cd1e82eb-cc83-44ef-af01-21a53fcec28d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:20:49.073788 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cd1e82eb-cc83-44ef-af01-21a53fcec28d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:20:49.074230 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cd1e82eb-cc83-44ef-af01-21a53fcec28d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:20:49.074998 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cd1e82eb-cc83-44ef-af01-21a53fcec28d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:20:49.075425 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cd1e82eb-cc83-44ef-af01-21a53fcec28d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:20:49.104170 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-cd1e82eb-cc83-44ef-af01-21a53fcec28d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041845 Nov 09 20:20:49.104749 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 702/1431] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:20:49 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:20:50.116291 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-4f01ce61-ed48-4b66-97da-99de21b0acc6 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:20:50.117217 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-4f01ce61-ed48-4b66-97da-99de21b0acc6 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:20:50.123333 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-4f01ce61-ed48-4b66-97da-99de21b0acc6 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:20:50.123776 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-4f01ce61-ed48-4b66-97da-99de21b0acc6 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:20:50.124564 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-4f01ce61-ed48-4b66-97da-99de21b0acc6 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:20:50.124993 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-4f01ce61-ed48-4b66-97da-99de21b0acc6 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:20:50.153049 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-4f01ce61-ed48-4b66-97da-99de21b0acc6 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041476 Nov 09 20:20:50.153601 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 730/1432] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:20:50 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:20:51.164276 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-1bfc67e6-e646-4f18-9855-4c2491f458ab tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:20:51.165299 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-1bfc67e6-e646-4f18-9855-4c2491f458ab tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:20:51.171598 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1bfc67e6-e646-4f18-9855-4c2491f458ab tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:20:51.172049 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1bfc67e6-e646-4f18-9855-4c2491f458ab tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:20:51.172857 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1bfc67e6-e646-4f18-9855-4c2491f458ab tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:20:51.173294 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1bfc67e6-e646-4f18-9855-4c2491f458ab tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:20:51.201754 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-1bfc67e6-e646-4f18-9855-4c2491f458ab tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041221 Nov 09 20:20:51.202299 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 703/1433] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:20:51 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:20:52.214084 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-f16c742a-39e9-467e-bc5f-42d7f241cfb9 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:20:52.215023 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-f16c742a-39e9-467e-bc5f-42d7f241cfb9 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:20:52.221286 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f16c742a-39e9-467e-bc5f-42d7f241cfb9 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:20:52.221732 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f16c742a-39e9-467e-bc5f-42d7f241cfb9 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:20:52.222516 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f16c742a-39e9-467e-bc5f-42d7f241cfb9 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:20:52.222947 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f16c742a-39e9-467e-bc5f-42d7f241cfb9 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:20:52.253153 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-f16c742a-39e9-467e-bc5f-42d7f241cfb9 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042840 Nov 09 20:20:52.253705 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 731/1434] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:20:52 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:20:53.264623 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-272a5661-5e0b-4642-b6e7-10251df1aa0d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:20:53.265448 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-272a5661-5e0b-4642-b6e7-10251df1aa0d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:20:53.272117 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-272a5661-5e0b-4642-b6e7-10251df1aa0d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:20:53.272609 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-272a5661-5e0b-4642-b6e7-10251df1aa0d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:20:53.273379 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-272a5661-5e0b-4642-b6e7-10251df1aa0d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:20:53.273807 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-272a5661-5e0b-4642-b6e7-10251df1aa0d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:20:53.303987 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-272a5661-5e0b-4642-b6e7-10251df1aa0d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043175 Nov 09 20:20:53.304564 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 704/1435] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:20:53 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:20:54.315186 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-336da6e6-e353-4415-9878-7c7de14e8e8d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:20:54.316084 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-336da6e6-e353-4415-9878-7c7de14e8e8d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:20:54.322897 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-336da6e6-e353-4415-9878-7c7de14e8e8d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:20:54.323335 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-336da6e6-e353-4415-9878-7c7de14e8e8d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:20:54.324096 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-336da6e6-e353-4415-9878-7c7de14e8e8d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:20:54.324552 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-336da6e6-e353-4415-9878-7c7de14e8e8d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:20:54.352862 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-336da6e6-e353-4415-9878-7c7de14e8e8d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041408 Nov 09 20:20:54.353404 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 732/1436] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:20:54 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:20:55.364140 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-bb173c44-7880-4874-9108-d151606f792a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:20:55.365188 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-bb173c44-7880-4874-9108-d151606f792a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:20:55.371387 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bb173c44-7880-4874-9108-d151606f792a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:20:55.371827 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bb173c44-7880-4874-9108-d151606f792a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:20:55.372633 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bb173c44-7880-4874-9108-d151606f792a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:20:55.373064 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bb173c44-7880-4874-9108-d151606f792a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:20:55.401825 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-bb173c44-7880-4874-9108-d151606f792a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041720 Nov 09 20:20:55.402368 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 705/1437] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:20:55 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:20:56.412984 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-768111f1-0346-443a-930e-ef8f54104cf6 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:20:56.413887 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-768111f1-0346-443a-930e-ef8f54104cf6 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:20:56.420725 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-768111f1-0346-443a-930e-ef8f54104cf6 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:20:56.421173 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-768111f1-0346-443a-930e-ef8f54104cf6 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:20:56.422005 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-768111f1-0346-443a-930e-ef8f54104cf6 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:20:56.422435 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-768111f1-0346-443a-930e-ef8f54104cf6 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:20:56.451492 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-768111f1-0346-443a-930e-ef8f54104cf6 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042117 Nov 09 20:20:56.451980 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 733/1438] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:20:56 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:20:57.462835 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-ed4f6f65-93ca-4139-87a5-b20ac304a15e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:20:57.463666 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-ed4f6f65-93ca-4139-87a5-b20ac304a15e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:20:57.469550 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ed4f6f65-93ca-4139-87a5-b20ac304a15e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:20:57.470000 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ed4f6f65-93ca-4139-87a5-b20ac304a15e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:20:57.470770 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ed4f6f65-93ca-4139-87a5-b20ac304a15e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:20:57.471202 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ed4f6f65-93ca-4139-87a5-b20ac304a15e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:20:57.499439 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-ed4f6f65-93ca-4139-87a5-b20ac304a15e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040569 Nov 09 20:20:57.499980 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 706/1439] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:20:57 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:20:58.510606 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-80176abd-9dae-4788-8258-56e860eb34dd tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:20:58.511553 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-80176abd-9dae-4788-8258-56e860eb34dd tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:20:58.517843 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-80176abd-9dae-4788-8258-56e860eb34dd tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:20:58.518293 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-80176abd-9dae-4788-8258-56e860eb34dd tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:20:58.519074 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-80176abd-9dae-4788-8258-56e860eb34dd tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:20:58.519510 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-80176abd-9dae-4788-8258-56e860eb34dd tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:20:58.548289 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-80176abd-9dae-4788-8258-56e860eb34dd tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041399 Nov 09 20:20:58.548943 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 734/1440] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:20:58 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:20:59.559303 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-578f954e-7e25-40eb-93e3-6cba2b94f66a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:20:59.560203 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-578f954e-7e25-40eb-93e3-6cba2b94f66a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:20:59.567852 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-578f954e-7e25-40eb-93e3-6cba2b94f66a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:20:59.568617 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-578f954e-7e25-40eb-93e3-6cba2b94f66a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:20:59.569857 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-578f954e-7e25-40eb-93e3-6cba2b94f66a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:20:59.571048 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-578f954e-7e25-40eb-93e3-6cba2b94f66a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:20:59.598891 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-578f954e-7e25-40eb-93e3-6cba2b94f66a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043808 Nov 09 20:20:59.599443 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 707/1441] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:20:59 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:21:00.610057 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-800321e2-67d2-4ee4-b5e1-20c8cda318e2 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:21:00.610999 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-800321e2-67d2-4ee4-b5e1-20c8cda318e2 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:21:00.617682 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-800321e2-67d2-4ee4-b5e1-20c8cda318e2 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:21:00.618477 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-800321e2-67d2-4ee4-b5e1-20c8cda318e2 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:21:00.619501 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-800321e2-67d2-4ee4-b5e1-20c8cda318e2 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:21:00.619941 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-800321e2-67d2-4ee4-b5e1-20c8cda318e2 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:21:00.649240 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-800321e2-67d2-4ee4-b5e1-20c8cda318e2 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042118 Nov 09 20:21:00.650097 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 735/1442] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:21:00 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:21:01.660710 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-f2959148-967d-4794-8e14-e65580d78129 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:21:01.661611 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-f2959148-967d-4794-8e14-e65580d78129 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:21:01.668423 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f2959148-967d-4794-8e14-e65580d78129 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:21:01.668880 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f2959148-967d-4794-8e14-e65580d78129 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:21:01.669647 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f2959148-967d-4794-8e14-e65580d78129 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:21:01.670064 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f2959148-967d-4794-8e14-e65580d78129 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:21:01.698063 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-f2959148-967d-4794-8e14-e65580d78129 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041218 Nov 09 20:21:01.698598 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 708/1443] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:21:01 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:21:02.709098 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-f98f1a2e-1e08-431e-b630-2ab10a44e422 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:21:02.709999 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-f98f1a2e-1e08-431e-b630-2ab10a44e422 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:21:02.716352 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f98f1a2e-1e08-431e-b630-2ab10a44e422 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:21:02.716828 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f98f1a2e-1e08-431e-b630-2ab10a44e422 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:21:02.717641 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f98f1a2e-1e08-431e-b630-2ab10a44e422 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:21:02.718078 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f98f1a2e-1e08-431e-b630-2ab10a44e422 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:21:02.747583 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-f98f1a2e-1e08-431e-b630-2ab10a44e422 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042278 Nov 09 20:21:02.748139 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 736/1444] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:21:02 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:21:03.759452 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-66477e39-7a67-4bbf-b02d-d577eac4d5b1 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:21:03.760276 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-66477e39-7a67-4bbf-b02d-d577eac4d5b1 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:21:03.766548 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-66477e39-7a67-4bbf-b02d-d577eac4d5b1 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:21:03.767069 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-66477e39-7a67-4bbf-b02d-d577eac4d5b1 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:21:03.767878 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-66477e39-7a67-4bbf-b02d-d577eac4d5b1 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:21:03.768310 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-66477e39-7a67-4bbf-b02d-d577eac4d5b1 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:21:03.796616 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-66477e39-7a67-4bbf-b02d-d577eac4d5b1 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041479 Nov 09 20:21:03.797160 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 709/1445] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:21:03 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:21:04.807498 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-a43d2377-013a-4712-8f21-8c44bdb94af7 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:21:04.808325 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-a43d2377-013a-4712-8f21-8c44bdb94af7 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:21:04.814845 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a43d2377-013a-4712-8f21-8c44bdb94af7 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:21:04.815299 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a43d2377-013a-4712-8f21-8c44bdb94af7 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:21:04.816113 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a43d2377-013a-4712-8f21-8c44bdb94af7 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:21:04.816646 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a43d2377-013a-4712-8f21-8c44bdb94af7 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:21:04.847081 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-a43d2377-013a-4712-8f21-8c44bdb94af7 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043720 Nov 09 20:21:04.847630 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 737/1446] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:21:04 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:21:05.858343 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-00e4053a-0f0d-48ce-b37f-059bed049a39 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:21:05.859232 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-00e4053a-0f0d-48ce-b37f-059bed049a39 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:21:05.865703 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-00e4053a-0f0d-48ce-b37f-059bed049a39 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:21:05.866145 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-00e4053a-0f0d-48ce-b37f-059bed049a39 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:21:05.866910 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-00e4053a-0f0d-48ce-b37f-059bed049a39 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:21:05.868053 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-00e4053a-0f0d-48ce-b37f-059bed049a39 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:21:05.895787 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-00e4053a-0f0d-48ce-b37f-059bed049a39 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041122 Nov 09 20:21:05.896329 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 710/1447] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:21:05 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:21:06.907177 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-1fef6796-e66e-43d4-b916-b953d19b8a59 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:21:06.908074 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-1fef6796-e66e-43d4-b916-b953d19b8a59 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:21:06.913861 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-1fef6796-e66e-43d4-b916-b953d19b8a59 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:21:06.914300 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-1fef6796-e66e-43d4-b916-b953d19b8a59 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:21:06.915065 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-1fef6796-e66e-43d4-b916-b953d19b8a59 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:21:06.916128 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-1fef6796-e66e-43d4-b916-b953d19b8a59 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:21:06.944197 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-1fef6796-e66e-43d4-b916-b953d19b8a59 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040827 Nov 09 20:21:06.944915 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 738/1448] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:21:06 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:21:07.954897 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-d63923c9-26ad-4658-8454-64f0bcbf8e58 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:21:07.955948 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-d63923c9-26ad-4658-8454-64f0bcbf8e58 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:21:07.962207 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d63923c9-26ad-4658-8454-64f0bcbf8e58 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:21:07.962749 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d63923c9-26ad-4658-8454-64f0bcbf8e58 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:21:07.963515 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d63923c9-26ad-4658-8454-64f0bcbf8e58 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:21:07.963937 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d63923c9-26ad-4658-8454-64f0bcbf8e58 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:21:07.991481 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-d63923c9-26ad-4658-8454-64f0bcbf8e58 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040411 Nov 09 20:21:07.992007 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 711/1449] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:21:07 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:21:09.002902 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-9d9c7aab-ce45-4243-9bac-406ba45ab616 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:21:09.003877 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-9d9c7aab-ce45-4243-9bac-406ba45ab616 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:21:09.010650 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-9d9c7aab-ce45-4243-9bac-406ba45ab616 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:21:09.011094 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-9d9c7aab-ce45-4243-9bac-406ba45ab616 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:21:09.011869 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-9d9c7aab-ce45-4243-9bac-406ba45ab616 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:21:09.012306 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-9d9c7aab-ce45-4243-9bac-406ba45ab616 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:21:09.041077 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-9d9c7aab-ce45-4243-9bac-406ba45ab616 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041816 Nov 09 20:21:09.041617 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 739/1450] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:21:08 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:21:10.052161 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-4a091098-2935-4683-8828-24d49003be68 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:21:10.053090 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-4a091098-2935-4683-8828-24d49003be68 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:21:10.059270 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4a091098-2935-4683-8828-24d49003be68 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:21:10.059711 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4a091098-2935-4683-8828-24d49003be68 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:21:10.060529 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4a091098-2935-4683-8828-24d49003be68 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:21:10.060954 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4a091098-2935-4683-8828-24d49003be68 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:21:10.088641 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-4a091098-2935-4683-8828-24d49003be68 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040157 Nov 09 20:21:10.089173 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 712/1451] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:21:10 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:21:11.100166 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-06f9ae3e-8a16-4794-85e6-e89d6794aff5 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:21:11.101384 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-06f9ae3e-8a16-4794-85e6-e89d6794aff5 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:21:11.110267 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-06f9ae3e-8a16-4794-85e6-e89d6794aff5 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:21:11.110927 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-06f9ae3e-8a16-4794-85e6-e89d6794aff5 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:21:11.112171 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-06f9ae3e-8a16-4794-85e6-e89d6794aff5 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:21:11.112716 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-06f9ae3e-8a16-4794-85e6-e89d6794aff5 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:21:11.143139 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-06f9ae3e-8a16-4794-85e6-e89d6794aff5 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047818 Nov 09 20:21:11.143693 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 740/1452] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:21:11 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:21:12.154871 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-3d306614-7e49-407a-b2fe-2ccda078935f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:21:12.155776 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-3d306614-7e49-407a-b2fe-2ccda078935f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:21:12.161928 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3d306614-7e49-407a-b2fe-2ccda078935f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:21:12.162371 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3d306614-7e49-407a-b2fe-2ccda078935f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:21:12.163138 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3d306614-7e49-407a-b2fe-2ccda078935f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:21:12.163566 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3d306614-7e49-407a-b2fe-2ccda078935f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:21:12.193213 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-3d306614-7e49-407a-b2fe-2ccda078935f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042079 Nov 09 20:21:12.193752 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 713/1453] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:21:12 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:21:13.205608 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-a3cc0041-7748-432a-9677-ea4192bf297a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:21:13.206451 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-a3cc0041-7748-432a-9677-ea4192bf297a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:21:13.213246 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a3cc0041-7748-432a-9677-ea4192bf297a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:21:13.213693 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a3cc0041-7748-432a-9677-ea4192bf297a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:21:13.214454 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a3cc0041-7748-432a-9677-ea4192bf297a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:21:13.214878 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a3cc0041-7748-432a-9677-ea4192bf297a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:21:13.242942 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-a3cc0041-7748-432a-9677-ea4192bf297a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041241 Nov 09 20:21:13.243672 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 741/1454] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:21:13 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:21:14.254344 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-1158f4a2-e93e-429d-bde3-11104ba1a99d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:21:14.255265 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-1158f4a2-e93e-429d-bde3-11104ba1a99d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:21:14.261836 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1158f4a2-e93e-429d-bde3-11104ba1a99d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:21:14.262278 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1158f4a2-e93e-429d-bde3-11104ba1a99d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:21:14.263048 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1158f4a2-e93e-429d-bde3-11104ba1a99d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:21:14.263476 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1158f4a2-e93e-429d-bde3-11104ba1a99d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:21:14.292223 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-1158f4a2-e93e-429d-bde3-11104ba1a99d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041749 Nov 09 20:21:14.292801 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 714/1455] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:21:14 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 20:21:15.302961 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-f77c7194-ac7d-4760-9cfd-d5205e2f36a0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:21:15.303869 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-f77c7194-ac7d-4760-9cfd-d5205e2f36a0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:21:15.310402 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f77c7194-ac7d-4760-9cfd-d5205e2f36a0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:21:15.310850 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f77c7194-ac7d-4760-9cfd-d5205e2f36a0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:21:15.311618 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f77c7194-ac7d-4760-9cfd-d5205e2f36a0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:21:15.312054 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f77c7194-ac7d-4760-9cfd-d5205e2f36a0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:21:15.340466 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-f77c7194-ac7d-4760-9cfd-d5205e2f36a0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041317 Nov 09 20:21:15.341005 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 742/1456] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:21:15 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:21:16.350737 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-81ece398-7708-476b-af6a-f96fa28ec2ce tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:21:16.351630 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-81ece398-7708-476b-af6a-f96fa28ec2ce tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:21:16.357815 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-81ece398-7708-476b-af6a-f96fa28ec2ce tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:21:16.358324 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-81ece398-7708-476b-af6a-f96fa28ec2ce tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:21:16.359076 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-81ece398-7708-476b-af6a-f96fa28ec2ce tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:21:16.359497 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-81ece398-7708-476b-af6a-f96fa28ec2ce tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:21:16.387694 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-81ece398-7708-476b-af6a-f96fa28ec2ce tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040648 Nov 09 20:21:16.388226 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 715/1457] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:21:16 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:21:17.398044 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-6ab0680b-387b-4e21-a232-3817419b8e82 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:21:17.398879 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-6ab0680b-387b-4e21-a232-3817419b8e82 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:21:17.405718 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6ab0680b-387b-4e21-a232-3817419b8e82 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:21:17.406158 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6ab0680b-387b-4e21-a232-3817419b8e82 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:21:17.406929 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6ab0680b-387b-4e21-a232-3817419b8e82 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:21:17.407352 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6ab0680b-387b-4e21-a232-3817419b8e82 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:21:17.435836 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-6ab0680b-387b-4e21-a232-3817419b8e82 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041556 Nov 09 20:21:17.436362 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 743/1458] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:21:17 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:21:18.447652 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-4154f624-90fa-4d4e-bc7b-7ce05ad2a49b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:21:18.448536 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-4154f624-90fa-4d4e-bc7b-7ce05ad2a49b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:21:18.454743 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4154f624-90fa-4d4e-bc7b-7ce05ad2a49b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:21:18.455188 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4154f624-90fa-4d4e-bc7b-7ce05ad2a49b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:21:18.455953 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4154f624-90fa-4d4e-bc7b-7ce05ad2a49b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:21:18.456381 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4154f624-90fa-4d4e-bc7b-7ce05ad2a49b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:21:18.483859 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-4154f624-90fa-4d4e-bc7b-7ce05ad2a49b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040622 Nov 09 20:21:18.484416 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 716/1459] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:21:18 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:21:19.498488 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-ce75bef1-51cb-4ddb-9b93-68bdb1c7b56d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:21:19.499319 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-ce75bef1-51cb-4ddb-9b93-68bdb1c7b56d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:21:19.505517 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ce75bef1-51cb-4ddb-9b93-68bdb1c7b56d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:21:19.505972 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ce75bef1-51cb-4ddb-9b93-68bdb1c7b56d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:21:19.506743 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ce75bef1-51cb-4ddb-9b93-68bdb1c7b56d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:21:19.507171 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ce75bef1-51cb-4ddb-9b93-68bdb1c7b56d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:21:19.536832 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-ce75bef1-51cb-4ddb-9b93-68bdb1c7b56d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042063 Nov 09 20:21:19.537375 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 744/1460] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:21:19 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:21:20.548358 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-2f06b589-c2a3-451c-bc9c-fb74c3b13cbf tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:21:20.549264 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-2f06b589-c2a3-451c-bc9c-fb74c3b13cbf tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:21:20.555414 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2f06b589-c2a3-451c-bc9c-fb74c3b13cbf tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:21:20.555864 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2f06b589-c2a3-451c-bc9c-fb74c3b13cbf tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:21:20.556651 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2f06b589-c2a3-451c-bc9c-fb74c3b13cbf tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:21:20.557656 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2f06b589-c2a3-451c-bc9c-fb74c3b13cbf tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:21:20.586007 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-2f06b589-c2a3-451c-bc9c-fb74c3b13cbf tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041458 Nov 09 20:21:20.586540 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 717/1461] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:21:20 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:21:21.596685 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-c6469e63-1762-45a8-8a2d-2d82e5a8d39b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:21:21.597596 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-c6469e63-1762-45a8-8a2d-2d82e5a8d39b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:21:21.603727 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c6469e63-1762-45a8-8a2d-2d82e5a8d39b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:21:21.604437 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c6469e63-1762-45a8-8a2d-2d82e5a8d39b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:21:21.605298 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c6469e63-1762-45a8-8a2d-2d82e5a8d39b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:21:21.605736 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c6469e63-1762-45a8-8a2d-2d82e5a8d39b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:21:21.633966 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-c6469e63-1762-45a8-8a2d-2d82e5a8d39b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040965 Nov 09 20:21:21.634510 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 745/1462] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:21:21 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:21:22.645734 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-4c12b73f-a2fb-4049-a9da-8b9d6778a1b9 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:21:22.646640 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-4c12b73f-a2fb-4049-a9da-8b9d6778a1b9 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:21:22.652815 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4c12b73f-a2fb-4049-a9da-8b9d6778a1b9 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:21:22.653258 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4c12b73f-a2fb-4049-a9da-8b9d6778a1b9 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:21:22.654022 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4c12b73f-a2fb-4049-a9da-8b9d6778a1b9 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:21:22.654448 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4c12b73f-a2fb-4049-a9da-8b9d6778a1b9 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:21:22.681818 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-4c12b73f-a2fb-4049-a9da-8b9d6778a1b9 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039778 Nov 09 20:21:22.682995 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 718/1463] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:21:22 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:21:23.693736 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-d7e98d81-adf4-4e51-9515-3251ab72cd1d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:21:23.694555 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-d7e98d81-adf4-4e51-9515-3251ab72cd1d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:21:23.701147 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d7e98d81-adf4-4e51-9515-3251ab72cd1d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:21:23.701587 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d7e98d81-adf4-4e51-9515-3251ab72cd1d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:21:23.702356 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d7e98d81-adf4-4e51-9515-3251ab72cd1d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:21:23.702785 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d7e98d81-adf4-4e51-9515-3251ab72cd1d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:21:23.732164 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-d7e98d81-adf4-4e51-9515-3251ab72cd1d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042266 Nov 09 20:21:23.732811 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 746/1464] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:21:23 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:21:24.743054 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-5c1fbe03-ddeb-4c75-aac4-0fd32ec678ba tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:21:24.743895 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-5c1fbe03-ddeb-4c75-aac4-0fd32ec678ba tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:21:24.750136 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5c1fbe03-ddeb-4c75-aac4-0fd32ec678ba tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:21:24.750574 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5c1fbe03-ddeb-4c75-aac4-0fd32ec678ba tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:21:24.751336 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5c1fbe03-ddeb-4c75-aac4-0fd32ec678ba tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:21:24.751764 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5c1fbe03-ddeb-4c75-aac4-0fd32ec678ba tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:21:24.780274 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-5c1fbe03-ddeb-4c75-aac4-0fd32ec678ba tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040958 Nov 09 20:21:24.780840 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 719/1465] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:21:24 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:21:25.791250 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-08efeea3-eb12-4447-a17d-7793145ffe28 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:21:25.792688 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-08efeea3-eb12-4447-a17d-7793145ffe28 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:21:25.799024 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-08efeea3-eb12-4447-a17d-7793145ffe28 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:21:25.799462 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-08efeea3-eb12-4447-a17d-7793145ffe28 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:21:25.800217 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-08efeea3-eb12-4447-a17d-7793145ffe28 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:21:25.800664 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-08efeea3-eb12-4447-a17d-7793145ffe28 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:21:25.828318 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-08efeea3-eb12-4447-a17d-7793145ffe28 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040848 Nov 09 20:21:25.828896 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 747/1466] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:21:25 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:21:26.839751 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-1c44de7d-ca37-4e67-8983-07a83834377c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:21:26.840632 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-1c44de7d-ca37-4e67-8983-07a83834377c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:21:26.846451 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1c44de7d-ca37-4e67-8983-07a83834377c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:21:26.846897 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1c44de7d-ca37-4e67-8983-07a83834377c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:21:26.847695 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1c44de7d-ca37-4e67-8983-07a83834377c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:21:26.848128 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1c44de7d-ca37-4e67-8983-07a83834377c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:21:26.877794 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-1c44de7d-ca37-4e67-8983-07a83834377c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042171 Nov 09 20:21:26.878357 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 720/1467] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:21:26 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:21:27.529123 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 09 20:21:27.529372 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: Tue Nov 9 20:21:27 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 09 20:21:27.889738 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-5005146a-07db-4620-98cc-4aa71f88b4c3 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:21:27.890636 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-5005146a-07db-4620-98cc-4aa71f88b4c3 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:21:27.896884 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-5005146a-07db-4620-98cc-4aa71f88b4c3 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:21:27.897272 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-5005146a-07db-4620-98cc-4aa71f88b4c3 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:21:27.898036 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-5005146a-07db-4620-98cc-4aa71f88b4c3 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:21:27.898469 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-5005146a-07db-4620-98cc-4aa71f88b4c3 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:21:27.926379 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-5005146a-07db-4620-98cc-4aa71f88b4c3 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041109 Nov 09 20:21:27.926967 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 748/1468] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:21:27 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:21:28.936861 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-6bf64e70-061f-4ae4-afa6-d02c7067d213 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:21:28.937779 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-6bf64e70-061f-4ae4-afa6-d02c7067d213 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:21:28.943983 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6bf64e70-061f-4ae4-afa6-d02c7067d213 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:21:28.944373 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6bf64e70-061f-4ae4-afa6-d02c7067d213 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:21:28.945168 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6bf64e70-061f-4ae4-afa6-d02c7067d213 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:21:28.945601 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6bf64e70-061f-4ae4-afa6-d02c7067d213 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:21:28.974364 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-6bf64e70-061f-4ae4-afa6-d02c7067d213 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041204 Nov 09 20:21:28.974904 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 721/1469] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:21:28 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:21:29.985769 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-e6a038bf-c531-4981-b223-7ec10e98614f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:21:29.986678 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-e6a038bf-c531-4981-b223-7ec10e98614f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:21:29.993304 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e6a038bf-c531-4981-b223-7ec10e98614f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:21:29.993744 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e6a038bf-c531-4981-b223-7ec10e98614f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:21:29.995159 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e6a038bf-c531-4981-b223-7ec10e98614f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:21:29.995583 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e6a038bf-c531-4981-b223-7ec10e98614f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:21:30.023177 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-e6a038bf-c531-4981-b223-7ec10e98614f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041103 Nov 09 20:21:30.023655 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 749/1470] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:21:29 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:21:31.034676 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-00290fde-4c08-401a-b03b-22e922387ae1 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:21:31.035571 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-00290fde-4c08-401a-b03b-22e922387ae1 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:21:31.041983 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-00290fde-4c08-401a-b03b-22e922387ae1 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:21:31.042425 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-00290fde-4c08-401a-b03b-22e922387ae1 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:21:31.043181 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-00290fde-4c08-401a-b03b-22e922387ae1 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:21:31.043604 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-00290fde-4c08-401a-b03b-22e922387ae1 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:21:31.071625 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-00290fde-4c08-401a-b03b-22e922387ae1 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040649 Nov 09 20:21:31.072093 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 722/1471] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:21:31 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:21:32.083327 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-773345be-c117-498b-af19-33fb6e583da5 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:21:32.084213 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-773345be-c117-498b-af19-33fb6e583da5 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:21:32.091014 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-773345be-c117-498b-af19-33fb6e583da5 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:21:32.091456 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-773345be-c117-498b-af19-33fb6e583da5 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:21:32.092216 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-773345be-c117-498b-af19-33fb6e583da5 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:21:32.092672 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-773345be-c117-498b-af19-33fb6e583da5 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:21:32.120473 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-773345be-c117-498b-af19-33fb6e583da5 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040920 Nov 09 20:21:32.121016 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 750/1472] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:21:32 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:21:33.131736 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-d8484cc9-db23-459d-bef0-454a3a49c145 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:21:33.132672 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-d8484cc9-db23-459d-bef0-454a3a49c145 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:21:33.139058 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d8484cc9-db23-459d-bef0-454a3a49c145 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:21:33.139502 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d8484cc9-db23-459d-bef0-454a3a49c145 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:21:33.140269 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d8484cc9-db23-459d-bef0-454a3a49c145 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:21:33.140807 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d8484cc9-db23-459d-bef0-454a3a49c145 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:21:33.169999 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-d8484cc9-db23-459d-bef0-454a3a49c145 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041910 Nov 09 20:21:33.170514 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 723/1473] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:21:33 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:21:34.181309 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-c4144690-a52c-48ab-ad5b-c560010d1a2f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:21:34.182883 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-c4144690-a52c-48ab-ad5b-c560010d1a2f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:21:34.189257 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c4144690-a52c-48ab-ad5b-c560010d1a2f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:21:34.189705 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c4144690-a52c-48ab-ad5b-c560010d1a2f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:21:34.190526 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c4144690-a52c-48ab-ad5b-c560010d1a2f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:21:34.190907 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c4144690-a52c-48ab-ad5b-c560010d1a2f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:21:34.219697 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-c4144690-a52c-48ab-ad5b-c560010d1a2f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042109 Nov 09 20:21:34.220235 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 751/1474] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:21:34 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:21:35.231008 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-6086d857-4fe4-4367-8cfe-7d54b1f163ed tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:21:35.231934 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-6086d857-4fe4-4367-8cfe-7d54b1f163ed tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:21:35.238366 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6086d857-4fe4-4367-8cfe-7d54b1f163ed tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:21:35.238810 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6086d857-4fe4-4367-8cfe-7d54b1f163ed tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:21:35.239566 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6086d857-4fe4-4367-8cfe-7d54b1f163ed tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:21:35.239992 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6086d857-4fe4-4367-8cfe-7d54b1f163ed tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:21:35.268366 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-6086d857-4fe4-4367-8cfe-7d54b1f163ed tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041185 Nov 09 20:21:35.268857 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 724/1475] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:21:35 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:21:36.279550 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-95463e40-2abc-44c7-8055-cb8448592cab tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:21:36.280385 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-95463e40-2abc-44c7-8055-cb8448592cab tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:21:36.286633 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-95463e40-2abc-44c7-8055-cb8448592cab tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:21:36.287076 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-95463e40-2abc-44c7-8055-cb8448592cab tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:21:36.287853 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-95463e40-2abc-44c7-8055-cb8448592cab tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:21:36.288286 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-95463e40-2abc-44c7-8055-cb8448592cab tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:21:36.316619 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-95463e40-2abc-44c7-8055-cb8448592cab tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041445 Nov 09 20:21:36.317167 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 752/1476] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:21:36 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:21:37.328163 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-1f4a6038-fb02-4c2f-a88e-c66b0caf85ef tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:21:37.329098 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-1f4a6038-fb02-4c2f-a88e-c66b0caf85ef tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:21:37.335251 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1f4a6038-fb02-4c2f-a88e-c66b0caf85ef tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:21:37.335687 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1f4a6038-fb02-4c2f-a88e-c66b0caf85ef tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:21:37.336467 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1f4a6038-fb02-4c2f-a88e-c66b0caf85ef tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:21:37.336893 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1f4a6038-fb02-4c2f-a88e-c66b0caf85ef tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:21:37.365361 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-1f4a6038-fb02-4c2f-a88e-c66b0caf85ef tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040890 Nov 09 20:21:37.365827 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 725/1477] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:21:37 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:21:38.376804 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-e9fb9f20-9a30-4e4e-bea9-55e8428d27b2 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:21:38.377752 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-e9fb9f20-9a30-4e4e-bea9-55e8428d27b2 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:21:38.383992 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e9fb9f20-9a30-4e4e-bea9-55e8428d27b2 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:21:38.384473 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e9fb9f20-9a30-4e4e-bea9-55e8428d27b2 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:21:38.385254 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e9fb9f20-9a30-4e4e-bea9-55e8428d27b2 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:21:38.385690 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e9fb9f20-9a30-4e4e-bea9-55e8428d27b2 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:21:38.413822 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-e9fb9f20-9a30-4e4e-bea9-55e8428d27b2 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040768 Nov 09 20:21:38.414358 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 753/1478] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:21:38 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:21:39.424740 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-94348631-2e4c-4741-a5f5-466ac65a212c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:21:39.425648 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-94348631-2e4c-4741-a5f5-466ac65a212c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:21:39.431882 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-94348631-2e4c-4741-a5f5-466ac65a212c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:21:39.432325 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-94348631-2e4c-4741-a5f5-466ac65a212c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:21:39.433122 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-94348631-2e4c-4741-a5f5-466ac65a212c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:21:39.434124 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-94348631-2e4c-4741-a5f5-466ac65a212c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:21:39.461694 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-94348631-2e4c-4741-a5f5-466ac65a212c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040598 Nov 09 20:21:39.462167 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 726/1479] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:21:39 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:21:40.473182 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-0b31ac07-bee1-4832-aea4-bbe8e84abc5d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:21:40.474119 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-0b31ac07-bee1-4832-aea4-bbe8e84abc5d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:21:40.480268 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-0b31ac07-bee1-4832-aea4-bbe8e84abc5d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:21:40.480818 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-0b31ac07-bee1-4832-aea4-bbe8e84abc5d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:21:40.481561 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-0b31ac07-bee1-4832-aea4-bbe8e84abc5d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:21:40.481995 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-0b31ac07-bee1-4832-aea4-bbe8e84abc5d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:21:40.510331 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-0b31ac07-bee1-4832-aea4-bbe8e84abc5d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040781 Nov 09 20:21:40.510806 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 754/1480] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:21:40 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:21:41.522087 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-6b2eece2-7117-410a-ae7c-06053d657bcf tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:21:41.523031 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-6b2eece2-7117-410a-ae7c-06053d657bcf tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:21:41.529973 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6b2eece2-7117-410a-ae7c-06053d657bcf tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:21:41.530423 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6b2eece2-7117-410a-ae7c-06053d657bcf tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:21:41.531198 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6b2eece2-7117-410a-ae7c-06053d657bcf tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:21:41.531633 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6b2eece2-7117-410a-ae7c-06053d657bcf tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:21:41.560559 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-6b2eece2-7117-410a-ae7c-06053d657bcf tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042082 Nov 09 20:21:41.561044 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 727/1481] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:21:41 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:21:42.570888 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-ec3d5687-06ed-4fd0-8ff6-65d851e3d710 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:21:42.571724 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-ec3d5687-06ed-4fd0-8ff6-65d851e3d710 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:21:42.578203 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ec3d5687-06ed-4fd0-8ff6-65d851e3d710 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:21:42.578646 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ec3d5687-06ed-4fd0-8ff6-65d851e3d710 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:21:42.579409 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ec3d5687-06ed-4fd0-8ff6-65d851e3d710 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:21:42.579835 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ec3d5687-06ed-4fd0-8ff6-65d851e3d710 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:21:42.607905 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-ec3d5687-06ed-4fd0-8ff6-65d851e3d710 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040786 Nov 09 20:21:42.608456 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 755/1482] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:21:42 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:21:43.619056 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-03f5408f-98a6-40ef-b5ff-4f0921e692b4 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:21:43.619966 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-03f5408f-98a6-40ef-b5ff-4f0921e692b4 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:21:43.626965 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-03f5408f-98a6-40ef-b5ff-4f0921e692b4 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:21:43.627414 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-03f5408f-98a6-40ef-b5ff-4f0921e692b4 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:21:43.628171 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-03f5408f-98a6-40ef-b5ff-4f0921e692b4 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:21:43.628622 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-03f5408f-98a6-40ef-b5ff-4f0921e692b4 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:21:43.656504 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-03f5408f-98a6-40ef-b5ff-4f0921e692b4 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041155 Nov 09 20:21:43.657046 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 728/1483] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:21:43 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:21:44.667490 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-4640e61d-b652-4c95-ab03-9cd31ee911e6 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:21:44.669210 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-4640e61d-b652-4c95-ab03-9cd31ee911e6 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:21:44.675332 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-4640e61d-b652-4c95-ab03-9cd31ee911e6 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:21:44.675773 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-4640e61d-b652-4c95-ab03-9cd31ee911e6 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:21:44.676579 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-4640e61d-b652-4c95-ab03-9cd31ee911e6 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:21:44.677032 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-4640e61d-b652-4c95-ab03-9cd31ee911e6 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:21:44.706450 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-4640e61d-b652-4c95-ab03-9cd31ee911e6 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042656 Nov 09 20:21:44.706996 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 756/1484] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:21:44 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:21:45.717805 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-db987d62-2cc1-41d6-92d6-4a920be7962a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:21:45.718789 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-db987d62-2cc1-41d6-92d6-4a920be7962a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:21:45.724978 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-db987d62-2cc1-41d6-92d6-4a920be7962a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:21:45.725418 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-db987d62-2cc1-41d6-92d6-4a920be7962a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:21:45.726175 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-db987d62-2cc1-41d6-92d6-4a920be7962a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:21:45.726598 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-db987d62-2cc1-41d6-92d6-4a920be7962a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:21:45.755661 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-db987d62-2cc1-41d6-92d6-4a920be7962a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041809 Nov 09 20:21:45.756196 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 729/1485] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:21:45 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:21:46.768261 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-e77be661-1a17-49a1-a068-6b721c02fa34 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:21:46.769179 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-e77be661-1a17-49a1-a068-6b721c02fa34 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:21:46.775042 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e77be661-1a17-49a1-a068-6b721c02fa34 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:21:46.775489 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e77be661-1a17-49a1-a068-6b721c02fa34 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:21:46.776286 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e77be661-1a17-49a1-a068-6b721c02fa34 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:21:46.776738 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e77be661-1a17-49a1-a068-6b721c02fa34 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:21:46.806763 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-e77be661-1a17-49a1-a068-6b721c02fa34 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043719 Nov 09 20:21:46.807298 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 757/1486] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:21:46 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:21:47.818572 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-cc05eb0b-86b7-42de-bd62-4a22e0329a12 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:21:47.819464 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-cc05eb0b-86b7-42de-bd62-4a22e0329a12 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:21:47.826210 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cc05eb0b-86b7-42de-bd62-4a22e0329a12 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:21:47.826648 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cc05eb0b-86b7-42de-bd62-4a22e0329a12 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:21:47.827442 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cc05eb0b-86b7-42de-bd62-4a22e0329a12 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:21:47.827867 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cc05eb0b-86b7-42de-bd62-4a22e0329a12 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:21:47.855895 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-cc05eb0b-86b7-42de-bd62-4a22e0329a12 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041111 Nov 09 20:21:47.856442 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 730/1487] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:21:47 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:21:48.867318 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-aed48213-00ce-42a2-a9e7-99871adb2c8d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:21:48.868215 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-aed48213-00ce-42a2-a9e7-99871adb2c8d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:21:48.874563 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-aed48213-00ce-42a2-a9e7-99871adb2c8d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:21:48.875008 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-aed48213-00ce-42a2-a9e7-99871adb2c8d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:21:48.875778 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-aed48213-00ce-42a2-a9e7-99871adb2c8d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:21:48.876211 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-aed48213-00ce-42a2-a9e7-99871adb2c8d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:21:48.904747 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-aed48213-00ce-42a2-a9e7-99871adb2c8d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041135 Nov 09 20:21:48.905287 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 758/1488] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:21:48 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:21:49.915006 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-ba52ac8b-bd5c-4cfd-921c-bd61caa8d431 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:21:49.915927 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-ba52ac8b-bd5c-4cfd-921c-bd61caa8d431 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:21:49.922575 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ba52ac8b-bd5c-4cfd-921c-bd61caa8d431 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:21:49.923011 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ba52ac8b-bd5c-4cfd-921c-bd61caa8d431 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:21:49.923763 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ba52ac8b-bd5c-4cfd-921c-bd61caa8d431 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:21:49.924187 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ba52ac8b-bd5c-4cfd-921c-bd61caa8d431 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:21:49.953519 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-ba52ac8b-bd5c-4cfd-921c-bd61caa8d431 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042340 Nov 09 20:21:49.954090 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 731/1489] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:21:49 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:21:50.964731 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-fa367039-9afe-415a-ba6d-e993bac02ef9 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:21:50.965657 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-fa367039-9afe-415a-ba6d-e993bac02ef9 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:21:50.972667 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-fa367039-9afe-415a-ba6d-e993bac02ef9 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:21:50.973117 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-fa367039-9afe-415a-ba6d-e993bac02ef9 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:21:50.973888 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-fa367039-9afe-415a-ba6d-e993bac02ef9 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:21:50.974321 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-fa367039-9afe-415a-ba6d-e993bac02ef9 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:21:51.003290 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-fa367039-9afe-415a-ba6d-e993bac02ef9 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042246 Nov 09 20:21:51.003831 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 759/1490] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:21:50 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:21:52.015413 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-7064c595-9f0b-4bc8-8de8-58ffbedc5620 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:21:52.016319 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-7064c595-9f0b-4bc8-8de8-58ffbedc5620 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:21:52.023069 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7064c595-9f0b-4bc8-8de8-58ffbedc5620 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:21:52.023520 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7064c595-9f0b-4bc8-8de8-58ffbedc5620 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:21:52.024296 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7064c595-9f0b-4bc8-8de8-58ffbedc5620 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:21:52.024870 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7064c595-9f0b-4bc8-8de8-58ffbedc5620 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:21:52.055756 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-7064c595-9f0b-4bc8-8de8-58ffbedc5620 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044895 Nov 09 20:21:52.056304 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 732/1491] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:21:52 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:21:53.067947 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-8634c5f4-f443-4b13-8a7b-2231cc504d06 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:21:53.068874 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-8634c5f4-f443-4b13-8a7b-2231cc504d06 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:21:53.075027 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-8634c5f4-f443-4b13-8a7b-2231cc504d06 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:21:53.076012 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-8634c5f4-f443-4b13-8a7b-2231cc504d06 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:21:53.077077 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-8634c5f4-f443-4b13-8a7b-2231cc504d06 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:21:53.077515 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-8634c5f4-f443-4b13-8a7b-2231cc504d06 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:21:53.105786 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-8634c5f4-f443-4b13-8a7b-2231cc504d06 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041545 Nov 09 20:21:53.106323 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 760/1492] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:21:53 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:21:54.117491 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-d5a8aeb6-0d65-434e-a7f2-633dddfc589f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:21:54.118397 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-d5a8aeb6-0d65-434e-a7f2-633dddfc589f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:21:54.125263 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d5a8aeb6-0d65-434e-a7f2-633dddfc589f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:21:54.125711 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d5a8aeb6-0d65-434e-a7f2-633dddfc589f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:21:54.126494 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d5a8aeb6-0d65-434e-a7f2-633dddfc589f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:21:54.126925 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d5a8aeb6-0d65-434e-a7f2-633dddfc589f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:21:54.155997 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-d5a8aeb6-0d65-434e-a7f2-633dddfc589f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042224 Nov 09 20:21:54.156808 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 733/1493] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:21:54 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:21:55.014645 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-ed0b9bda-e5fa-4a39-8ac3-c3074ec08c26 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:21:55.015301 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-ed0b9bda-e5fa-4a39-8ac3-c3074ec08c26 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:21:55.021445 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ed0b9bda-e5fa-4a39-8ac3-c3074ec08c26 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:21:55.021891 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ed0b9bda-e5fa-4a39-8ac3-c3074ec08c26 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:21:55.022667 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ed0b9bda-e5fa-4a39-8ac3-c3074ec08c26 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:21:55.023131 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ed0b9bda-e5fa-4a39-8ac3-c3074ec08c26 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:21:55.048551 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-ed0b9bda-e5fa-4a39-8ac3-c3074ec08c26 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Going to try to terminate instance {{(pid=116102) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 09 20:21:55.130670 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-ed0b9bda-e5fa-4a39-8ac3-c3074ec08c26 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "DELETE /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 204 len: 0 microversion: 2.1 time: 0.119761 Nov 09 20:21:55.131251 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 761/1494] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Nov 9 20:21:55 2021] DELETE /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 09 20:21:55.141008 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-2f7fd70e-5940-4e17-bc10-8b8ae1b2668b tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:21:55.141622 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-2f7fd70e-5940-4e17-bc10-8b8ae1b2668b tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:21:55.147764 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2f7fd70e-5940-4e17-bc10-8b8ae1b2668b tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:21:55.148211 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2f7fd70e-5940-4e17-bc10-8b8ae1b2668b tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:21:55.149022 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2f7fd70e-5940-4e17-bc10-8b8ae1b2668b tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:21:55.149460 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2f7fd70e-5940-4e17-bc10-8b8ae1b2668b tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:21:55.167708 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-21731410-564e-42c1-a94f-a90dd3ea09b7 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:21:55.168753 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-21731410-564e-42c1-a94f-a90dd3ea09b7 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:21:55.174560 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-21731410-564e-42c1-a94f-a90dd3ea09b7 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:21:55.175007 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-21731410-564e-42c1-a94f-a90dd3ea09b7 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:21:55.175776 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-21731410-564e-42c1-a94f-a90dd3ea09b7 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:21:55.176206 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-21731410-564e-42c1-a94f-a90dd3ea09b7 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:21:55.205999 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-21731410-564e-42c1-a94f-a90dd3ea09b7 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042433 Nov 09 20:21:55.206548 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 762/1495] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:21:55 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 20:21:55.342767 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-2f7fd70e-5940-4e17-bc10-8b8ae1b2668b tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:21:55.350623 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-2f7fd70e-5940-4e17-bc10-8b8ae1b2668b tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.214840 Nov 09 20:21:55.351190 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 734/1496] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:21:55 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:21:56.217195 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-cbecf582-b0c2-4fbe-8db6-b281007c8c04 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:21:56.218731 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-cbecf582-b0c2-4fbe-8db6-b281007c8c04 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:21:56.224822 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-cbecf582-b0c2-4fbe-8db6-b281007c8c04 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:21:56.225266 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-cbecf582-b0c2-4fbe-8db6-b281007c8c04 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:21:56.226026 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-cbecf582-b0c2-4fbe-8db6-b281007c8c04 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:21:56.226457 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-cbecf582-b0c2-4fbe-8db6-b281007c8c04 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:21:56.255049 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-cbecf582-b0c2-4fbe-8db6-b281007c8c04 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041640 Nov 09 20:21:56.255604 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 763/1497] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:21:56 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:21:56.367683 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-963e7d27-1f7b-4947-bb54-b7179ee74ca6 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:21:56.368292 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-963e7d27-1f7b-4947-bb54-b7179ee74ca6 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:21:56.374679 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-963e7d27-1f7b-4947-bb54-b7179ee74ca6 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:21:56.375128 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-963e7d27-1f7b-4947-bb54-b7179ee74ca6 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:21:56.375936 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-963e7d27-1f7b-4947-bb54-b7179ee74ca6 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:21:56.376372 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-963e7d27-1f7b-4947-bb54-b7179ee74ca6 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:21:56.501585 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-963e7d27-1f7b-4947-bb54-b7179ee74ca6 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:21:56.509192 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-963e7d27-1f7b-4947-bb54-b7179ee74ca6 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.145151 Nov 09 20:21:56.509749 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 735/1498] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:21:56 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:21:57.266174 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-f925992b-9c24-485f-b5f7-3d5c7d781b8f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:21:57.267074 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-f925992b-9c24-485f-b5f7-3d5c7d781b8f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:21:57.273279 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f925992b-9c24-485f-b5f7-3d5c7d781b8f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:21:57.273726 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f925992b-9c24-485f-b5f7-3d5c7d781b8f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:21:57.274498 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f925992b-9c24-485f-b5f7-3d5c7d781b8f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:21:57.274932 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f925992b-9c24-485f-b5f7-3d5c7d781b8f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:21:57.303505 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-f925992b-9c24-485f-b5f7-3d5c7d781b8f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041095 Nov 09 20:21:57.304057 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 764/1499] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:21:57 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:21:57.526462 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-02ef028b-908a-4b1e-8f6a-afd50f3f8f8f tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:21:57.526974 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-02ef028b-908a-4b1e-8f6a-afd50f3f8f8f tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:21:57.533807 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-02ef028b-908a-4b1e-8f6a-afd50f3f8f8f tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:21:57.534249 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-02ef028b-908a-4b1e-8f6a-afd50f3f8f8f tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:21:57.535010 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-02ef028b-908a-4b1e-8f6a-afd50f3f8f8f tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:21:57.535437 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-02ef028b-908a-4b1e-8f6a-afd50f3f8f8f tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:21:57.662881 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-02ef028b-908a-4b1e-8f6a-afd50f3f8f8f tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:21:57.671155 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-02ef028b-908a-4b1e-8f6a-afd50f3f8f8f tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.147645 Nov 09 20:21:57.672178 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 736/1500] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:21:57 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:21:58.315225 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-b9ec8216-cb5e-4b20-838b-65ada8ca5829 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:21:58.316176 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-b9ec8216-cb5e-4b20-838b-65ada8ca5829 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:21:58.322297 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b9ec8216-cb5e-4b20-838b-65ada8ca5829 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:21:58.322741 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b9ec8216-cb5e-4b20-838b-65ada8ca5829 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:21:58.323507 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b9ec8216-cb5e-4b20-838b-65ada8ca5829 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:21:58.323932 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b9ec8216-cb5e-4b20-838b-65ada8ca5829 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:21:58.353270 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-b9ec8216-cb5e-4b20-838b-65ada8ca5829 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042375 Nov 09 20:21:58.353805 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 765/1501] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:21:58 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:21:58.689040 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-97c726df-94c5-4444-9afd-5e24f8d8ceae tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:21:58.689645 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-97c726df-94c5-4444-9afd-5e24f8d8ceae tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:21:58.695794 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-97c726df-94c5-4444-9afd-5e24f8d8ceae tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:21:58.696236 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-97c726df-94c5-4444-9afd-5e24f8d8ceae tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:21:58.697038 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-97c726df-94c5-4444-9afd-5e24f8d8ceae tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:21:58.697468 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-97c726df-94c5-4444-9afd-5e24f8d8ceae tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:21:58.826987 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-97c726df-94c5-4444-9afd-5e24f8d8ceae tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:21:58.834798 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-97c726df-94c5-4444-9afd-5e24f8d8ceae tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.150027 Nov 09 20:21:58.835351 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 737/1502] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:21:58 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:21:59.364217 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-6602e833-56d2-4b7f-bf1e-00ea5145f9fd tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:21:59.365167 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-6602e833-56d2-4b7f-bf1e-00ea5145f9fd tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:21:59.371239 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6602e833-56d2-4b7f-bf1e-00ea5145f9fd tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:21:59.371681 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6602e833-56d2-4b7f-bf1e-00ea5145f9fd tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:21:59.372457 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6602e833-56d2-4b7f-bf1e-00ea5145f9fd tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:21:59.372883 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6602e833-56d2-4b7f-bf1e-00ea5145f9fd tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:21:59.402286 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-6602e833-56d2-4b7f-bf1e-00ea5145f9fd tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041966 Nov 09 20:21:59.402834 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 766/1503] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:21:59 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:21:59.851282 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-d2b16da0-109a-4f5b-9a7e-915f4ecfca83 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:21:59.851858 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-d2b16da0-109a-4f5b-9a7e-915f4ecfca83 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:21:59.858243 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d2b16da0-109a-4f5b-9a7e-915f4ecfca83 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:21:59.858810 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d2b16da0-109a-4f5b-9a7e-915f4ecfca83 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:21:59.859573 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d2b16da0-109a-4f5b-9a7e-915f4ecfca83 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:21:59.859999 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d2b16da0-109a-4f5b-9a7e-915f4ecfca83 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:21:59.986302 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-d2b16da0-109a-4f5b-9a7e-915f4ecfca83 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:21:59.994101 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-d2b16da0-109a-4f5b-9a7e-915f4ecfca83 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.146459 Nov 09 20:21:59.994650 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 738/1504] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:21:59 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:22:00.413670 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-7e9d3135-9f75-49ef-846d-85b6674acea2 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:22:00.414576 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-7e9d3135-9f75-49ef-846d-85b6674acea2 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:22:00.421452 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-7e9d3135-9f75-49ef-846d-85b6674acea2 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:00.421901 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-7e9d3135-9f75-49ef-846d-85b6674acea2 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:00.422679 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-7e9d3135-9f75-49ef-846d-85b6674acea2 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:00.423113 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-7e9d3135-9f75-49ef-846d-85b6674acea2 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:00.451720 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-7e9d3135-9f75-49ef-846d-85b6674acea2 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041693 Nov 09 20:22:00.452295 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 767/1505] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:22:00 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:22:01.010747 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-81c02868-06e8-47ac-9e53-3136bd2a0669 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:22:01.011329 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-81c02868-06e8-47ac-9e53-3136bd2a0669 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:22:01.018150 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-81c02868-06e8-47ac-9e53-3136bd2a0669 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:01.018587 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-81c02868-06e8-47ac-9e53-3136bd2a0669 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:01.019347 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-81c02868-06e8-47ac-9e53-3136bd2a0669 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:01.019774 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-81c02868-06e8-47ac-9e53-3136bd2a0669 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:01.149682 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-81c02868-06e8-47ac-9e53-3136bd2a0669 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:22:01.157318 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-81c02868-06e8-47ac-9e53-3136bd2a0669 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.150200 Nov 09 20:22:01.157872 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 739/1506] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:22:01 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:22:01.462888 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-1e2c43cc-57f7-429e-a177-1c9539f632c4 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:22:01.463810 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-1e2c43cc-57f7-429e-a177-1c9539f632c4 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:22:01.469989 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-1e2c43cc-57f7-429e-a177-1c9539f632c4 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:01.470449 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-1e2c43cc-57f7-429e-a177-1c9539f632c4 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:01.471272 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-1e2c43cc-57f7-429e-a177-1c9539f632c4 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:01.471698 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-1e2c43cc-57f7-429e-a177-1c9539f632c4 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:01.507576 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-1e2c43cc-57f7-429e-a177-1c9539f632c4 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048141 Nov 09 20:22:01.508115 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 768/1507] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:22:01 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:22:02.175042 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-139f08ff-4ccf-4b11-b179-0ea02760b390 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:22:02.175676 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-139f08ff-4ccf-4b11-b179-0ea02760b390 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:22:02.181836 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-139f08ff-4ccf-4b11-b179-0ea02760b390 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:02.182278 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-139f08ff-4ccf-4b11-b179-0ea02760b390 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:02.183042 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-139f08ff-4ccf-4b11-b179-0ea02760b390 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:02.183470 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-139f08ff-4ccf-4b11-b179-0ea02760b390 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:02.311278 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-139f08ff-4ccf-4b11-b179-0ea02760b390 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:22:02.318923 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-139f08ff-4ccf-4b11-b179-0ea02760b390 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.148402 Nov 09 20:22:02.319475 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 740/1508] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:22:02 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:22:02.519559 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-ea5dbf0d-05e6-4903-89cb-d97237c99320 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:22:02.520456 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-ea5dbf0d-05e6-4903-89cb-d97237c99320 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:22:02.526660 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ea5dbf0d-05e6-4903-89cb-d97237c99320 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:02.527110 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ea5dbf0d-05e6-4903-89cb-d97237c99320 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:02.527884 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ea5dbf0d-05e6-4903-89cb-d97237c99320 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:02.528318 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ea5dbf0d-05e6-4903-89cb-d97237c99320 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:02.557646 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-ea5dbf0d-05e6-4903-89cb-d97237c99320 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041912 Nov 09 20:22:02.558201 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 769/1509] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:22:02 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:22:03.336251 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-ecae0029-a9a6-4d03-9553-430a6a3575c7 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:22:03.336907 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-ecae0029-a9a6-4d03-9553-430a6a3575c7 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:22:03.343284 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ecae0029-a9a6-4d03-9553-430a6a3575c7 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:03.343733 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ecae0029-a9a6-4d03-9553-430a6a3575c7 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:03.344531 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ecae0029-a9a6-4d03-9553-430a6a3575c7 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:03.344964 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ecae0029-a9a6-4d03-9553-430a6a3575c7 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:03.485782 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-ecae0029-a9a6-4d03-9553-430a6a3575c7 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:22:03.494609 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-ecae0029-a9a6-4d03-9553-430a6a3575c7 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.161938 Nov 09 20:22:03.495343 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 741/1510] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:22:03 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:22:03.569050 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-6cb58b6b-dd99-4de6-9e08-02f326f2ab76 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:22:03.569956 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-6cb58b6b-dd99-4de6-9e08-02f326f2ab76 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:22:03.576129 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6cb58b6b-dd99-4de6-9e08-02f326f2ab76 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:03.576625 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6cb58b6b-dd99-4de6-9e08-02f326f2ab76 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:03.577401 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6cb58b6b-dd99-4de6-9e08-02f326f2ab76 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:03.577832 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6cb58b6b-dd99-4de6-9e08-02f326f2ab76 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:03.606754 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-6cb58b6b-dd99-4de6-9e08-02f326f2ab76 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041361 Nov 09 20:22:03.607357 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 770/1511] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:22:03 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:22:04.510612 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-1d61f52d-8012-4f70-80c5-1d3299bd630b tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:22:04.511209 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-1d61f52d-8012-4f70-80c5-1d3299bd630b tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:22:04.518389 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1d61f52d-8012-4f70-80c5-1d3299bd630b tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:04.518833 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1d61f52d-8012-4f70-80c5-1d3299bd630b tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:04.519598 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1d61f52d-8012-4f70-80c5-1d3299bd630b tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:04.520063 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1d61f52d-8012-4f70-80c5-1d3299bd630b tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:04.618094 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-f47b90c5-7ed8-4f9b-af72-ceb56ddbf0b1 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:22:04.618997 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-f47b90c5-7ed8-4f9b-af72-ceb56ddbf0b1 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:22:04.625975 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f47b90c5-7ed8-4f9b-af72-ceb56ddbf0b1 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:04.626417 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f47b90c5-7ed8-4f9b-af72-ceb56ddbf0b1 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:04.627184 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f47b90c5-7ed8-4f9b-af72-ceb56ddbf0b1 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:04.627614 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f47b90c5-7ed8-4f9b-af72-ceb56ddbf0b1 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:04.650685 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-1d61f52d-8012-4f70-80c5-1d3299bd630b tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:22:04.656369 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-f47b90c5-7ed8-4f9b-af72-ceb56ddbf0b1 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041924 Nov 09 20:22:04.656945 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 771/1512] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:22:04 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 20:22:04.658530 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-1d61f52d-8012-4f70-80c5-1d3299bd630b tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.151590 Nov 09 20:22:04.659077 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 742/1513] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:22:04 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:22:05.667743 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-ef7a8e3e-7a54-4dca-83eb-bfd3a8ecf1ea tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:22:05.668706 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-ef7a8e3e-7a54-4dca-83eb-bfd3a8ecf1ea tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:22:05.674676 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-c3f3d25f-c382-454e-aa70-c491d0f7f737 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:22:05.675282 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ef7a8e3e-7a54-4dca-83eb-bfd3a8ecf1ea tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:05.675410 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-c3f3d25f-c382-454e-aa70-c491d0f7f737 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:22:05.675729 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ef7a8e3e-7a54-4dca-83eb-bfd3a8ecf1ea tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:05.676543 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ef7a8e3e-7a54-4dca-83eb-bfd3a8ecf1ea tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:05.676977 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ef7a8e3e-7a54-4dca-83eb-bfd3a8ecf1ea tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:05.681539 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c3f3d25f-c382-454e-aa70-c491d0f7f737 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:05.681987 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c3f3d25f-c382-454e-aa70-c491d0f7f737 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:05.682755 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c3f3d25f-c382-454e-aa70-c491d0f7f737 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:05.683194 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c3f3d25f-c382-454e-aa70-c491d0f7f737 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:05.706976 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-ef7a8e3e-7a54-4dca-83eb-bfd3a8ecf1ea tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042919 Nov 09 20:22:05.707534 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 772/1514] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:22:05 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:22:05.813074 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-c3f3d25f-c382-454e-aa70-c491d0f7f737 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:22:05.820744 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-c3f3d25f-c382-454e-aa70-c491d0f7f737 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.149605 Nov 09 20:22:05.821301 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 743/1515] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:22:05 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 20:22:06.717731 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-f3c3befc-8da0-4ca9-a97d-f4a3bb639255 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:22:06.718710 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-f3c3befc-8da0-4ca9-a97d-f4a3bb639255 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:22:06.724653 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f3c3befc-8da0-4ca9-a97d-f4a3bb639255 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:06.725263 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f3c3befc-8da0-4ca9-a97d-f4a3bb639255 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:06.726032 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f3c3befc-8da0-4ca9-a97d-f4a3bb639255 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:06.726460 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f3c3befc-8da0-4ca9-a97d-f4a3bb639255 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:06.754822 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-f3c3befc-8da0-4ca9-a97d-f4a3bb639255 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041353 Nov 09 20:22:06.755356 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 773/1516] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:22:06 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:22:06.838253 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-f68544af-6154-46de-81ed-a2ed77fd014e tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:22:06.838779 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-f68544af-6154-46de-81ed-a2ed77fd014e tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:22:06.845568 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f68544af-6154-46de-81ed-a2ed77fd014e tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:06.846005 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f68544af-6154-46de-81ed-a2ed77fd014e tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:06.846760 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f68544af-6154-46de-81ed-a2ed77fd014e tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:06.847180 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f68544af-6154-46de-81ed-a2ed77fd014e tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:06.978901 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-f68544af-6154-46de-81ed-a2ed77fd014e tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:22:06.986537 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-f68544af-6154-46de-81ed-a2ed77fd014e tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.151991 Nov 09 20:22:06.987093 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 744/1517] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:22:06 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:22:07.766089 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-3b897753-763e-48be-aa44-95687f657b07 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:22:07.767001 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-3b897753-763e-48be-aa44-95687f657b07 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:22:07.773297 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-3b897753-763e-48be-aa44-95687f657b07 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:07.773746 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-3b897753-763e-48be-aa44-95687f657b07 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:07.774554 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-3b897753-763e-48be-aa44-95687f657b07 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:07.774989 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-3b897753-763e-48be-aa44-95687f657b07 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:07.803529 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-3b897753-763e-48be-aa44-95687f657b07 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041181 Nov 09 20:22:07.804087 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 774/1518] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:22:07 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:22:08.003648 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-40030843-e559-41a2-9cc2-a3061e4681e5 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:22:08.004268 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-40030843-e559-41a2-9cc2-a3061e4681e5 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:22:08.010381 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-40030843-e559-41a2-9cc2-a3061e4681e5 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:08.010817 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-40030843-e559-41a2-9cc2-a3061e4681e5 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:08.011572 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-40030843-e559-41a2-9cc2-a3061e4681e5 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:08.011996 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-40030843-e559-41a2-9cc2-a3061e4681e5 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:08.138924 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-40030843-e559-41a2-9cc2-a3061e4681e5 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:22:08.146666 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-40030843-e559-41a2-9cc2-a3061e4681e5 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.146591 Nov 09 20:22:08.147225 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 745/1519] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:22:07 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:22:08.815394 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-8aa6ef4f-74c4-4168-9243-e01b8997e472 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:22:08.816293 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-8aa6ef4f-74c4-4168-9243-e01b8997e472 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:22:08.822543 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-8aa6ef4f-74c4-4168-9243-e01b8997e472 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:08.822983 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-8aa6ef4f-74c4-4168-9243-e01b8997e472 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:08.823743 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-8aa6ef4f-74c4-4168-9243-e01b8997e472 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:08.824165 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-8aa6ef4f-74c4-4168-9243-e01b8997e472 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:08.852834 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-8aa6ef4f-74c4-4168-9243-e01b8997e472 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041709 Nov 09 20:22:08.853388 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 775/1520] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:22:08 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:22:09.163949 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-861bece5-55f6-4170-a130-d8c003f7416c tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:22:09.164584 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-861bece5-55f6-4170-a130-d8c003f7416c tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:22:09.171858 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-861bece5-55f6-4170-a130-d8c003f7416c tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:09.172306 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-861bece5-55f6-4170-a130-d8c003f7416c tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:09.173108 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-861bece5-55f6-4170-a130-d8c003f7416c tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:09.173533 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-861bece5-55f6-4170-a130-d8c003f7416c tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:09.306656 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-861bece5-55f6-4170-a130-d8c003f7416c tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:22:09.314952 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-861bece5-55f6-4170-a130-d8c003f7416c tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.154617 Nov 09 20:22:09.315499 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 746/1521] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:22:09 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:22:09.863765 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-dce8129d-1a04-4785-af7c-f52ed3531bcc tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:22:09.864688 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-dce8129d-1a04-4785-af7c-f52ed3531bcc tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:22:09.870810 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-dce8129d-1a04-4785-af7c-f52ed3531bcc tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:09.871261 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-dce8129d-1a04-4785-af7c-f52ed3531bcc tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:09.872035 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-dce8129d-1a04-4785-af7c-f52ed3531bcc tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:09.872493 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-dce8129d-1a04-4785-af7c-f52ed3531bcc tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:09.900963 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-dce8129d-1a04-4785-af7c-f52ed3531bcc tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041246 Nov 09 20:22:09.901503 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 776/1522] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:22:09 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:22:10.331508 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-b5127912-531f-4d4e-868f-954f698aacd8 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:22:10.332103 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-b5127912-531f-4d4e-868f-954f698aacd8 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:22:10.338280 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b5127912-531f-4d4e-868f-954f698aacd8 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:10.338718 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b5127912-531f-4d4e-868f-954f698aacd8 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:10.339477 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b5127912-531f-4d4e-868f-954f698aacd8 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:10.339906 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b5127912-531f-4d4e-868f-954f698aacd8 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:10.470815 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-b5127912-531f-4d4e-868f-954f698aacd8 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:22:10.478453 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-b5127912-531f-4d4e-868f-954f698aacd8 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.150695 Nov 09 20:22:10.479025 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 747/1523] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:22:10 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:22:10.912610 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-cfaecaf0-cb4a-46a2-bf5f-a25002f3d24d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:22:10.913515 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-cfaecaf0-cb4a-46a2-bf5f-a25002f3d24d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:22:10.919646 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-cfaecaf0-cb4a-46a2-bf5f-a25002f3d24d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:10.920135 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-cfaecaf0-cb4a-46a2-bf5f-a25002f3d24d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:10.920925 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-cfaecaf0-cb4a-46a2-bf5f-a25002f3d24d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:10.922081 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-cfaecaf0-cb4a-46a2-bf5f-a25002f3d24d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:10.950109 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-cfaecaf0-cb4a-46a2-bf5f-a25002f3d24d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041360 Nov 09 20:22:10.950648 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 777/1524] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:22:10 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:22:11.495860 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-1a48d5ad-55b0-45cb-9a68-7c16ad8bea19 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:22:11.496497 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-1a48d5ad-55b0-45cb-9a68-7c16ad8bea19 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:22:11.503026 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1a48d5ad-55b0-45cb-9a68-7c16ad8bea19 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:11.503468 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1a48d5ad-55b0-45cb-9a68-7c16ad8bea19 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:11.504226 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1a48d5ad-55b0-45cb-9a68-7c16ad8bea19 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:11.504682 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1a48d5ad-55b0-45cb-9a68-7c16ad8bea19 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:11.632361 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-1a48d5ad-55b0-45cb-9a68-7c16ad8bea19 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:22:11.640689 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-1a48d5ad-55b0-45cb-9a68-7c16ad8bea19 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.147840 Nov 09 20:22:11.641255 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 748/1525] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:22:11 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:22:11.961239 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-540e4627-5b04-4d51-8be0-1898377717be tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:22:11.962042 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-540e4627-5b04-4d51-8be0-1898377717be tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:22:11.968261 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-540e4627-5b04-4d51-8be0-1898377717be tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:11.968832 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-540e4627-5b04-4d51-8be0-1898377717be tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:11.969611 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-540e4627-5b04-4d51-8be0-1898377717be tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:11.970035 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-540e4627-5b04-4d51-8be0-1898377717be tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:11.998283 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-540e4627-5b04-4d51-8be0-1898377717be tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040838 Nov 09 20:22:11.998820 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 778/1526] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:22:11 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:22:12.658469 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-8ad395fe-fc0a-41f5-816f-e706801f3814 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:22:12.659122 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-8ad395fe-fc0a-41f5-816f-e706801f3814 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:22:12.665222 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8ad395fe-fc0a-41f5-816f-e706801f3814 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:12.665679 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8ad395fe-fc0a-41f5-816f-e706801f3814 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:12.666451 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8ad395fe-fc0a-41f5-816f-e706801f3814 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:12.666883 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8ad395fe-fc0a-41f5-816f-e706801f3814 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:12.796634 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-8ad395fe-fc0a-41f5-816f-e706801f3814 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:22:12.804295 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-8ad395fe-fc0a-41f5-816f-e706801f3814 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.150167 Nov 09 20:22:12.804890 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 749/1527] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:22:12 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:22:13.010044 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-70c4e2c1-0fba-4cfa-9c17-fd9132096cc8 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:22:13.010938 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-70c4e2c1-0fba-4cfa-9c17-fd9132096cc8 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:22:13.017590 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-70c4e2c1-0fba-4cfa-9c17-fd9132096cc8 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:13.018028 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-70c4e2c1-0fba-4cfa-9c17-fd9132096cc8 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:13.018793 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-70c4e2c1-0fba-4cfa-9c17-fd9132096cc8 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:13.019220 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-70c4e2c1-0fba-4cfa-9c17-fd9132096cc8 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:13.047024 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-70c4e2c1-0fba-4cfa-9c17-fd9132096cc8 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040662 Nov 09 20:22:13.047553 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 779/1528] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:22:13 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:22:13.821655 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-e8356630-29a8-47ee-968f-14c892542fe9 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:22:13.822234 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-e8356630-29a8-47ee-968f-14c892542fe9 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:22:13.828913 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e8356630-29a8-47ee-968f-14c892542fe9 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:13.829355 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e8356630-29a8-47ee-968f-14c892542fe9 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:13.830124 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e8356630-29a8-47ee-968f-14c892542fe9 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:13.830552 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e8356630-29a8-47ee-968f-14c892542fe9 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:13.962249 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-e8356630-29a8-47ee-968f-14c892542fe9 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:22:13.970770 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-e8356630-29a8-47ee-968f-14c892542fe9 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.152727 Nov 09 20:22:13.971333 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 750/1529] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:22:13 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:22:14.057730 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-8d5601b3-4050-4ebf-85f2-6770656774d9 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:22:14.058636 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-8d5601b3-4050-4ebf-85f2-6770656774d9 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:22:14.064844 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-8d5601b3-4050-4ebf-85f2-6770656774d9 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:14.065291 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-8d5601b3-4050-4ebf-85f2-6770656774d9 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:14.066060 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-8d5601b3-4050-4ebf-85f2-6770656774d9 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:14.066492 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-8d5601b3-4050-4ebf-85f2-6770656774d9 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:14.095034 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-8d5601b3-4050-4ebf-85f2-6770656774d9 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041036 Nov 09 20:22:14.095591 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 780/1530] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:22:14 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:22:14.988316 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-e45ef3f9-753a-46f8-85f5-e82d948a8891 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:22:14.989007 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-e45ef3f9-753a-46f8-85f5-e82d948a8891 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:22:14.995332 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e45ef3f9-753a-46f8-85f5-e82d948a8891 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:14.995781 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e45ef3f9-753a-46f8-85f5-e82d948a8891 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:14.996595 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e45ef3f9-753a-46f8-85f5-e82d948a8891 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:14.997032 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e45ef3f9-753a-46f8-85f5-e82d948a8891 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:15.106678 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-d6a26cba-66b7-4f79-9823-aae92d4e06bb tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:22:15.107571 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-d6a26cba-66b7-4f79-9823-aae92d4e06bb tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:22:15.114626 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d6a26cba-66b7-4f79-9823-aae92d4e06bb tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:15.115068 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d6a26cba-66b7-4f79-9823-aae92d4e06bb tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:15.115834 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d6a26cba-66b7-4f79-9823-aae92d4e06bb tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:15.116261 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d6a26cba-66b7-4f79-9823-aae92d4e06bb tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:15.130759 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-e45ef3f9-753a-46f8-85f5-e82d948a8891 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:22:15.138410 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-e45ef3f9-753a-46f8-85f5-e82d948a8891 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.154522 Nov 09 20:22:15.138968 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 751/1531] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:22:14 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:22:15.145018 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-d6a26cba-66b7-4f79-9823-aae92d4e06bb tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042018 Nov 09 20:22:15.145703 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 781/1532] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:22:15 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 20:22:16.155402 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-c4b44f76-83e6-43f4-8181-46fefb8293dc tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:22:16.156053 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-a2d5b3eb-7fbf-481a-80a1-b51c8b06c22c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:22:16.156449 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-c4b44f76-83e6-43f4-8181-46fefb8293dc tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:22:16.156760 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-a2d5b3eb-7fbf-481a-80a1-b51c8b06c22c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:22:16.162146 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c4b44f76-83e6-43f4-8181-46fefb8293dc tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:16.162720 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c4b44f76-83e6-43f4-8181-46fefb8293dc tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:16.162866 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a2d5b3eb-7fbf-481a-80a1-b51c8b06c22c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:16.163322 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a2d5b3eb-7fbf-481a-80a1-b51c8b06c22c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:16.163647 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c4b44f76-83e6-43f4-8181-46fefb8293dc tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:16.164077 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c4b44f76-83e6-43f4-8181-46fefb8293dc tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:16.164198 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a2d5b3eb-7fbf-481a-80a1-b51c8b06c22c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:16.164653 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a2d5b3eb-7fbf-481a-80a1-b51c8b06c22c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:16.195986 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-a2d5b3eb-7fbf-481a-80a1-b51c8b06c22c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044274 Nov 09 20:22:16.196578 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 752/1533] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:22:16 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:22:16.342295 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-c4b44f76-83e6-43f4-8181-46fefb8293dc tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:22:16.350435 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-c4b44f76-83e6-43f4-8181-46fefb8293dc tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.198812 Nov 09 20:22:16.350990 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 782/1534] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:22:16 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:22:17.206757 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-c0a75cb9-3c37-4397-8d58-99f58c337433 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:22:17.207646 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-c0a75cb9-3c37-4397-8d58-99f58c337433 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:22:17.213832 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c0a75cb9-3c37-4397-8d58-99f58c337433 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:17.214270 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c0a75cb9-3c37-4397-8d58-99f58c337433 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:17.215023 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c0a75cb9-3c37-4397-8d58-99f58c337433 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:17.215447 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c0a75cb9-3c37-4397-8d58-99f58c337433 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:17.244637 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-c0a75cb9-3c37-4397-8d58-99f58c337433 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041453 Nov 09 20:22:17.245177 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 753/1535] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:22:17 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:22:17.367694 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-0a2afb78-d7e4-4378-9395-c4d652ab701e tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:22:17.368308 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-0a2afb78-d7e4-4378-9395-c4d652ab701e tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:22:17.374662 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-0a2afb78-d7e4-4378-9395-c4d652ab701e tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:17.375206 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-0a2afb78-d7e4-4378-9395-c4d652ab701e tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:17.375981 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-0a2afb78-d7e4-4378-9395-c4d652ab701e tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:17.376438 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-0a2afb78-d7e4-4378-9395-c4d652ab701e tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:17.506367 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-0a2afb78-d7e4-4378-9395-c4d652ab701e tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:22:17.514034 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-0a2afb78-d7e4-4378-9395-c4d652ab701e tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.149979 Nov 09 20:22:17.514600 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 783/1536] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:22:17 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:22:18.255609 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-8a4508e3-cae5-4f25-b8ca-f1f49d6829ca tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:22:18.256486 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-8a4508e3-cae5-4f25-b8ca-f1f49d6829ca tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:22:18.262709 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8a4508e3-cae5-4f25-b8ca-f1f49d6829ca tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:18.263146 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8a4508e3-cae5-4f25-b8ca-f1f49d6829ca tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:18.263904 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8a4508e3-cae5-4f25-b8ca-f1f49d6829ca tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:18.264322 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8a4508e3-cae5-4f25-b8ca-f1f49d6829ca tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:18.291840 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-8a4508e3-cae5-4f25-b8ca-f1f49d6829ca tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040092 Nov 09 20:22:18.292385 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 754/1537] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:22:18 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:22:18.531324 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-883311bd-e928-4f30-b071-56f31cea2cb2 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:22:18.531881 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-883311bd-e928-4f30-b071-56f31cea2cb2 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:22:18.537986 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-883311bd-e928-4f30-b071-56f31cea2cb2 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:18.538431 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-883311bd-e928-4f30-b071-56f31cea2cb2 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:18.539204 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-883311bd-e928-4f30-b071-56f31cea2cb2 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:18.539641 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-883311bd-e928-4f30-b071-56f31cea2cb2 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:18.667109 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-883311bd-e928-4f30-b071-56f31cea2cb2 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:22:18.675287 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-883311bd-e928-4f30-b071-56f31cea2cb2 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.148221 Nov 09 20:22:18.675847 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 784/1538] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:22:18 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:22:19.302939 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-f8572003-c168-45e0-8fb8-63ac0fe18bae tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:22:19.303837 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-f8572003-c168-45e0-8fb8-63ac0fe18bae tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:22:19.309923 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f8572003-c168-45e0-8fb8-63ac0fe18bae tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:19.310360 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f8572003-c168-45e0-8fb8-63ac0fe18bae tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:19.311114 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f8572003-c168-45e0-8fb8-63ac0fe18bae tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:19.311536 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f8572003-c168-45e0-8fb8-63ac0fe18bae tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:19.340231 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-f8572003-c168-45e0-8fb8-63ac0fe18bae tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041084 Nov 09 20:22:19.340788 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 755/1539] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:22:19 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:22:19.692296 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-2c3b727d-9778-41aa-b004-3d6d08a68ea3 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:22:19.692916 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-2c3b727d-9778-41aa-b004-3d6d08a68ea3 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:22:19.699089 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-2c3b727d-9778-41aa-b004-3d6d08a68ea3 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:19.699530 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-2c3b727d-9778-41aa-b004-3d6d08a68ea3 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:19.700299 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-2c3b727d-9778-41aa-b004-3d6d08a68ea3 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:19.700756 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-2c3b727d-9778-41aa-b004-3d6d08a68ea3 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:19.840284 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-2c3b727d-9778-41aa-b004-3d6d08a68ea3 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:22:19.848623 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-2c3b727d-9778-41aa-b004-3d6d08a68ea3 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.159957 Nov 09 20:22:19.849186 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 785/1540] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:22:19 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:22:20.351996 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-2cb3bf02-177f-484d-b432-023db6187c1a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:22:20.352915 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-2cb3bf02-177f-484d-b432-023db6187c1a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:22:20.360137 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2cb3bf02-177f-484d-b432-023db6187c1a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:20.360599 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2cb3bf02-177f-484d-b432-023db6187c1a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:20.361358 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2cb3bf02-177f-484d-b432-023db6187c1a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:20.361776 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2cb3bf02-177f-484d-b432-023db6187c1a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:20.390020 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-2cb3bf02-177f-484d-b432-023db6187c1a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041670 Nov 09 20:22:20.390559 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 756/1541] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:22:20 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:22:20.866105 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-01aec0f9-14f9-44cb-88b5-4b0ab676094c tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:22:20.866706 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-01aec0f9-14f9-44cb-88b5-4b0ab676094c tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:22:20.872831 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-01aec0f9-14f9-44cb-88b5-4b0ab676094c tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:20.873337 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-01aec0f9-14f9-44cb-88b5-4b0ab676094c tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:20.874102 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-01aec0f9-14f9-44cb-88b5-4b0ab676094c tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:20.874764 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-01aec0f9-14f9-44cb-88b5-4b0ab676094c tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:21.006607 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-01aec0f9-14f9-44cb-88b5-4b0ab676094c tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:22:21.014663 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-01aec0f9-14f9-44cb-88b5-4b0ab676094c tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.152541 Nov 09 20:22:21.015924 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 786/1542] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:22:20 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:22:21.401155 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-6f10a8dd-30cb-47cb-95b9-afe13f826e32 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:22:21.402050 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-6f10a8dd-30cb-47cb-95b9-afe13f826e32 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:22:21.408164 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6f10a8dd-30cb-47cb-95b9-afe13f826e32 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:21.408636 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6f10a8dd-30cb-47cb-95b9-afe13f826e32 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:21.409393 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6f10a8dd-30cb-47cb-95b9-afe13f826e32 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:21.409813 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6f10a8dd-30cb-47cb-95b9-afe13f826e32 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:21.437779 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-6f10a8dd-30cb-47cb-95b9-afe13f826e32 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040256 Nov 09 20:22:21.438305 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 757/1543] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:22:21 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:22:22.031291 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-a17d6730-f0c2-4503-84aa-e2cb2ef0321c tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:22:22.031895 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-a17d6730-f0c2-4503-84aa-e2cb2ef0321c tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:22:22.038046 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a17d6730-f0c2-4503-84aa-e2cb2ef0321c tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:22.038484 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a17d6730-f0c2-4503-84aa-e2cb2ef0321c tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:22.039249 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a17d6730-f0c2-4503-84aa-e2cb2ef0321c tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:22.039675 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a17d6730-f0c2-4503-84aa-e2cb2ef0321c tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:22.168634 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-a17d6730-f0c2-4503-84aa-e2cb2ef0321c tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:22:22.176794 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-a17d6730-f0c2-4503-84aa-e2cb2ef0321c tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.149127 Nov 09 20:22:22.177354 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 787/1544] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:22:22 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:22:22.448915 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-793e7cbd-0c2f-4a93-b4bf-e66aa2b5621a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:22:22.449953 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-793e7cbd-0c2f-4a93-b4bf-e66aa2b5621a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:22:22.456226 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-793e7cbd-0c2f-4a93-b4bf-e66aa2b5621a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:22.456705 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-793e7cbd-0c2f-4a93-b4bf-e66aa2b5621a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:22.457482 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-793e7cbd-0c2f-4a93-b4bf-e66aa2b5621a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:22.457914 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-793e7cbd-0c2f-4a93-b4bf-e66aa2b5621a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:22.487464 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-793e7cbd-0c2f-4a93-b4bf-e66aa2b5621a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042342 Nov 09 20:22:22.488263 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 758/1545] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:22:22 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:22:23.194090 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-fee32f92-2f41-4f42-bc4c-95b9802bfc90 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:22:23.194725 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-fee32f92-2f41-4f42-bc4c-95b9802bfc90 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:22:23.200969 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-fee32f92-2f41-4f42-bc4c-95b9802bfc90 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:23.201411 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-fee32f92-2f41-4f42-bc4c-95b9802bfc90 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:23.202163 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-fee32f92-2f41-4f42-bc4c-95b9802bfc90 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:23.203210 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-fee32f92-2f41-4f42-bc4c-95b9802bfc90 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:23.335911 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-fee32f92-2f41-4f42-bc4c-95b9802bfc90 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:22:23.344048 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-fee32f92-2f41-4f42-bc4c-95b9802bfc90 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.153625 Nov 09 20:22:23.344635 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 788/1546] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:22:23 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:22:23.498746 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-0499b6e9-8ba8-42c7-a363-8123006e8212 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:22:23.500354 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-0499b6e9-8ba8-42c7-a363-8123006e8212 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:22:23.506527 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0499b6e9-8ba8-42c7-a363-8123006e8212 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:23.506963 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0499b6e9-8ba8-42c7-a363-8123006e8212 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:23.507717 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0499b6e9-8ba8-42c7-a363-8123006e8212 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:23.508138 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0499b6e9-8ba8-42c7-a363-8123006e8212 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:23.536207 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-0499b6e9-8ba8-42c7-a363-8123006e8212 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041147 Nov 09 20:22:23.536783 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 759/1547] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:22:23 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:22:24.361681 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-cf85edf5-6a9f-4666-b90b-010586cd93d7 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:22:24.362282 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-cf85edf5-6a9f-4666-b90b-010586cd93d7 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:22:24.368770 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-cf85edf5-6a9f-4666-b90b-010586cd93d7 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:24.369274 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-cf85edf5-6a9f-4666-b90b-010586cd93d7 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:24.370053 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-cf85edf5-6a9f-4666-b90b-010586cd93d7 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:24.370479 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-cf85edf5-6a9f-4666-b90b-010586cd93d7 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:24.512933 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-cf85edf5-6a9f-4666-b90b-010586cd93d7 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:22:24.520857 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-cf85edf5-6a9f-4666-b90b-010586cd93d7 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.163418 Nov 09 20:22:24.521416 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 789/1548] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:22:24 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:22:24.547584 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-1fac40e2-7dc6-4cd1-a80d-27cc596b8572 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:22:24.548507 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-1fac40e2-7dc6-4cd1-a80d-27cc596b8572 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:22:24.554547 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1fac40e2-7dc6-4cd1-a80d-27cc596b8572 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:24.554982 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1fac40e2-7dc6-4cd1-a80d-27cc596b8572 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:24.555739 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1fac40e2-7dc6-4cd1-a80d-27cc596b8572 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:24.556160 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1fac40e2-7dc6-4cd1-a80d-27cc596b8572 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:24.583543 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-1fac40e2-7dc6-4cd1-a80d-27cc596b8572 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040489 Nov 09 20:22:24.584078 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 760/1549] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:22:24 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:22:25.537455 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-67f94a28-741c-442f-be2c-d960200913a2 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:22:25.538154 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-67f94a28-741c-442f-be2c-d960200913a2 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:22:25.544481 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-67f94a28-741c-442f-be2c-d960200913a2 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:25.544988 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-67f94a28-741c-442f-be2c-d960200913a2 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:25.545697 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-67f94a28-741c-442f-be2c-d960200913a2 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:25.546633 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-67f94a28-741c-442f-be2c-d960200913a2 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:25.595783 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-271fd058-12f0-48cf-8b1d-12e6f23a1de1 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:22:25.596712 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-271fd058-12f0-48cf-8b1d-12e6f23a1de1 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:22:25.602834 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-271fd058-12f0-48cf-8b1d-12e6f23a1de1 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:25.603273 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-271fd058-12f0-48cf-8b1d-12e6f23a1de1 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:25.604035 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-271fd058-12f0-48cf-8b1d-12e6f23a1de1 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:25.604516 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-271fd058-12f0-48cf-8b1d-12e6f23a1de1 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:25.634392 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-271fd058-12f0-48cf-8b1d-12e6f23a1de1 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043417 Nov 09 20:22:25.634949 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 761/1550] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:22:25 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 20:22:25.674651 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-67f94a28-741c-442f-be2c-d960200913a2 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:22:25.682667 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-67f94a28-741c-442f-be2c-d960200913a2 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.148837 Nov 09 20:22:25.683231 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 790/1551] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:22:25 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:22:26.646259 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-41ad9381-5fa0-462d-ae58-dd77ca241240 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:22:26.647149 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-41ad9381-5fa0-462d-ae58-dd77ca241240 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:22:26.653083 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-41ad9381-5fa0-462d-ae58-dd77ca241240 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:26.653545 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-41ad9381-5fa0-462d-ae58-dd77ca241240 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:26.654288 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-41ad9381-5fa0-462d-ae58-dd77ca241240 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:26.654715 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-41ad9381-5fa0-462d-ae58-dd77ca241240 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:26.682559 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-41ad9381-5fa0-462d-ae58-dd77ca241240 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040086 Nov 09 20:22:26.683101 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 762/1552] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:22:26 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 20:22:26.700487 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-5b161ecb-cde3-47cd-ab99-4e9ce6eba6d0 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:22:26.701152 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-5b161ecb-cde3-47cd-ab99-4e9ce6eba6d0 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:22:26.708222 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-5b161ecb-cde3-47cd-ab99-4e9ce6eba6d0 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:26.708693 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-5b161ecb-cde3-47cd-ab99-4e9ce6eba6d0 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:26.709460 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-5b161ecb-cde3-47cd-ab99-4e9ce6eba6d0 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:26.709886 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-5b161ecb-cde3-47cd-ab99-4e9ce6eba6d0 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:26.839186 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-5b161ecb-cde3-47cd-ab99-4e9ce6eba6d0 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:22:26.847044 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-5b161ecb-cde3-47cd-ab99-4e9ce6eba6d0 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.150308 Nov 09 20:22:26.847598 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 791/1553] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:22:26 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:22:27.694014 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-6cc89637-0526-4468-9d93-32d21fb09aa5 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:22:27.694918 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-6cc89637-0526-4468-9d93-32d21fb09aa5 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:22:27.701070 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6cc89637-0526-4468-9d93-32d21fb09aa5 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:27.701518 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6cc89637-0526-4468-9d93-32d21fb09aa5 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:27.702314 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6cc89637-0526-4468-9d93-32d21fb09aa5 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:27.703012 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6cc89637-0526-4468-9d93-32d21fb09aa5 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:27.731212 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-6cc89637-0526-4468-9d93-32d21fb09aa5 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041143 Nov 09 20:22:27.731756 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 763/1554] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:22:27 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:22:27.864537 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-d7565e36-1455-4893-8f32-50d8af1a1a87 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:22:27.865140 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-d7565e36-1455-4893-8f32-50d8af1a1a87 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:22:27.871293 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d7565e36-1455-4893-8f32-50d8af1a1a87 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:27.871733 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d7565e36-1455-4893-8f32-50d8af1a1a87 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:27.872514 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d7565e36-1455-4893-8f32-50d8af1a1a87 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:27.872940 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d7565e36-1455-4893-8f32-50d8af1a1a87 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:27.999020 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-d7565e36-1455-4893-8f32-50d8af1a1a87 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:22:28.006736 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-d7565e36-1455-4893-8f32-50d8af1a1a87 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.146342 Nov 09 20:22:28.007290 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 792/1555] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:22:27 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:22:28.743113 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-67996209-b298-4d1d-9c78-de0be92ed9ca tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:22:28.744043 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-67996209-b298-4d1d-9c78-de0be92ed9ca tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:22:28.751055 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-67996209-b298-4d1d-9c78-de0be92ed9ca tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:28.751499 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-67996209-b298-4d1d-9c78-de0be92ed9ca tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:28.752264 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-67996209-b298-4d1d-9c78-de0be92ed9ca tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:28.752723 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-67996209-b298-4d1d-9c78-de0be92ed9ca tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:28.781237 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-67996209-b298-4d1d-9c78-de0be92ed9ca tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041492 Nov 09 20:22:28.781788 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 764/1556] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:22:28 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:22:29.024205 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-1d5f0e47-3b96-43ec-a7bd-8bc9a5310abc tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:22:29.024783 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-1d5f0e47-3b96-43ec-a7bd-8bc9a5310abc tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:22:29.032006 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-1d5f0e47-3b96-43ec-a7bd-8bc9a5310abc tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:29.032481 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-1d5f0e47-3b96-43ec-a7bd-8bc9a5310abc tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:29.033254 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-1d5f0e47-3b96-43ec-a7bd-8bc9a5310abc tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:29.033688 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-1d5f0e47-3b96-43ec-a7bd-8bc9a5310abc tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:29.167319 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-1d5f0e47-3b96-43ec-a7bd-8bc9a5310abc tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:22:29.176115 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-1d5f0e47-3b96-43ec-a7bd-8bc9a5310abc tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.155590 Nov 09 20:22:29.176710 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 793/1557] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:22:29 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:22:29.792168 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-eb4c16be-c8cb-466e-a1e8-e367a999f73d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:22:29.793107 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-eb4c16be-c8cb-466e-a1e8-e367a999f73d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:22:29.799557 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-eb4c16be-c8cb-466e-a1e8-e367a999f73d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:29.799995 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-eb4c16be-c8cb-466e-a1e8-e367a999f73d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:29.800801 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-eb4c16be-c8cb-466e-a1e8-e367a999f73d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:29.801230 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-eb4c16be-c8cb-466e-a1e8-e367a999f73d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:29.830463 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-eb4c16be-c8cb-466e-a1e8-e367a999f73d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041951 Nov 09 20:22:29.831000 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 765/1558] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:22:29 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:22:30.193682 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-c3fd8bf1-7078-47f8-8422-566869157ec0 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:22:30.194291 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-c3fd8bf1-7078-47f8-8422-566869157ec0 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:22:30.200810 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c3fd8bf1-7078-47f8-8422-566869157ec0 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:30.201256 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c3fd8bf1-7078-47f8-8422-566869157ec0 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:30.202029 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c3fd8bf1-7078-47f8-8422-566869157ec0 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:30.202552 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c3fd8bf1-7078-47f8-8422-566869157ec0 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:30.331722 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-c3fd8bf1-7078-47f8-8422-566869157ec0 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:22:30.339351 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-c3fd8bf1-7078-47f8-8422-566869157ec0 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.149345 Nov 09 20:22:30.340126 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 794/1559] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:22:30 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:22:30.841612 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-35d5a154-dd54-4d89-8f5e-bbd680919cf4 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:22:30.842509 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-35d5a154-dd54-4d89-8f5e-bbd680919cf4 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:22:30.849495 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-35d5a154-dd54-4d89-8f5e-bbd680919cf4 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:30.849935 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-35d5a154-dd54-4d89-8f5e-bbd680919cf4 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:30.850699 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-35d5a154-dd54-4d89-8f5e-bbd680919cf4 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:30.851133 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-35d5a154-dd54-4d89-8f5e-bbd680919cf4 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:30.879202 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-35d5a154-dd54-4d89-8f5e-bbd680919cf4 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041300 Nov 09 20:22:30.879734 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 766/1560] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:22:30 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:22:31.355899 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-970c77c0-2398-4528-ab09-38406ffe0311 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:22:31.356524 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-970c77c0-2398-4528-ab09-38406ffe0311 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:22:31.363087 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-970c77c0-2398-4528-ab09-38406ffe0311 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:31.363786 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-970c77c0-2398-4528-ab09-38406ffe0311 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:31.364579 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-970c77c0-2398-4528-ab09-38406ffe0311 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:31.365007 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-970c77c0-2398-4528-ab09-38406ffe0311 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:31.495450 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-970c77c0-2398-4528-ab09-38406ffe0311 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:22:31.503765 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-970c77c0-2398-4528-ab09-38406ffe0311 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.151513 Nov 09 20:22:31.504327 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 795/1561] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:22:31 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:22:31.890301 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-e765c881-9294-4248-bab9-b5a1027c3d73 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:22:31.891194 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-e765c881-9294-4248-bab9-b5a1027c3d73 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:22:31.897337 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e765c881-9294-4248-bab9-b5a1027c3d73 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:31.897777 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e765c881-9294-4248-bab9-b5a1027c3d73 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:31.898532 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e765c881-9294-4248-bab9-b5a1027c3d73 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:31.898962 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e765c881-9294-4248-bab9-b5a1027c3d73 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:31.927227 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-e765c881-9294-4248-bab9-b5a1027c3d73 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040680 Nov 09 20:22:31.927767 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 767/1562] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:22:31 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:22:32.520331 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-e35f7d3f-b24d-4611-a946-0651eafefc04 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:22:32.520964 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-e35f7d3f-b24d-4611-a946-0651eafefc04 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:22:32.527094 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e35f7d3f-b24d-4611-a946-0651eafefc04 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:32.527571 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e35f7d3f-b24d-4611-a946-0651eafefc04 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:32.528331 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e35f7d3f-b24d-4611-a946-0651eafefc04 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:32.528780 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e35f7d3f-b24d-4611-a946-0651eafefc04 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:32.655874 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-e35f7d3f-b24d-4611-a946-0651eafefc04 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:22:32.663499 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-e35f7d3f-b24d-4611-a946-0651eafefc04 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.146808 Nov 09 20:22:32.664055 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 796/1563] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:22:32 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:22:32.938956 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-70fcc4a4-c83f-48eb-ab3a-4623af7e877d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:22:32.939936 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-70fcc4a4-c83f-48eb-ab3a-4623af7e877d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:22:32.946115 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-70fcc4a4-c83f-48eb-ab3a-4623af7e877d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:32.946560 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-70fcc4a4-c83f-48eb-ab3a-4623af7e877d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:32.947331 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-70fcc4a4-c83f-48eb-ab3a-4623af7e877d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:32.947760 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-70fcc4a4-c83f-48eb-ab3a-4623af7e877d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:32.976368 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-70fcc4a4-c83f-48eb-ab3a-4623af7e877d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041842 Nov 09 20:22:32.976939 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 768/1564] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:22:32 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:22:33.680995 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-f8256dbf-a00c-4bce-a78e-45a0b4f733e9 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:22:33.681595 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-f8256dbf-a00c-4bce-a78e-45a0b4f733e9 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:22:33.687644 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f8256dbf-a00c-4bce-a78e-45a0b4f733e9 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:33.688181 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f8256dbf-a00c-4bce-a78e-45a0b4f733e9 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:33.693251 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f8256dbf-a00c-4bce-a78e-45a0b4f733e9 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:33.693727 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f8256dbf-a00c-4bce-a78e-45a0b4f733e9 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:33.819124 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-f8256dbf-a00c-4bce-a78e-45a0b4f733e9 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:22:33.826789 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-f8256dbf-a00c-4bce-a78e-45a0b4f733e9 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.149463 Nov 09 20:22:33.827344 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 797/1565] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:22:33 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:22:33.986819 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-093dccf3-772b-4147-acaf-af218b338d37 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:22:33.987722 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-093dccf3-772b-4147-acaf-af218b338d37 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:22:33.994153 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-093dccf3-772b-4147-acaf-af218b338d37 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:33.994599 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-093dccf3-772b-4147-acaf-af218b338d37 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:33.995371 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-093dccf3-772b-4147-acaf-af218b338d37 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:33.995800 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-093dccf3-772b-4147-acaf-af218b338d37 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:34.024389 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-093dccf3-772b-4147-acaf-af218b338d37 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041297 Nov 09 20:22:34.024953 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 769/1566] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:22:33 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:22:34.845232 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-8f68471e-a532-493e-8f21-6b9201529b22 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:22:34.845845 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-8f68471e-a532-493e-8f21-6b9201529b22 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:22:34.852292 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-8f68471e-a532-493e-8f21-6b9201529b22 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:34.852763 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-8f68471e-a532-493e-8f21-6b9201529b22 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:34.853533 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-8f68471e-a532-493e-8f21-6b9201529b22 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:34.853959 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-8f68471e-a532-493e-8f21-6b9201529b22 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:34.991626 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-8f68471e-a532-493e-8f21-6b9201529b22 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:22:34.999671 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-8f68471e-a532-493e-8f21-6b9201529b22 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.158720 Nov 09 20:22:35.000222 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 798/1567] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:22:34 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:22:35.036007 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-d43ac825-c348-4055-b9c8-ac59f99d2d2a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:22:35.036957 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-d43ac825-c348-4055-b9c8-ac59f99d2d2a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:22:35.043130 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d43ac825-c348-4055-b9c8-ac59f99d2d2a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:35.043579 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d43ac825-c348-4055-b9c8-ac59f99d2d2a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:35.044352 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d43ac825-c348-4055-b9c8-ac59f99d2d2a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:35.044816 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d43ac825-c348-4055-b9c8-ac59f99d2d2a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:35.073215 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-d43ac825-c348-4055-b9c8-ac59f99d2d2a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041468 Nov 09 20:22:35.073753 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 770/1568] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:22:35 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:22:36.015953 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-9e35722f-a192-4937-bb3b-7e5e3627db1c tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:22:36.016764 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-9e35722f-a192-4937-bb3b-7e5e3627db1c tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:22:36.022927 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-9e35722f-a192-4937-bb3b-7e5e3627db1c tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:36.023369 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-9e35722f-a192-4937-bb3b-7e5e3627db1c tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:36.024145 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-9e35722f-a192-4937-bb3b-7e5e3627db1c tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:36.024608 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-9e35722f-a192-4937-bb3b-7e5e3627db1c tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:36.084605 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-944fe1be-e3c3-4b13-84ff-5aa40d49f85c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:22:36.085516 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-944fe1be-e3c3-4b13-84ff-5aa40d49f85c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:22:36.091590 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-944fe1be-e3c3-4b13-84ff-5aa40d49f85c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:36.092090 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-944fe1be-e3c3-4b13-84ff-5aa40d49f85c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:36.092894 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-944fe1be-e3c3-4b13-84ff-5aa40d49f85c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:36.093326 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-944fe1be-e3c3-4b13-84ff-5aa40d49f85c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:36.124044 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-944fe1be-e3c3-4b13-84ff-5aa40d49f85c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043169 Nov 09 20:22:36.124881 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 771/1569] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:22:36 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 20:22:36.156394 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-9e35722f-a192-4937-bb3b-7e5e3627db1c tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:22:36.164351 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-9e35722f-a192-4937-bb3b-7e5e3627db1c tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.151933 Nov 09 20:22:36.164942 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 799/1570] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:22:36 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:22:37.136070 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-84fbb05b-0ec9-4e27-998c-95116772d6df tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:22:37.137006 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-84fbb05b-0ec9-4e27-998c-95116772d6df tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:22:37.143874 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-84fbb05b-0ec9-4e27-998c-95116772d6df tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:37.144322 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-84fbb05b-0ec9-4e27-998c-95116772d6df tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:37.145127 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-84fbb05b-0ec9-4e27-998c-95116772d6df tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:37.145562 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-84fbb05b-0ec9-4e27-998c-95116772d6df tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:37.173681 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-84fbb05b-0ec9-4e27-998c-95116772d6df tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041277 Nov 09 20:22:37.174222 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 772/1571] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:22:37 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:22:37.181890 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-ee32cdae-c886-4ee7-9a97-c170f51c7080 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:22:37.182524 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-ee32cdae-c886-4ee7-9a97-c170f51c7080 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:22:37.189290 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ee32cdae-c886-4ee7-9a97-c170f51c7080 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:37.189733 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ee32cdae-c886-4ee7-9a97-c170f51c7080 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:37.190504 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ee32cdae-c886-4ee7-9a97-c170f51c7080 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:37.190935 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ee32cdae-c886-4ee7-9a97-c170f51c7080 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:37.322715 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-ee32cdae-c886-4ee7-9a97-c170f51c7080 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:22:37.330941 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-ee32cdae-c886-4ee7-9a97-c170f51c7080 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.152706 Nov 09 20:22:37.331494 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 800/1572] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:22:37 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:22:38.185072 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-3b6fa1c1-6d79-4b18-bf2d-1c4822a14fdb tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:22:38.185973 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-3b6fa1c1-6d79-4b18-bf2d-1c4822a14fdb tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:22:38.192169 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3b6fa1c1-6d79-4b18-bf2d-1c4822a14fdb tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:38.192641 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3b6fa1c1-6d79-4b18-bf2d-1c4822a14fdb tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:38.193400 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3b6fa1c1-6d79-4b18-bf2d-1c4822a14fdb tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:38.193825 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3b6fa1c1-6d79-4b18-bf2d-1c4822a14fdb tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:38.222281 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-3b6fa1c1-6d79-4b18-bf2d-1c4822a14fdb tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040994 Nov 09 20:22:38.222847 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 773/1573] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:22:38 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:22:38.348459 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-b3a5dce8-8be7-4e6b-bf86-9c4e2a8728a1 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:22:38.349073 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-b3a5dce8-8be7-4e6b-bf86-9c4e2a8728a1 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:22:38.355252 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b3a5dce8-8be7-4e6b-bf86-9c4e2a8728a1 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:38.355705 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b3a5dce8-8be7-4e6b-bf86-9c4e2a8728a1 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:38.356517 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b3a5dce8-8be7-4e6b-bf86-9c4e2a8728a1 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:38.356955 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b3a5dce8-8be7-4e6b-bf86-9c4e2a8728a1 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:38.482524 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-b3a5dce8-8be7-4e6b-bf86-9c4e2a8728a1 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:22:38.490480 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-b3a5dce8-8be7-4e6b-bf86-9c4e2a8728a1 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.146341 Nov 09 20:22:38.491030 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 801/1574] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:22:38 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:22:39.075899 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 09 20:22:39.076162 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: Tue Nov 9 20:22:39 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 09 20:22:39.232584 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-9fcf6413-3fa8-4f37-83ec-05ed39c3f199 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:22:39.233488 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-9fcf6413-3fa8-4f37-83ec-05ed39c3f199 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:22:39.245643 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9fcf6413-3fa8-4f37-83ec-05ed39c3f199 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:39.246091 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9fcf6413-3fa8-4f37-83ec-05ed39c3f199 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:39.246875 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9fcf6413-3fa8-4f37-83ec-05ed39c3f199 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:39.247305 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9fcf6413-3fa8-4f37-83ec-05ed39c3f199 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:39.277470 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-9fcf6413-3fa8-4f37-83ec-05ed39c3f199 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048595 Nov 09 20:22:39.278016 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 774/1575] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:22:39 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:22:39.507606 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-226a0f60-2af8-442b-a76c-26c5bf70ffde tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:22:39.508245 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-226a0f60-2af8-442b-a76c-26c5bf70ffde tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:22:39.514528 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-226a0f60-2af8-442b-a76c-26c5bf70ffde tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:39.514971 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-226a0f60-2af8-442b-a76c-26c5bf70ffde tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:39.515744 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-226a0f60-2af8-442b-a76c-26c5bf70ffde tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:39.516176 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-226a0f60-2af8-442b-a76c-26c5bf70ffde tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:39.642643 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-226a0f60-2af8-442b-a76c-26c5bf70ffde tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:22:39.650298 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-226a0f60-2af8-442b-a76c-26c5bf70ffde tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.146347 Nov 09 20:22:39.650858 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 802/1576] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:22:39 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:22:40.289003 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-0ff205ba-e12b-422a-94f8-2f59f588d89b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:22:40.289909 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-0ff205ba-e12b-422a-94f8-2f59f588d89b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:22:40.296187 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0ff205ba-e12b-422a-94f8-2f59f588d89b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:40.296659 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0ff205ba-e12b-422a-94f8-2f59f588d89b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:40.297431 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0ff205ba-e12b-422a-94f8-2f59f588d89b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:40.297935 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0ff205ba-e12b-422a-94f8-2f59f588d89b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:40.327486 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-0ff205ba-e12b-422a-94f8-2f59f588d89b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042284 Nov 09 20:22:40.328024 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 775/1577] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:22:40 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:22:40.667787 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-a5c018e4-22e2-475d-8781-61ca722ff4a4 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:22:40.668414 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-a5c018e4-22e2-475d-8781-61ca722ff4a4 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:22:40.675446 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a5c018e4-22e2-475d-8781-61ca722ff4a4 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:40.676033 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a5c018e4-22e2-475d-8781-61ca722ff4a4 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:40.676846 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a5c018e4-22e2-475d-8781-61ca722ff4a4 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:40.677280 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a5c018e4-22e2-475d-8781-61ca722ff4a4 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:40.807104 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-a5c018e4-22e2-475d-8781-61ca722ff4a4 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:22:40.815456 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-a5c018e4-22e2-475d-8781-61ca722ff4a4 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.151348 Nov 09 20:22:40.816008 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 803/1578] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:22:40 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:22:41.338741 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-ff2eef3b-d0d2-4465-8e27-674b7c61feaa tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:22:41.339662 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-ff2eef3b-d0d2-4465-8e27-674b7c61feaa tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:22:41.346194 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ff2eef3b-d0d2-4465-8e27-674b7c61feaa tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:41.346635 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ff2eef3b-d0d2-4465-8e27-674b7c61feaa tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:41.347415 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ff2eef3b-d0d2-4465-8e27-674b7c61feaa tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:41.347850 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ff2eef3b-d0d2-4465-8e27-674b7c61feaa tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:41.373532 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: ERROR oslo.messaging._drivers.impl_rabbit [None req-ff2eef3b-d0d2-4465-8e27-674b7c61feaa tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [e74ec4ee-5a2c-4e9b-a3cb-77ede2633c68] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 09 20:22:41.832710 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-ffe50623-0f37-4fdb-b040-56914b23695b tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:22:41.833322 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-ffe50623-0f37-4fdb-b040-56914b23695b tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:22:41.839557 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ffe50623-0f37-4fdb-b040-56914b23695b tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:41.840000 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ffe50623-0f37-4fdb-b040-56914b23695b tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:41.840801 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ffe50623-0f37-4fdb-b040-56914b23695b tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:41.841235 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ffe50623-0f37-4fdb-b040-56914b23695b tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:41.966058 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-ffe50623-0f37-4fdb-b040-56914b23695b tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:22:41.974003 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-ffe50623-0f37-4fdb-b040-56914b23695b tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.145520 Nov 09 20:22:41.974573 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 804/1579] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:22:41 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 20:22:42.389764 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO oslo.messaging._drivers.impl_rabbit [None req-ff2eef3b-d0d2-4465-8e27-674b7c61feaa tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [e74ec4ee-5a2c-4e9b-a3cb-77ede2633c68] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 38922. Nov 09 20:22:42.449126 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-ff2eef3b-d0d2-4465-8e27-674b7c61feaa tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "POST /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/action" status: 200 len: 76819 microversion: 2.1 time: 1.113893 Nov 09 20:22:42.449786 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 776/1580] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Nov 9 20:22:41 2021] POST /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6/action => generated 76819 bytes in 1115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 20:22:42.990523 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-aa1330a4-5c7d-4d6b-b9c3-f28071dde8b1 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:22:42.991156 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-aa1330a4-5c7d-4d6b-b9c3-f28071dde8b1 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:22:42.997350 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-aa1330a4-5c7d-4d6b-b9c3-f28071dde8b1 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:42.997799 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-aa1330a4-5c7d-4d6b-b9c3-f28071dde8b1 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:42.998563 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-aa1330a4-5c7d-4d6b-b9c3-f28071dde8b1 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:42.998995 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-aa1330a4-5c7d-4d6b-b9c3-f28071dde8b1 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:43.129449 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-aa1330a4-5c7d-4d6b-b9c3-f28071dde8b1 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:22:43.137241 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-aa1330a4-5c7d-4d6b-b9c3-f28071dde8b1 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.150553 Nov 09 20:22:43.137806 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 805/1581] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:22:42 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:22:44.155228 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-50103368-7243-4c5c-942d-7c5dfcfa1681 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:22:44.155918 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-50103368-7243-4c5c-942d-7c5dfcfa1681 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:22:44.163254 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-50103368-7243-4c5c-942d-7c5dfcfa1681 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:44.163700 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-50103368-7243-4c5c-942d-7c5dfcfa1681 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:44.164505 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-50103368-7243-4c5c-942d-7c5dfcfa1681 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:44.164942 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-50103368-7243-4c5c-942d-7c5dfcfa1681 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:44.295833 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-50103368-7243-4c5c-942d-7c5dfcfa1681 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:22:44.303954 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-50103368-7243-4c5c-942d-7c5dfcfa1681 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.152719 Nov 09 20:22:44.304542 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 777/1582] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:22:44 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:22:45.320987 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-b80f142f-cd20-42a8-9c0c-37b41d58b6ab tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:22:45.321600 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-b80f142f-cd20-42a8-9c0c-37b41d58b6ab tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:22:45.327420 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b80f142f-cd20-42a8-9c0c-37b41d58b6ab tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:45.327866 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b80f142f-cd20-42a8-9c0c-37b41d58b6ab tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:45.328679 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b80f142f-cd20-42a8-9c0c-37b41d58b6ab tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:45.329781 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b80f142f-cd20-42a8-9c0c-37b41d58b6ab tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:45.461342 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-b80f142f-cd20-42a8-9c0c-37b41d58b6ab tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:22:45.468960 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-b80f142f-cd20-42a8-9c0c-37b41d58b6ab tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.151778 Nov 09 20:22:45.469520 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 806/1583] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:22:45 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:22:45.591368 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 09 20:22:45.591549 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: Tue Nov 9 20:22:45 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 09 20:22:46.485942 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-018118a0-ce29-4d8e-b6d4-ce5e5632735e tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:22:46.486581 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-018118a0-ce29-4d8e-b6d4-ce5e5632735e tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:22:46.492988 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-018118a0-ce29-4d8e-b6d4-ce5e5632735e tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:46.493426 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-018118a0-ce29-4d8e-b6d4-ce5e5632735e tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:46.494193 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-018118a0-ce29-4d8e-b6d4-ce5e5632735e tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:46.494652 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-018118a0-ce29-4d8e-b6d4-ce5e5632735e tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:46.625183 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-018118a0-ce29-4d8e-b6d4-ce5e5632735e tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:22:46.632763 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-018118a0-ce29-4d8e-b6d4-ce5e5632735e tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.150651 Nov 09 20:22:46.633328 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 778/1584] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:22:46 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:22:47.650107 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-9cdbe2c5-bfd8-4db6-b4a8-02b5c25a6f2a tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:22:47.650708 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-9cdbe2c5-bfd8-4db6-b4a8-02b5c25a6f2a tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:22:47.656988 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-9cdbe2c5-bfd8-4db6-b4a8-02b5c25a6f2a tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:47.657958 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-9cdbe2c5-bfd8-4db6-b4a8-02b5c25a6f2a tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:47.658686 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-9cdbe2c5-bfd8-4db6-b4a8-02b5c25a6f2a tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:47.659109 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-9cdbe2c5-bfd8-4db6-b4a8-02b5c25a6f2a tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:47.789971 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-9cdbe2c5-bfd8-4db6-b4a8-02b5c25a6f2a tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:22:47.799117 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-9cdbe2c5-bfd8-4db6-b4a8-02b5c25a6f2a tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.151382 Nov 09 20:22:47.799659 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 807/1585] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:22:47 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:22:48.815729 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-beabde9a-b01b-4129-8fcd-40b41f57d390 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:22:48.816331 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-beabde9a-b01b-4129-8fcd-40b41f57d390 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:22:48.823162 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-beabde9a-b01b-4129-8fcd-40b41f57d390 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:48.823541 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-beabde9a-b01b-4129-8fcd-40b41f57d390 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:48.824295 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-beabde9a-b01b-4129-8fcd-40b41f57d390 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:48.824742 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-beabde9a-b01b-4129-8fcd-40b41f57d390 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:48.952959 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-beabde9a-b01b-4129-8fcd-40b41f57d390 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:22:48.960518 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-beabde9a-b01b-4129-8fcd-40b41f57d390 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.148494 Nov 09 20:22:48.961077 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 779/1586] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:22:48 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:22:49.976697 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-31ff2d66-6cb9-4cb0-b495-b95ea2c281bd tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:22:49.977293 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-31ff2d66-6cb9-4cb0-b495-b95ea2c281bd tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:22:49.983375 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-31ff2d66-6cb9-4cb0-b495-b95ea2c281bd tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:49.984030 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-31ff2d66-6cb9-4cb0-b495-b95ea2c281bd tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:49.984657 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-31ff2d66-6cb9-4cb0-b495-b95ea2c281bd tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:49.985080 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-31ff2d66-6cb9-4cb0-b495-b95ea2c281bd tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:50.114857 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-31ff2d66-6cb9-4cb0-b495-b95ea2c281bd tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:22:50.122449 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-31ff2d66-6cb9-4cb0-b495-b95ea2c281bd tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.149500 Nov 09 20:22:50.122997 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 808/1587] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:22:49 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:22:51.139254 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-29e0f8af-7fa4-463a-956f-04f4802f5872 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:22:51.139842 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-29e0f8af-7fa4-463a-956f-04f4802f5872 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:22:51.146358 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-29e0f8af-7fa4-463a-956f-04f4802f5872 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:51.146885 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-29e0f8af-7fa4-463a-956f-04f4802f5872 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:51.147574 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-29e0f8af-7fa4-463a-956f-04f4802f5872 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:51.148013 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-29e0f8af-7fa4-463a-956f-04f4802f5872 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:51.279675 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-29e0f8af-7fa4-463a-956f-04f4802f5872 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:22:51.287582 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-29e0f8af-7fa4-463a-956f-04f4802f5872 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.151977 Nov 09 20:22:51.288151 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 780/1588] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:22:51 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:22:52.196603 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 09 20:22:52.197272 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: Tue Nov 9 20:22:52 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 09 20:22:52.304675 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-c99a766e-2dd4-4f97-a58f-93d4b582415d tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:22:52.305297 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-c99a766e-2dd4-4f97-a58f-93d4b582415d tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:22:52.311552 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c99a766e-2dd4-4f97-a58f-93d4b582415d tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:52.311990 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c99a766e-2dd4-4f97-a58f-93d4b582415d tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:52.312788 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c99a766e-2dd4-4f97-a58f-93d4b582415d tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:52.313717 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c99a766e-2dd4-4f97-a58f-93d4b582415d tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:52.443612 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-c99a766e-2dd4-4f97-a58f-93d4b582415d tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:22:52.451541 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-c99a766e-2dd4-4f97-a58f-93d4b582415d tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.150767 Nov 09 20:22:52.452108 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 809/1589] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:22:52 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:22:53.468932 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-ffea0b7d-116d-4db2-beda-8d6604ab9954 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:22:53.469529 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-ffea0b7d-116d-4db2-beda-8d6604ab9954 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:22:53.476679 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ffea0b7d-116d-4db2-beda-8d6604ab9954 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:53.477120 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ffea0b7d-116d-4db2-beda-8d6604ab9954 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:53.477886 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ffea0b7d-116d-4db2-beda-8d6604ab9954 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:53.478318 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ffea0b7d-116d-4db2-beda-8d6604ab9954 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:53.608025 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-ffea0b7d-116d-4db2-beda-8d6604ab9954 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:22:53.616852 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-ffea0b7d-116d-4db2-beda-8d6604ab9954 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.151507 Nov 09 20:22:53.617415 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 781/1590] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:22:53 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:22:54.634594 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-574caa12-39c6-4319-ac6f-7591746e445a tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:22:54.635351 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-574caa12-39c6-4319-ac6f-7591746e445a tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:22:54.641587 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-574caa12-39c6-4319-ac6f-7591746e445a tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:54.643237 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-574caa12-39c6-4319-ac6f-7591746e445a tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:54.643237 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-574caa12-39c6-4319-ac6f-7591746e445a tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:54.644699 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-574caa12-39c6-4319-ac6f-7591746e445a tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:54.778197 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-574caa12-39c6-4319-ac6f-7591746e445a tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:22:54.786651 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-574caa12-39c6-4319-ac6f-7591746e445a tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.155849 Nov 09 20:22:54.787212 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 810/1591] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:22:54 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:22:55.803900 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-ee47c1dc-ca29-420e-a583-7d609ebedc15 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:22:55.804540 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-ee47c1dc-ca29-420e-a583-7d609ebedc15 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:22:55.810724 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ee47c1dc-ca29-420e-a583-7d609ebedc15 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:55.811200 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ee47c1dc-ca29-420e-a583-7d609ebedc15 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:55.811962 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ee47c1dc-ca29-420e-a583-7d609ebedc15 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:55.812391 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ee47c1dc-ca29-420e-a583-7d609ebedc15 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:55.941849 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-ee47c1dc-ca29-420e-a583-7d609ebedc15 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:22:55.949790 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-ee47c1dc-ca29-420e-a583-7d609ebedc15 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.149554 Nov 09 20:22:55.950347 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 782/1592] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:22:55 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:22:56.966069 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-a6d4ade9-a2ef-4690-a1c9-a09c0babebe3 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:22:56.966681 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-a6d4ade9-a2ef-4690-a1c9-a09c0babebe3 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:22:56.973042 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a6d4ade9-a2ef-4690-a1c9-a09c0babebe3 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:56.973489 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a6d4ade9-a2ef-4690-a1c9-a09c0babebe3 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:56.974270 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a6d4ade9-a2ef-4690-a1c9-a09c0babebe3 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:56.974702 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a6d4ade9-a2ef-4690-a1c9-a09c0babebe3 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:57.106872 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-a6d4ade9-a2ef-4690-a1c9-a09c0babebe3 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:22:57.115431 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-a6d4ade9-a2ef-4690-a1c9-a09c0babebe3 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.153063 Nov 09 20:22:57.115991 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 811/1593] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:22:56 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:22:58.132780 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-70b2224b-983a-4b71-8650-076fe625adbe tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:22:58.133417 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-70b2224b-983a-4b71-8650-076fe625adbe tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:22:58.139459 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-70b2224b-983a-4b71-8650-076fe625adbe tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:58.139898 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-70b2224b-983a-4b71-8650-076fe625adbe tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:58.140689 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-70b2224b-983a-4b71-8650-076fe625adbe tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:58.141119 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-70b2224b-983a-4b71-8650-076fe625adbe tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:58.267075 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-70b2224b-983a-4b71-8650-076fe625adbe tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:22:58.275303 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-70b2224b-983a-4b71-8650-076fe625adbe tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.146021 Nov 09 20:22:58.275850 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 783/1594] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:22:58 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:22:59.292022 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-479f666f-e39c-443b-91f9-9b73270c0115 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:22:59.292656 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-479f666f-e39c-443b-91f9-9b73270c0115 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:22:59.298970 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-479f666f-e39c-443b-91f9-9b73270c0115 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:59.299434 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-479f666f-e39c-443b-91f9-9b73270c0115 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:59.300214 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-479f666f-e39c-443b-91f9-9b73270c0115 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:22:59.300684 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-479f666f-e39c-443b-91f9-9b73270c0115 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:22:59.431774 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-479f666f-e39c-443b-91f9-9b73270c0115 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:22:59.439610 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-479f666f-e39c-443b-91f9-9b73270c0115 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.151067 Nov 09 20:22:59.440165 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 812/1595] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:22:59 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:23:00.456310 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-b9b36f02-5599-47d2-b757-e2209ff27977 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:23:00.456945 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-b9b36f02-5599-47d2-b757-e2209ff27977 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:23:00.463176 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b9b36f02-5599-47d2-b757-e2209ff27977 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:23:00.463621 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b9b36f02-5599-47d2-b757-e2209ff27977 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:23:00.464389 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b9b36f02-5599-47d2-b757-e2209ff27977 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:23:00.464850 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b9b36f02-5599-47d2-b757-e2209ff27977 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:23:00.592976 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-b9b36f02-5599-47d2-b757-e2209ff27977 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:23:00.601254 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-b9b36f02-5599-47d2-b757-e2209ff27977 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.148545 Nov 09 20:23:00.601815 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 784/1596] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:23:00 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:23:01.618334 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-f7979cb3-51c8-4e76-8287-401db86287a6 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:23:01.618932 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-f7979cb3-51c8-4e76-8287-401db86287a6 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:23:01.625073 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f7979cb3-51c8-4e76-8287-401db86287a6 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:23:01.625515 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f7979cb3-51c8-4e76-8287-401db86287a6 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:23:01.626278 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f7979cb3-51c8-4e76-8287-401db86287a6 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:23:01.627361 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f7979cb3-51c8-4e76-8287-401db86287a6 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:23:01.753585 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-f7979cb3-51c8-4e76-8287-401db86287a6 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:23:01.761105 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-f7979cb3-51c8-4e76-8287-401db86287a6 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.146428 Nov 09 20:23:01.761662 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 813/1597] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:23:01 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:23:02.778025 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-2e5ab6f9-6810-4487-b895-b97a913235a0 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:23:02.778652 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-2e5ab6f9-6810-4487-b895-b97a913235a0 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:23:02.785077 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2e5ab6f9-6810-4487-b895-b97a913235a0 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:23:02.785517 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2e5ab6f9-6810-4487-b895-b97a913235a0 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:23:02.786281 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2e5ab6f9-6810-4487-b895-b97a913235a0 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:23:02.786708 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2e5ab6f9-6810-4487-b895-b97a913235a0 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:23:02.915430 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-2e5ab6f9-6810-4487-b895-b97a913235a0 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:23:02.923047 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-2e5ab6f9-6810-4487-b895-b97a913235a0 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.148858 Nov 09 20:23:02.924314 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 785/1598] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:23:02 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:23:03.940767 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-31738030-087b-4abf-9c8c-66376fd360c5 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:23:03.941377 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-31738030-087b-4abf-9c8c-66376fd360c5 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:23:03.947595 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-31738030-087b-4abf-9c8c-66376fd360c5 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:23:03.948047 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-31738030-087b-4abf-9c8c-66376fd360c5 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:23:03.948854 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-31738030-087b-4abf-9c8c-66376fd360c5 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:23:03.949290 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-31738030-087b-4abf-9c8c-66376fd360c5 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:23:04.082742 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-31738030-087b-4abf-9c8c-66376fd360c5 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:23:04.090380 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-31738030-087b-4abf-9c8c-66376fd360c5 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.153363 Nov 09 20:23:04.090941 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 814/1599] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:23:03 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:23:05.106840 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-03b9acb1-910e-44e1-b745-cc0ac27553b2 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:23:05.107477 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-03b9acb1-910e-44e1-b745-cc0ac27553b2 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:23:05.114328 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-03b9acb1-910e-44e1-b745-cc0ac27553b2 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:23:05.114768 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-03b9acb1-910e-44e1-b745-cc0ac27553b2 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:23:05.115951 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-03b9acb1-910e-44e1-b745-cc0ac27553b2 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:23:05.116792 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-03b9acb1-910e-44e1-b745-cc0ac27553b2 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:23:05.247908 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-03b9acb1-910e-44e1-b745-cc0ac27553b2 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:23:05.256571 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-03b9acb1-910e-44e1-b745-cc0ac27553b2 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.153286 Nov 09 20:23:05.257129 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 786/1600] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:23:05 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:23:06.273958 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-024bc213-d889-46d3-95dd-d0b292822692 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:23:06.274527 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-024bc213-d889-46d3-95dd-d0b292822692 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:23:06.280756 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-024bc213-d889-46d3-95dd-d0b292822692 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:23:06.281222 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-024bc213-d889-46d3-95dd-d0b292822692 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:23:06.281989 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-024bc213-d889-46d3-95dd-d0b292822692 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:23:06.282423 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-024bc213-d889-46d3-95dd-d0b292822692 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:23:06.411018 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-024bc213-d889-46d3-95dd-d0b292822692 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:23:06.418720 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-024bc213-d889-46d3-95dd-d0b292822692 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.148546 Nov 09 20:23:06.419339 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 815/1601] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:23:06 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:23:07.435521 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-7bcfd0ea-2e51-4752-9fca-2da6c3936c78 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:23:07.436203 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-7bcfd0ea-2e51-4752-9fca-2da6c3936c78 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:23:07.442405 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7bcfd0ea-2e51-4752-9fca-2da6c3936c78 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:23:07.442848 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7bcfd0ea-2e51-4752-9fca-2da6c3936c78 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:23:07.443602 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7bcfd0ea-2e51-4752-9fca-2da6c3936c78 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:23:07.444025 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7bcfd0ea-2e51-4752-9fca-2da6c3936c78 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:23:07.575993 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-7bcfd0ea-2e51-4752-9fca-2da6c3936c78 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:23:07.584711 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-7bcfd0ea-2e51-4752-9fca-2da6c3936c78 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.152744 Nov 09 20:23:07.585281 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 787/1602] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:23:07 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:23:08.601994 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-2eac4005-3744-4946-b127-8207d6a237a2 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:23:08.602593 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-2eac4005-3744-4946-b127-8207d6a237a2 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:23:08.608957 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-2eac4005-3744-4946-b127-8207d6a237a2 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:23:08.609396 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-2eac4005-3744-4946-b127-8207d6a237a2 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:23:08.610162 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-2eac4005-3744-4946-b127-8207d6a237a2 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:23:08.610592 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-2eac4005-3744-4946-b127-8207d6a237a2 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:23:08.741870 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-2eac4005-3744-4946-b127-8207d6a237a2 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:23:08.749690 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-2eac4005-3744-4946-b127-8207d6a237a2 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.151281 Nov 09 20:23:08.750328 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 816/1603] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:23:08 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:23:09.766302 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-658323bc-2278-4a9f-8909-5ee878211568 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:23:09.766894 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-658323bc-2278-4a9f-8909-5ee878211568 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:23:09.773171 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-658323bc-2278-4a9f-8909-5ee878211568 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:23:09.773609 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-658323bc-2278-4a9f-8909-5ee878211568 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:23:09.774404 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-658323bc-2278-4a9f-8909-5ee878211568 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:23:09.774829 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-658323bc-2278-4a9f-8909-5ee878211568 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:23:09.901873 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-658323bc-2278-4a9f-8909-5ee878211568 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:23:09.909605 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-658323bc-2278-4a9f-8909-5ee878211568 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.146896 Nov 09 20:23:09.910166 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 788/1604] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:23:09 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:23:10.927116 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-60dfb3f6-36b2-42ae-88a8-a57e28546ad7 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:23:10.927725 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-60dfb3f6-36b2-42ae-88a8-a57e28546ad7 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:23:10.934024 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-60dfb3f6-36b2-42ae-88a8-a57e28546ad7 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:23:10.934472 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-60dfb3f6-36b2-42ae-88a8-a57e28546ad7 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:23:10.935251 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-60dfb3f6-36b2-42ae-88a8-a57e28546ad7 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:23:10.935684 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-60dfb3f6-36b2-42ae-88a8-a57e28546ad7 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:23:11.064023 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-60dfb3f6-36b2-42ae-88a8-a57e28546ad7 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:23:11.072125 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-60dfb3f6-36b2-42ae-88a8-a57e28546ad7 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.149460 Nov 09 20:23:11.072715 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 817/1605] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:23:10 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:23:12.089799 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-bc31e659-dcd4-4ce4-87c6-522a143ce9a5 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:23:12.090394 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-bc31e659-dcd4-4ce4-87c6-522a143ce9a5 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:23:12.096657 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bc31e659-dcd4-4ce4-87c6-522a143ce9a5 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:23:12.097092 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bc31e659-dcd4-4ce4-87c6-522a143ce9a5 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:23:12.097849 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bc31e659-dcd4-4ce4-87c6-522a143ce9a5 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:23:12.098271 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bc31e659-dcd4-4ce4-87c6-522a143ce9a5 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:23:12.224854 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-bc31e659-dcd4-4ce4-87c6-522a143ce9a5 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:23:12.232370 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-bc31e659-dcd4-4ce4-87c6-522a143ce9a5 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.146132 Nov 09 20:23:12.232940 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 789/1606] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:23:12 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:23:13.250106 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-38666e80-4679-4b10-80ff-dd188dcbc5e6 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:23:13.250759 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-38666e80-4679-4b10-80ff-dd188dcbc5e6 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:23:13.257659 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-38666e80-4679-4b10-80ff-dd188dcbc5e6 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:23:13.258101 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-38666e80-4679-4b10-80ff-dd188dcbc5e6 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:23:13.258881 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-38666e80-4679-4b10-80ff-dd188dcbc5e6 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:23:13.259314 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-38666e80-4679-4b10-80ff-dd188dcbc5e6 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:23:13.389929 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-38666e80-4679-4b10-80ff-dd188dcbc5e6 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:23:13.397596 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-38666e80-4679-4b10-80ff-dd188dcbc5e6 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.151235 Nov 09 20:23:13.398153 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 818/1607] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:23:13 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:23:14.415272 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-629dcdd9-841f-4d68-bf79-788b1570ad1b tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:23:14.415870 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-629dcdd9-841f-4d68-bf79-788b1570ad1b tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:23:14.423125 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-629dcdd9-841f-4d68-bf79-788b1570ad1b tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:23:14.423572 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-629dcdd9-841f-4d68-bf79-788b1570ad1b tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:23:14.424333 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-629dcdd9-841f-4d68-bf79-788b1570ad1b tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:23:14.424793 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-629dcdd9-841f-4d68-bf79-788b1570ad1b tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:23:14.552424 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-629dcdd9-841f-4d68-bf79-788b1570ad1b tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:23:14.560015 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-629dcdd9-841f-4d68-bf79-788b1570ad1b tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.148415 Nov 09 20:23:14.560602 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 790/1608] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:23:14 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:23:15.576867 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-18a02516-2db4-437b-a6b4-09388fc70ef3 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:23:15.577431 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-18a02516-2db4-437b-a6b4-09388fc70ef3 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:23:15.584200 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-18a02516-2db4-437b-a6b4-09388fc70ef3 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:23:15.584676 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-18a02516-2db4-437b-a6b4-09388fc70ef3 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:23:15.585451 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-18a02516-2db4-437b-a6b4-09388fc70ef3 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:23:15.585884 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-18a02516-2db4-437b-a6b4-09388fc70ef3 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:23:15.712342 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-18a02516-2db4-437b-a6b4-09388fc70ef3 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:23:15.719913 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-18a02516-2db4-437b-a6b4-09388fc70ef3 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.146961 Nov 09 20:23:15.720510 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 819/1609] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:23:15 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:23:16.736706 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-a40adba0-215f-4904-9d5c-183f3cc22b01 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:23:16.737305 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-a40adba0-215f-4904-9d5c-183f3cc22b01 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:23:16.744346 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a40adba0-215f-4904-9d5c-183f3cc22b01 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:23:16.744805 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a40adba0-215f-4904-9d5c-183f3cc22b01 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:23:16.745561 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a40adba0-215f-4904-9d5c-183f3cc22b01 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:23:16.745983 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a40adba0-215f-4904-9d5c-183f3cc22b01 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:23:16.874566 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-a40adba0-215f-4904-9d5c-183f3cc22b01 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:23:16.882200 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-a40adba0-215f-4904-9d5c-183f3cc22b01 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.149120 Nov 09 20:23:16.882755 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 791/1610] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:23:16 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 20:23:17.898781 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-c1767609-3bf3-4e1d-b4e8-db15f15ca273 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:23:17.899390 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-c1767609-3bf3-4e1d-b4e8-db15f15ca273 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:23:17.905652 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c1767609-3bf3-4e1d-b4e8-db15f15ca273 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:23:17.906100 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c1767609-3bf3-4e1d-b4e8-db15f15ca273 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:23:17.906869 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c1767609-3bf3-4e1d-b4e8-db15f15ca273 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:23:17.907297 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c1767609-3bf3-4e1d-b4e8-db15f15ca273 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:23:18.037254 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-c1767609-3bf3-4e1d-b4e8-db15f15ca273 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:23:18.045032 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-c1767609-3bf3-4e1d-b4e8-db15f15ca273 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.149871 Nov 09 20:23:18.045584 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 820/1611] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:23:17 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 20:23:19.062372 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-dc86545b-9aea-415f-ad4c-fd85fe111f04 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:23:19.062969 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-dc86545b-9aea-415f-ad4c-fd85fe111f04 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:23:19.069399 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-dc86545b-9aea-415f-ad4c-fd85fe111f04 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:23:19.069837 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-dc86545b-9aea-415f-ad4c-fd85fe111f04 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:23:19.070599 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-dc86545b-9aea-415f-ad4c-fd85fe111f04 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:23:19.071035 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-dc86545b-9aea-415f-ad4c-fd85fe111f04 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:23:19.205878 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-dc86545b-9aea-415f-ad4c-fd85fe111f04 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:23:19.213610 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-dc86545b-9aea-415f-ad4c-fd85fe111f04 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.154976 Nov 09 20:23:19.214383 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 792/1612] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:23:19 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:23:20.230770 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-9b1b2408-983c-401b-8855-7398619a7ff6 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:23:20.231403 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-9b1b2408-983c-401b-8855-7398619a7ff6 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:23:20.237581 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-9b1b2408-983c-401b-8855-7398619a7ff6 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:23:20.238284 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-9b1b2408-983c-401b-8855-7398619a7ff6 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:23:20.239341 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-9b1b2408-983c-401b-8855-7398619a7ff6 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:23:20.239772 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-9b1b2408-983c-401b-8855-7398619a7ff6 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:23:20.371030 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-9b1b2408-983c-401b-8855-7398619a7ff6 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:23:20.379262 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-9b1b2408-983c-401b-8855-7398619a7ff6 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.151664 Nov 09 20:23:20.379962 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 821/1613] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:23:20 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:23:21.396226 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-5f835608-b6d3-4ae1-b89e-5b72049cee0e tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:23:21.396855 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-5f835608-b6d3-4ae1-b89e-5b72049cee0e tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:23:21.403015 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5f835608-b6d3-4ae1-b89e-5b72049cee0e tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:23:21.403448 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5f835608-b6d3-4ae1-b89e-5b72049cee0e tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:23:21.404205 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5f835608-b6d3-4ae1-b89e-5b72049cee0e tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:23:21.404655 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5f835608-b6d3-4ae1-b89e-5b72049cee0e tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:23:21.536362 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-5f835608-b6d3-4ae1-b89e-5b72049cee0e tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:23:21.544115 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-5f835608-b6d3-4ae1-b89e-5b72049cee0e tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.152112 Nov 09 20:23:21.544721 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 793/1614] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:23:21 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:23:22.204861 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-80224227-7b8f-410c-a710-beef5523a918 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:23:22.205369 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-80224227-7b8f-410c-a710-beef5523a918 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: 90c53d4c-080d-4d25-a3eb-50c92e83f38c] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:23:22.211610 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-80224227-7b8f-410c-a710-beef5523a918 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:23:22.212054 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-80224227-7b8f-410c-a710-beef5523a918 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:23:22.212865 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-80224227-7b8f-410c-a710-beef5523a918 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:23:22.213292 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-80224227-7b8f-410c-a710-beef5523a918 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:23:22.238365 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-80224227-7b8f-410c-a710-beef5523a918 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: 90c53d4c-080d-4d25-a3eb-50c92e83f38c] Going to try to terminate instance {{(pid=116102) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 09 20:23:22.312762 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-80224227-7b8f-410c-a710-beef5523a918 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "DELETE /compute/v2.1/servers/90c53d4c-080d-4d25-a3eb-50c92e83f38c" status: 204 len: 0 microversion: 2.20 time: 0.111202 Nov 09 20:23:22.313423 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 822/1615] 10.222.0.25 () {60 vars in 1279 bytes} [Tue Nov 9 20:23:22 2021] DELETE /compute/v2.1/servers/90c53d4c-080d-4d25-a3eb-50c92e83f38c => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 09 20:23:22.322552 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-248146a3-2edb-4e6a-a9b4-bb81c519fe04 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:23:22.323151 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-248146a3-2edb-4e6a-a9b4-bb81c519fe04 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: 90c53d4c-080d-4d25-a3eb-50c92e83f38c] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:23:22.329101 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-248146a3-2edb-4e6a-a9b4-bb81c519fe04 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:23:22.329541 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-248146a3-2edb-4e6a-a9b4-bb81c519fe04 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:23:22.330299 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-248146a3-2edb-4e6a-a9b4-bb81c519fe04 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:23:22.330726 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-248146a3-2edb-4e6a-a9b4-bb81c519fe04 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:23:22.463984 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-248146a3-2edb-4e6a-a9b4-bb81c519fe04 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:23:22.471676 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-248146a3-2edb-4e6a-a9b4-bb81c519fe04 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:23:22.473858 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-248146a3-2edb-4e6a-a9b4-bb81c519fe04 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:23:22.475000 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-248146a3-2edb-4e6a-a9b4-bb81c519fe04 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/90c53d4c-080d-4d25-a3eb-50c92e83f38c" status: 200 len: 1720 microversion: 2.20 time: 0.156120 Nov 09 20:23:22.475551 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 794/1616] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:23:22 2021] GET /compute/v2.1/servers/90c53d4c-080d-4d25-a3eb-50c92e83f38c => generated 1720 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 20:23:22.561573 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-765b000a-22fd-4f19-b096-971043571217 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:23:22.562182 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-765b000a-22fd-4f19-b096-971043571217 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:23:22.568110 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-765b000a-22fd-4f19-b096-971043571217 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:23:22.568589 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-765b000a-22fd-4f19-b096-971043571217 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:23:22.569354 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-765b000a-22fd-4f19-b096-971043571217 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:23:22.569777 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-765b000a-22fd-4f19-b096-971043571217 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:23:22.696903 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-765b000a-22fd-4f19-b096-971043571217 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:23:22.704454 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-765b000a-22fd-4f19-b096-971043571217 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.146919 Nov 09 20:23:22.705006 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 823/1617] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:23:22 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:23:23.494839 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-7a76685e-8a28-4fcf-8ff6-71852d888f1b tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:23:23.496150 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-7a76685e-8a28-4fcf-8ff6-71852d888f1b tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: 90c53d4c-080d-4d25-a3eb-50c92e83f38c] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:23:23.502667 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7a76685e-8a28-4fcf-8ff6-71852d888f1b tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:23:23.511551 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7a76685e-8a28-4fcf-8ff6-71852d888f1b tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:23:23.512429 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7a76685e-8a28-4fcf-8ff6-71852d888f1b tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:23:23.512875 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7a76685e-8a28-4fcf-8ff6-71852d888f1b tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:23:23.584297 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-7a76685e-8a28-4fcf-8ff6-71852d888f1b tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:23:23.598410 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-7a76685e-8a28-4fcf-8ff6-71852d888f1b tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:23:23.600842 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-7a76685e-8a28-4fcf-8ff6-71852d888f1b tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f813425597246e495fca79f1d6a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e1da6a3c14c4a931ece53d568b716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:23:23.603407 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-7a76685e-8a28-4fcf-8ff6-71852d888f1b tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/90c53d4c-080d-4d25-a3eb-50c92e83f38c" status: 200 len: 1654 microversion: 2.20 time: 0.112582 Nov 09 20:23:23.604288 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 795/1618] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:23:23 2021] GET /compute/v2.1/servers/90c53d4c-080d-4d25-a3eb-50c92e83f38c => generated 1654 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 09 20:23:23.697418 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [req-2862c35e-27de-4170-9d81-782bdec1999c req-72c63dae-1a9b-4646-a406-29277b599cee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90c53d4c-080d-4d25-a3eb-50c92e83f38c", "name": "network-vif-deleted", "tag": "5b6cdcb9-1700-444f-a78d-dd1966ee5647"}]} {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:23:23.699113 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 20:23:23.699113 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: warnings.warn(msg) Nov 09 20:23:23.706370 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [req-2862c35e-27de-4170-9d81-782bdec1999c req-72c63dae-1a9b-4646-a406-29277b599cee service nova] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:23:23.707079 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [req-2862c35e-27de-4170-9d81-782bdec1999c req-72c63dae-1a9b-4646-a406-29277b599cee service nova] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:23:23.718938 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.compute.server_external_events [req-2862c35e-27de-4170-9d81-782bdec1999c req-72c63dae-1a9b-4646-a406-29277b599cee service nova] Creating event network-vif-deleted:5b6cdcb9-1700-444f-a78d-dd1966ee5647 for instance 90c53d4c-080d-4d25-a3eb-50c92e83f38c on hv-cinder-80135 Nov 09 20:23:23.720527 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-b466cdea-97ae-4844-99c5-dc92518ab601 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:23:23.721124 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-b466cdea-97ae-4844-99c5-dc92518ab601 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:23:23.723921 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [req-2862c35e-27de-4170-9d81-782bdec1999c req-72c63dae-1a9b-4646-a406-29277b599cee service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115341 Nov 09 20:23:23.724808 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 824/1619] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Nov 9 20:23:23 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:23:23.728603 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b466cdea-97ae-4844-99c5-dc92518ab601 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:23:23.729160 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b466cdea-97ae-4844-99c5-dc92518ab601 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:23:23.730072 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b466cdea-97ae-4844-99c5-dc92518ab601 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:23:23.730577 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b466cdea-97ae-4844-99c5-dc92518ab601 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:23:23.869512 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-b466cdea-97ae-4844-99c5-dc92518ab601 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:23:23.878237 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-b466cdea-97ae-4844-99c5-dc92518ab601 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.161519 Nov 09 20:23:23.879658 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 796/1620] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:23:23 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 20:23:24.623936 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-5a34391c-b128-49f7-81aa-1de2a1593970 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:23:24.624812 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-5a34391c-b128-49f7-81aa-1de2a1593970 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: 90c53d4c-080d-4d25-a3eb-50c92e83f38c] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:23:24.631552 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-5a34391c-b128-49f7-81aa-1de2a1593970 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:23:24.632026 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-5a34391c-b128-49f7-81aa-1de2a1593970 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:23:24.632909 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-5a34391c-b128-49f7-81aa-1de2a1593970 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:23:24.633346 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-5a34391c-b128-49f7-81aa-1de2a1593970 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:23:24.647106 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.wsgi [None req-5a34391c-b128-49f7-81aa-1de2a1593970 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] HTTP exception thrown: Instance 90c53d4c-080d-4d25-a3eb-50c92e83f38c could not be found. Nov 09 20:23:24.647702 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-5a34391c-b128-49f7-81aa-1de2a1593970 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Returning 404 to user: Instance 90c53d4c-080d-4d25-a3eb-50c92e83f38c could not be found. {{(pid=116102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 09 20:23:24.648549 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-5a34391c-b128-49f7-81aa-1de2a1593970 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/90c53d4c-080d-4d25-a3eb-50c92e83f38c" status: 404 len: 111 microversion: 2.20 time: 0.029216 Nov 09 20:23:24.649085 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 825/1621] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Nov 9 20:23:24 2021] GET /compute/v2.1/servers/90c53d4c-080d-4d25-a3eb-50c92e83f38c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 09 20:23:24.657414 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-01a6fbd6-b0e3-46f5-9c24-fdff571dc0ea tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '.version_select at 0x7fab36dd7430>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:23:24.678501 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-01a6fbd6-b0e3-46f5-9c24-fdff571dc0ea tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-409129768" status: 204 len: 0 microversion: 2.20 time: 0.024861 Nov 09 20:23:24.679212 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 797/1622] 10.222.0.25 () {60 vars in 1258 bytes} [Tue Nov 9 20:23:24 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-409129768 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 09 20:23:24.896156 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-61f10bd8-5d1f-4bf0-a2bc-de464b30c289 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:23:24.897746 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-61f10bd8-5d1f-4bf0-a2bc-de464b30c289 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:23:24.906959 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-61f10bd8-5d1f-4bf0-a2bc-de464b30c289 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:23:24.907499 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-61f10bd8-5d1f-4bf0-a2bc-de464b30c289 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:23:24.908420 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-61f10bd8-5d1f-4bf0-a2bc-de464b30c289 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:23:24.908979 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-61f10bd8-5d1f-4bf0-a2bc-de464b30c289 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:23:25.120930 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-61f10bd8-5d1f-4bf0-a2bc-de464b30c289 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:23:25.129105 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-61f10bd8-5d1f-4bf0-a2bc-de464b30c289 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.237318 Nov 09 20:23:25.129674 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 826/1623] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:23:24 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:23:26.145653 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-b0eda617-e41f-4a98-b8c7-6bbbac26562f tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:23:26.146246 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-b0eda617-e41f-4a98-b8c7-6bbbac26562f tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:23:26.151996 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b0eda617-e41f-4a98-b8c7-6bbbac26562f tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:23:26.152372 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b0eda617-e41f-4a98-b8c7-6bbbac26562f tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:23:26.153166 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b0eda617-e41f-4a98-b8c7-6bbbac26562f tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:23:26.153588 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b0eda617-e41f-4a98-b8c7-6bbbac26562f tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:23:26.282136 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-b0eda617-e41f-4a98-b8c7-6bbbac26562f tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:23:26.290510 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-b0eda617-e41f-4a98-b8c7-6bbbac26562f tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.148655 Nov 09 20:23:26.291077 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 798/1624] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:23:26 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:23:27.307125 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-18d26ba4-b02a-4dd6-8ac2-e6f8b9f00bb3 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:23:27.307732 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-18d26ba4-b02a-4dd6-8ac2-e6f8b9f00bb3 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:23:27.313988 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-18d26ba4-b02a-4dd6-8ac2-e6f8b9f00bb3 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:23:27.314434 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-18d26ba4-b02a-4dd6-8ac2-e6f8b9f00bb3 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:23:27.315198 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-18d26ba4-b02a-4dd6-8ac2-e6f8b9f00bb3 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:23:27.315655 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-18d26ba4-b02a-4dd6-8ac2-e6f8b9f00bb3 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:23:27.444696 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-18d26ba4-b02a-4dd6-8ac2-e6f8b9f00bb3 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:23:27.452251 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-18d26ba4-b02a-4dd6-8ac2-e6f8b9f00bb3 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.148806 Nov 09 20:23:27.452841 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 827/1625] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:23:27 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:23:28.469281 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-a00df521-df9a-4898-bf49-6e483e95b84e tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:23:28.469892 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-a00df521-df9a-4898-bf49-6e483e95b84e tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:23:28.476333 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a00df521-df9a-4898-bf49-6e483e95b84e tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:23:28.476809 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a00df521-df9a-4898-bf49-6e483e95b84e tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:23:28.477583 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a00df521-df9a-4898-bf49-6e483e95b84e tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:23:28.478020 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a00df521-df9a-4898-bf49-6e483e95b84e tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:23:28.609468 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-a00df521-df9a-4898-bf49-6e483e95b84e tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:23:28.617620 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-a00df521-df9a-4898-bf49-6e483e95b84e tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.152017 Nov 09 20:23:28.618176 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 799/1626] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:23:28 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 20:23:29.634352 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-d2ae0eec-14de-40bb-ac87-b278363517ed tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:23:29.634936 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-d2ae0eec-14de-40bb-ac87-b278363517ed tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:23:29.641309 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d2ae0eec-14de-40bb-ac87-b278363517ed tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:23:29.641762 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d2ae0eec-14de-40bb-ac87-b278363517ed tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:23:29.642574 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d2ae0eec-14de-40bb-ac87-b278363517ed tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:23:29.643007 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d2ae0eec-14de-40bb-ac87-b278363517ed tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:23:29.773315 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-d2ae0eec-14de-40bb-ac87-b278363517ed tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:23:29.781390 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-d2ae0eec-14de-40bb-ac87-b278363517ed tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.150634 Nov 09 20:23:29.781961 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 828/1627] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:23:29 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 20:23:30.800033 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-ba85ac03-e8ad-44c3-a725-4612d24ea17c tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:23:30.801283 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-ba85ac03-e8ad-44c3-a725-4612d24ea17c tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:23:30.807614 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ba85ac03-e8ad-44c3-a725-4612d24ea17c tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:23:30.808056 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ba85ac03-e8ad-44c3-a725-4612d24ea17c tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:23:30.808858 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ba85ac03-e8ad-44c3-a725-4612d24ea17c tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:23:30.809286 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ba85ac03-e8ad-44c3-a725-4612d24ea17c tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:23:30.939567 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-ba85ac03-e8ad-44c3-a725-4612d24ea17c tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:23:30.947325 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-ba85ac03-e8ad-44c3-a725-4612d24ea17c tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.150834 Nov 09 20:23:30.947882 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 800/1628] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:23:30 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:23:31.963239 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-d1ecfb69-251f-4f47-bef1-d2968f394b78 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:23:31.963874 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-d1ecfb69-251f-4f47-bef1-d2968f394b78 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:23:31.970080 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d1ecfb69-251f-4f47-bef1-d2968f394b78 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:23:31.970530 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d1ecfb69-251f-4f47-bef1-d2968f394b78 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:23:31.971306 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d1ecfb69-251f-4f47-bef1-d2968f394b78 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:23:31.971742 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d1ecfb69-251f-4f47-bef1-d2968f394b78 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:23:32.100517 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-d1ecfb69-251f-4f47-bef1-d2968f394b78 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:23:32.108101 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-d1ecfb69-251f-4f47-bef1-d2968f394b78 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.148468 Nov 09 20:23:32.108688 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 829/1629] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:23:31 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:23:33.124741 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-e0d982f9-dfcf-4500-ba74-744081decfab tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:23:33.125341 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-e0d982f9-dfcf-4500-ba74-744081decfab tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:23:33.131722 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e0d982f9-dfcf-4500-ba74-744081decfab tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:23:33.132162 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e0d982f9-dfcf-4500-ba74-744081decfab tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:23:33.132952 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e0d982f9-dfcf-4500-ba74-744081decfab tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:23:33.133380 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e0d982f9-dfcf-4500-ba74-744081decfab tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:23:33.259452 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-e0d982f9-dfcf-4500-ba74-744081decfab tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:23:33.267081 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-e0d982f9-dfcf-4500-ba74-744081decfab tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.145925 Nov 09 20:23:33.267634 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 801/1630] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:23:33 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:23:34.284872 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-57350227-a182-43e6-b307-db7ed973bb60 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:23:34.285376 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-57350227-a182-43e6-b307-db7ed973bb60 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:23:34.291603 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-57350227-a182-43e6-b307-db7ed973bb60 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:23:34.292041 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-57350227-a182-43e6-b307-db7ed973bb60 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:23:34.292836 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-57350227-a182-43e6-b307-db7ed973bb60 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:23:34.293260 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-57350227-a182-43e6-b307-db7ed973bb60 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:23:34.423375 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-57350227-a182-43e6-b307-db7ed973bb60 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:23:34.432040 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-57350227-a182-43e6-b307-db7ed973bb60 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.150907 Nov 09 20:23:34.432616 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 830/1631] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:23:34 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:23:35.449211 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-d813bfbf-9aad-4fb9-bcd4-ceb4ed55366f tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:23:35.449847 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-d813bfbf-9aad-4fb9-bcd4-ceb4ed55366f tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:23:35.455981 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d813bfbf-9aad-4fb9-bcd4-ceb4ed55366f tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:23:35.456445 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d813bfbf-9aad-4fb9-bcd4-ceb4ed55366f tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:23:35.457214 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d813bfbf-9aad-4fb9-bcd4-ceb4ed55366f tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:23:35.457643 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d813bfbf-9aad-4fb9-bcd4-ceb4ed55366f tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:23:35.582983 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-d813bfbf-9aad-4fb9-bcd4-ceb4ed55366f tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:23:35.590685 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-d813bfbf-9aad-4fb9-bcd4-ceb4ed55366f tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.145104 Nov 09 20:23:35.591246 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 802/1632] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:23:35 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:23:36.606930 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-5c1fdb93-0946-4e1c-87a5-2e904e83d428 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:23:36.607557 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-5c1fdb93-0946-4e1c-87a5-2e904e83d428 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:23:36.613890 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-5c1fdb93-0946-4e1c-87a5-2e904e83d428 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:23:36.614583 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-5c1fdb93-0946-4e1c-87a5-2e904e83d428 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:23:36.615342 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-5c1fdb93-0946-4e1c-87a5-2e904e83d428 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:23:36.616011 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-5c1fdb93-0946-4e1c-87a5-2e904e83d428 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:23:36.745963 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-5c1fdb93-0946-4e1c-87a5-2e904e83d428 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:23:36.753705 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-5c1fdb93-0946-4e1c-87a5-2e904e83d428 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.150530 Nov 09 20:23:36.754267 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 831/1633] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:23:36 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:23:37.770872 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-5c0ed7c1-b6b6-426b-ac7e-24471ae8c7be tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:23:37.771478 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-5c0ed7c1-b6b6-426b-ac7e-24471ae8c7be tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:23:37.778687 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5c0ed7c1-b6b6-426b-ac7e-24471ae8c7be tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:23:37.779133 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5c0ed7c1-b6b6-426b-ac7e-24471ae8c7be tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:23:37.779909 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5c0ed7c1-b6b6-426b-ac7e-24471ae8c7be tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:23:37.780344 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5c0ed7c1-b6b6-426b-ac7e-24471ae8c7be tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:23:37.913926 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-5c0ed7c1-b6b6-426b-ac7e-24471ae8c7be tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:23:37.921619 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-5c0ed7c1-b6b6-426b-ac7e-24471ae8c7be tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.154427 Nov 09 20:23:37.922168 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 803/1634] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:23:37 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:23:38.938313 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-3aefda1c-0a3b-49ce-8a13-548079830c89 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:23:38.938918 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-3aefda1c-0a3b-49ce-8a13-548079830c89 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:23:38.945595 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-3aefda1c-0a3b-49ce-8a13-548079830c89 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:23:38.946041 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-3aefda1c-0a3b-49ce-8a13-548079830c89 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:23:38.946816 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-3aefda1c-0a3b-49ce-8a13-548079830c89 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:23:38.947245 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-3aefda1c-0a3b-49ce-8a13-548079830c89 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:23:39.074695 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-3aefda1c-0a3b-49ce-8a13-548079830c89 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:23:39.082285 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-3aefda1c-0a3b-49ce-8a13-548079830c89 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.147568 Nov 09 20:23:39.082839 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 832/1635] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:23:38 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:23:40.098614 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-7f9b14bb-1153-4637-9134-e15a0a833908 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:23:40.099217 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-7f9b14bb-1153-4637-9134-e15a0a833908 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:23:40.105328 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7f9b14bb-1153-4637-9134-e15a0a833908 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:23:40.105763 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7f9b14bb-1153-4637-9134-e15a0a833908 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:23:40.106520 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7f9b14bb-1153-4637-9134-e15a0a833908 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:23:40.106945 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7f9b14bb-1153-4637-9134-e15a0a833908 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:23:40.234455 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-7f9b14bb-1153-4637-9134-e15a0a833908 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:23:40.242871 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-7f9b14bb-1153-4637-9134-e15a0a833908 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.147802 Nov 09 20:23:40.243428 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 804/1636] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:23:40 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:23:41.259530 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-e992b9af-e416-4271-9bac-a24adc48216b tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:23:41.260247 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-e992b9af-e416-4271-9bac-a24adc48216b tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:23:41.266503 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e992b9af-e416-4271-9bac-a24adc48216b tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:23:41.266953 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e992b9af-e416-4271-9bac-a24adc48216b tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:23:41.267734 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e992b9af-e416-4271-9bac-a24adc48216b tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:23:41.268168 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e992b9af-e416-4271-9bac-a24adc48216b tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:23:41.399371 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-e992b9af-e416-4271-9bac-a24adc48216b tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:23:41.407332 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-e992b9af-e416-4271-9bac-a24adc48216b tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.152210 Nov 09 20:23:41.407883 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 833/1637] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:23:41 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:23:42.424195 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-c443e558-cdc8-4622-96a3-fb91439a3eb1 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:23:42.424829 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-c443e558-cdc8-4622-96a3-fb91439a3eb1 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:23:42.431584 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c443e558-cdc8-4622-96a3-fb91439a3eb1 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:23:42.432024 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c443e558-cdc8-4622-96a3-fb91439a3eb1 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:23:42.432801 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c443e558-cdc8-4622-96a3-fb91439a3eb1 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:23:42.433226 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c443e558-cdc8-4622-96a3-fb91439a3eb1 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:23:42.569710 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-c443e558-cdc8-4622-96a3-fb91439a3eb1 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:23:42.577452 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-c443e558-cdc8-4622-96a3-fb91439a3eb1 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.156898 Nov 09 20:23:42.578011 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 805/1638] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:23:42 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:23:43.594630 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-f05ab9e4-540a-4b18-bfcc-35888ed5b54c tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:23:43.595229 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-f05ab9e4-540a-4b18-bfcc-35888ed5b54c tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:23:43.601682 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f05ab9e4-540a-4b18-bfcc-35888ed5b54c tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:23:43.602131 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f05ab9e4-540a-4b18-bfcc-35888ed5b54c tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:23:43.603032 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f05ab9e4-540a-4b18-bfcc-35888ed5b54c tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:23:43.603340 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f05ab9e4-540a-4b18-bfcc-35888ed5b54c tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:23:43.734092 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-f05ab9e4-540a-4b18-bfcc-35888ed5b54c tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:23:43.742966 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-f05ab9e4-540a-4b18-bfcc-35888ed5b54c tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.152002 Nov 09 20:23:43.743527 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 834/1639] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:23:43 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:23:44.759860 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-b5b90c5c-86de-4874-bd37-b654fe3079ee tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:23:44.760507 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-b5b90c5c-86de-4874-bd37-b654fe3079ee tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:23:44.766810 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b5b90c5c-86de-4874-bd37-b654fe3079ee tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:23:44.767256 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b5b90c5c-86de-4874-bd37-b654fe3079ee tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:23:44.768052 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b5b90c5c-86de-4874-bd37-b654fe3079ee tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:23:44.768518 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b5b90c5c-86de-4874-bd37-b654fe3079ee tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:23:44.899317 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-b5b90c5c-86de-4874-bd37-b654fe3079ee tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:23:44.907063 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-b5b90c5c-86de-4874-bd37-b654fe3079ee tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.150869 Nov 09 20:23:44.907629 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 806/1640] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:23:44 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:23:45.924041 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-c1b64686-ca35-44e3-b49c-8c47ebad7451 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:23:45.924673 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-c1b64686-ca35-44e3-b49c-8c47ebad7451 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:23:45.931753 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c1b64686-ca35-44e3-b49c-8c47ebad7451 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:23:45.932194 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c1b64686-ca35-44e3-b49c-8c47ebad7451 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:23:45.932998 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c1b64686-ca35-44e3-b49c-8c47ebad7451 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:23:45.933430 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c1b64686-ca35-44e3-b49c-8c47ebad7451 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:23:46.060195 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-c1b64686-ca35-44e3-b49c-8c47ebad7451 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:23:46.067806 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-c1b64686-ca35-44e3-b49c-8c47ebad7451 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.147422 Nov 09 20:23:46.068358 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 835/1641] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:23:45 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:23:47.084763 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-b45f526d-3966-4763-be98-b82a861accda tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:23:47.085374 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-b45f526d-3966-4763-be98-b82a861accda tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:23:47.091523 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b45f526d-3966-4763-be98-b82a861accda tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:23:47.091973 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b45f526d-3966-4763-be98-b82a861accda tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:23:47.092780 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b45f526d-3966-4763-be98-b82a861accda tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:23:47.093221 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b45f526d-3966-4763-be98-b82a861accda tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:23:47.219387 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-b45f526d-3966-4763-be98-b82a861accda tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:23:47.227618 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-b45f526d-3966-4763-be98-b82a861accda tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.146527 Nov 09 20:23:47.228600 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 807/1642] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:23:47 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:23:48.245209 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-be29c1cd-2c10-45bf-88af-7d810599354f tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:23:48.245806 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-be29c1cd-2c10-45bf-88af-7d810599354f tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:23:48.252038 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-be29c1cd-2c10-45bf-88af-7d810599354f tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:23:48.252507 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-be29c1cd-2c10-45bf-88af-7d810599354f tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:23:48.253265 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-be29c1cd-2c10-45bf-88af-7d810599354f tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:23:48.253691 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-be29c1cd-2c10-45bf-88af-7d810599354f tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:23:48.386944 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-be29c1cd-2c10-45bf-88af-7d810599354f tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:23:48.394629 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-be29c1cd-2c10-45bf-88af-7d810599354f tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.153052 Nov 09 20:23:48.395193 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 836/1643] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:23:48 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:23:49.412229 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-10f7c1da-f02f-41a2-af3a-cdd8c93aae25 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:23:49.413199 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-10f7c1da-f02f-41a2-af3a-cdd8c93aae25 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:23:49.419394 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-10f7c1da-f02f-41a2-af3a-cdd8c93aae25 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:23:49.419850 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-10f7c1da-f02f-41a2-af3a-cdd8c93aae25 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:23:49.420661 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-10f7c1da-f02f-41a2-af3a-cdd8c93aae25 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:23:49.421094 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-10f7c1da-f02f-41a2-af3a-cdd8c93aae25 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:23:49.548331 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-10f7c1da-f02f-41a2-af3a-cdd8c93aae25 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:23:49.556109 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-10f7c1da-f02f-41a2-af3a-cdd8c93aae25 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.147527 Nov 09 20:23:49.556704 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 808/1644] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:23:49 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:23:50.573224 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-0e1e89c8-4d6a-429d-9f9c-4d8b4c96c460 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:23:50.573769 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-0e1e89c8-4d6a-429d-9f9c-4d8b4c96c460 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:23:50.579815 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-0e1e89c8-4d6a-429d-9f9c-4d8b4c96c460 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:23:50.580274 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-0e1e89c8-4d6a-429d-9f9c-4d8b4c96c460 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:23:50.581185 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-0e1e89c8-4d6a-429d-9f9c-4d8b4c96c460 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:23:50.581611 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-0e1e89c8-4d6a-429d-9f9c-4d8b4c96c460 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:23:50.712569 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-0e1e89c8-4d6a-429d-9f9c-4d8b4c96c460 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:23:50.720278 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-0e1e89c8-4d6a-429d-9f9c-4d8b4c96c460 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.150788 Nov 09 20:23:50.721083 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 837/1645] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:23:50 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:23:51.737986 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-1b4b063e-9c72-4686-8031-f5ee72e2605b tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:23:51.738588 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-1b4b063e-9c72-4686-8031-f5ee72e2605b tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:23:51.745156 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1b4b063e-9c72-4686-8031-f5ee72e2605b tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:23:51.745599 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1b4b063e-9c72-4686-8031-f5ee72e2605b tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:23:51.746359 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1b4b063e-9c72-4686-8031-f5ee72e2605b tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:23:51.746785 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1b4b063e-9c72-4686-8031-f5ee72e2605b tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:23:51.876016 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-1b4b063e-9c72-4686-8031-f5ee72e2605b tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:23:51.887840 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-1b4b063e-9c72-4686-8031-f5ee72e2605b tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.153478 Nov 09 20:23:51.888544 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 809/1646] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:23:51 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:23:52.905749 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-4d067577-8819-4e9d-ae89-39c847ea87dd tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:23:52.906358 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-4d067577-8819-4e9d-ae89-39c847ea87dd tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:23:52.914337 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-4d067577-8819-4e9d-ae89-39c847ea87dd tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:23:52.914791 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-4d067577-8819-4e9d-ae89-39c847ea87dd tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:23:52.915584 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-4d067577-8819-4e9d-ae89-39c847ea87dd tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:23:52.916021 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-4d067577-8819-4e9d-ae89-39c847ea87dd tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:23:53.053904 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-4d067577-8819-4e9d-ae89-39c847ea87dd tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:23:53.061708 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-4d067577-8819-4e9d-ae89-39c847ea87dd tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.159686 Nov 09 20:23:53.062272 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 838/1647] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:23:52 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:23:54.079379 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-98bfa146-95dd-40ad-9128-062300e90b35 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:23:54.079983 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-98bfa146-95dd-40ad-9128-062300e90b35 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:23:54.086602 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-98bfa146-95dd-40ad-9128-062300e90b35 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:23:54.087041 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-98bfa146-95dd-40ad-9128-062300e90b35 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:23:54.087810 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-98bfa146-95dd-40ad-9128-062300e90b35 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:23:54.088240 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-98bfa146-95dd-40ad-9128-062300e90b35 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:23:54.221490 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-98bfa146-95dd-40ad-9128-062300e90b35 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:23:54.229976 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-98bfa146-95dd-40ad-9128-062300e90b35 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.154190 Nov 09 20:23:54.230767 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 810/1648] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:23:54 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:23:55.248125 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-ba0d8eef-0587-4c7c-8343-d80f43a396f9 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:23:55.248705 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-ba0d8eef-0587-4c7c-8343-d80f43a396f9 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:23:55.254893 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ba0d8eef-0587-4c7c-8343-d80f43a396f9 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:23:55.255341 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ba0d8eef-0587-4c7c-8343-d80f43a396f9 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:23:55.256809 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ba0d8eef-0587-4c7c-8343-d80f43a396f9 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:23:55.257316 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ba0d8eef-0587-4c7c-8343-d80f43a396f9 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:23:55.384463 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-ba0d8eef-0587-4c7c-8343-d80f43a396f9 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:23:55.392046 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-ba0d8eef-0587-4c7c-8343-d80f43a396f9 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.147663 Nov 09 20:23:55.392630 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 839/1649] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:23:55 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:23:56.409254 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-1e24355f-8dcc-4c39-8405-87710690a114 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:23:56.409851 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-1e24355f-8dcc-4c39-8405-87710690a114 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:23:56.415802 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1e24355f-8dcc-4c39-8405-87710690a114 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:23:56.416240 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1e24355f-8dcc-4c39-8405-87710690a114 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:23:56.417022 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1e24355f-8dcc-4c39-8405-87710690a114 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:23:56.417448 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1e24355f-8dcc-4c39-8405-87710690a114 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:23:56.548206 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-1e24355f-8dcc-4c39-8405-87710690a114 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:23:56.557634 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-1e24355f-8dcc-4c39-8405-87710690a114 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.152081 Nov 09 20:23:56.558414 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 811/1650] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:23:56 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:23:57.575169 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-030758f3-ef1c-4016-961b-c49ca9504377 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:23:57.575731 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-030758f3-ef1c-4016-961b-c49ca9504377 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:23:57.581937 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-030758f3-ef1c-4016-961b-c49ca9504377 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:23:57.582383 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-030758f3-ef1c-4016-961b-c49ca9504377 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:23:57.583154 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-030758f3-ef1c-4016-961b-c49ca9504377 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:23:57.583587 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-030758f3-ef1c-4016-961b-c49ca9504377 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:23:57.711989 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-030758f3-ef1c-4016-961b-c49ca9504377 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:23:57.719735 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-030758f3-ef1c-4016-961b-c49ca9504377 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.148353 Nov 09 20:23:57.720297 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 840/1651] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:23:57 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:23:58.737128 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-5aec8a15-3ab6-4f95-b49b-c280c2174ea8 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:23:58.737769 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-5aec8a15-3ab6-4f95-b49b-c280c2174ea8 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:23:58.744649 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5aec8a15-3ab6-4f95-b49b-c280c2174ea8 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:23:58.745095 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5aec8a15-3ab6-4f95-b49b-c280c2174ea8 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:23:58.745861 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5aec8a15-3ab6-4f95-b49b-c280c2174ea8 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:23:58.746288 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5aec8a15-3ab6-4f95-b49b-c280c2174ea8 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:23:58.879375 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-5aec8a15-3ab6-4f95-b49b-c280c2174ea8 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:23:58.887034 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-5aec8a15-3ab6-4f95-b49b-c280c2174ea8 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.153602 Nov 09 20:23:58.887591 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 812/1652] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:23:58 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:23:59.959269 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-3b93ed9e-e31c-4a49-b592-283d4a415e78 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:23:59.959876 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-3b93ed9e-e31c-4a49-b592-283d4a415e78 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:23:59.965592 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-3b93ed9e-e31c-4a49-b592-283d4a415e78 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:23:59.966042 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-3b93ed9e-e31c-4a49-b592-283d4a415e78 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:23:59.966814 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-3b93ed9e-e31c-4a49-b592-283d4a415e78 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:23:59.967250 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-3b93ed9e-e31c-4a49-b592-283d4a415e78 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:24:00.093685 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-3b93ed9e-e31c-4a49-b592-283d4a415e78 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:24:00.102081 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-3b93ed9e-e31c-4a49-b592-283d4a415e78 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.201313 Nov 09 20:24:00.102675 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 841/1653] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:23:59 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:24:01.120028 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-0304ebe0-cbeb-4b68-b3a9-5ca45a1c235c tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:24:01.120654 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-0304ebe0-cbeb-4b68-b3a9-5ca45a1c235c tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:24:01.126830 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0304ebe0-cbeb-4b68-b3a9-5ca45a1c235c tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:24:01.127267 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0304ebe0-cbeb-4b68-b3a9-5ca45a1c235c tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:24:01.128023 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0304ebe0-cbeb-4b68-b3a9-5ca45a1c235c tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:24:01.128466 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0304ebe0-cbeb-4b68-b3a9-5ca45a1c235c tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:24:01.258986 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-0304ebe0-cbeb-4b68-b3a9-5ca45a1c235c tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:24:01.275225 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-0304ebe0-cbeb-4b68-b3a9-5ca45a1c235c tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.159672 Nov 09 20:24:01.275796 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 813/1654] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:24:01 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:24:02.291954 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-68e3bf1d-800d-4239-aac6-a8cb8e685356 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:24:02.292591 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-68e3bf1d-800d-4239-aac6-a8cb8e685356 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:24:02.298683 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-68e3bf1d-800d-4239-aac6-a8cb8e685356 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:24:02.299126 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-68e3bf1d-800d-4239-aac6-a8cb8e685356 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:24:02.299900 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-68e3bf1d-800d-4239-aac6-a8cb8e685356 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:24:02.300337 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-68e3bf1d-800d-4239-aac6-a8cb8e685356 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:24:02.433992 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-68e3bf1d-800d-4239-aac6-a8cb8e685356 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:24:02.441710 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-68e3bf1d-800d-4239-aac6-a8cb8e685356 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.153406 Nov 09 20:24:02.442278 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 842/1655] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:24:02 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:24:03.460506 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-f6349d49-df1c-4c37-928f-0e262af96277 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:24:03.461108 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-f6349d49-df1c-4c37-928f-0e262af96277 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:24:03.467314 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f6349d49-df1c-4c37-928f-0e262af96277 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:24:03.467753 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f6349d49-df1c-4c37-928f-0e262af96277 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:24:03.468541 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f6349d49-df1c-4c37-928f-0e262af96277 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:24:03.468967 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f6349d49-df1c-4c37-928f-0e262af96277 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:24:03.595653 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-f6349d49-df1c-4c37-928f-0e262af96277 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:24:03.603866 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-f6349d49-df1c-4c37-928f-0e262af96277 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.147655 Nov 09 20:24:03.604395 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 814/1656] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:24:03 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:24:04.622521 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-54b8f335-03ef-4449-9a71-907fc6984661 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:24:04.623122 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-54b8f335-03ef-4449-9a71-907fc6984661 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:24:04.629440 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-54b8f335-03ef-4449-9a71-907fc6984661 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:24:04.629876 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-54b8f335-03ef-4449-9a71-907fc6984661 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:24:04.630643 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-54b8f335-03ef-4449-9a71-907fc6984661 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:24:04.631117 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-54b8f335-03ef-4449-9a71-907fc6984661 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:24:04.760502 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-54b8f335-03ef-4449-9a71-907fc6984661 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:24:04.768191 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-54b8f335-03ef-4449-9a71-907fc6984661 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.149394 Nov 09 20:24:04.768790 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 843/1657] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:24:04 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:24:05.786241 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-e30919fe-c7a4-4993-80e8-8f53f3cbe620 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:24:05.786768 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-e30919fe-c7a4-4993-80e8-8f53f3cbe620 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:24:05.793089 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e30919fe-c7a4-4993-80e8-8f53f3cbe620 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:24:05.793546 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e30919fe-c7a4-4993-80e8-8f53f3cbe620 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:24:05.794281 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e30919fe-c7a4-4993-80e8-8f53f3cbe620 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:24:05.794706 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e30919fe-c7a4-4993-80e8-8f53f3cbe620 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:24:05.925424 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-e30919fe-c7a4-4993-80e8-8f53f3cbe620 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:24:05.933856 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-e30919fe-c7a4-4993-80e8-8f53f3cbe620 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.151365 Nov 09 20:24:05.934418 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 815/1658] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:24:05 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:24:06.950982 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-06e144d3-bca9-4f8f-aefc-4866297d7c28 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:24:06.951583 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-06e144d3-bca9-4f8f-aefc-4866297d7c28 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:24:06.957814 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-06e144d3-bca9-4f8f-aefc-4866297d7c28 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:24:06.958256 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-06e144d3-bca9-4f8f-aefc-4866297d7c28 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:24:06.959090 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-06e144d3-bca9-4f8f-aefc-4866297d7c28 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:24:06.959637 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-06e144d3-bca9-4f8f-aefc-4866297d7c28 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:24:07.086875 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-06e144d3-bca9-4f8f-aefc-4866297d7c28 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:24:07.094414 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-06e144d3-bca9-4f8f-aefc-4866297d7c28 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.147242 Nov 09 20:24:07.094971 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 844/1659] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:24:06 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:24:08.111699 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-879c3b08-48b8-413f-a450-b64f3edb698e tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:24:08.112323 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-879c3b08-48b8-413f-a450-b64f3edb698e tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:24:08.119048 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-879c3b08-48b8-413f-a450-b64f3edb698e tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:24:08.119491 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-879c3b08-48b8-413f-a450-b64f3edb698e tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:24:08.120259 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-879c3b08-48b8-413f-a450-b64f3edb698e tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:24:08.120719 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-879c3b08-48b8-413f-a450-b64f3edb698e tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:24:08.254058 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-879c3b08-48b8-413f-a450-b64f3edb698e tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:24:08.263112 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-879c3b08-48b8-413f-a450-b64f3edb698e tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.155043 Nov 09 20:24:08.263678 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 816/1660] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:24:08 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:24:09.280598 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-b861c231-9d00-4acf-a137-344e88b538f0 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:24:09.281202 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-b861c231-9d00-4acf-a137-344e88b538f0 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:24:09.288852 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b861c231-9d00-4acf-a137-344e88b538f0 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:24:09.289303 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b861c231-9d00-4acf-a137-344e88b538f0 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:24:09.290086 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b861c231-9d00-4acf-a137-344e88b538f0 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:24:09.290521 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b861c231-9d00-4acf-a137-344e88b538f0 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:24:09.417125 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-b861c231-9d00-4acf-a137-344e88b538f0 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:24:09.424709 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-b861c231-9d00-4acf-a137-344e88b538f0 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.147775 Nov 09 20:24:09.425273 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 845/1661] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:24:09 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:24:10.441581 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-8ec01b97-a729-43be-851f-cbd38f3dbf38 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:24:10.442174 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-8ec01b97-a729-43be-851f-cbd38f3dbf38 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:24:10.448508 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8ec01b97-a729-43be-851f-cbd38f3dbf38 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:24:10.448952 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8ec01b97-a729-43be-851f-cbd38f3dbf38 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:24:10.449706 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8ec01b97-a729-43be-851f-cbd38f3dbf38 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:24:10.450128 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8ec01b97-a729-43be-851f-cbd38f3dbf38 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:24:10.585068 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-8ec01b97-a729-43be-851f-cbd38f3dbf38 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:24:10.592698 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-8ec01b97-a729-43be-851f-cbd38f3dbf38 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.154770 Nov 09 20:24:10.593253 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 817/1662] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:24:10 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:24:11.610053 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-e47023c7-b0d3-4692-8451-3b1c8117c9e3 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:24:11.610695 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-e47023c7-b0d3-4692-8451-3b1c8117c9e3 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:24:11.617773 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e47023c7-b0d3-4692-8451-3b1c8117c9e3 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:24:11.618220 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e47023c7-b0d3-4692-8451-3b1c8117c9e3 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:24:11.618987 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e47023c7-b0d3-4692-8451-3b1c8117c9e3 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:24:11.619445 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e47023c7-b0d3-4692-8451-3b1c8117c9e3 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:24:11.747665 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-e47023c7-b0d3-4692-8451-3b1c8117c9e3 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:24:11.755306 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-e47023c7-b0d3-4692-8451-3b1c8117c9e3 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.148889 Nov 09 20:24:11.758000 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 846/1663] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:24:11 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:24:12.772784 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-0dc03959-417c-4b74-b2b2-f0cdef4bd006 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:24:12.773394 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-0dc03959-417c-4b74-b2b2-f0cdef4bd006 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:24:12.779664 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0dc03959-417c-4b74-b2b2-f0cdef4bd006 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:24:12.780113 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0dc03959-417c-4b74-b2b2-f0cdef4bd006 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:24:12.780937 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0dc03959-417c-4b74-b2b2-f0cdef4bd006 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:24:12.781377 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0dc03959-417c-4b74-b2b2-f0cdef4bd006 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:24:12.918680 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-0dc03959-417c-4b74-b2b2-f0cdef4bd006 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:24:12.926568 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-0dc03959-417c-4b74-b2b2-f0cdef4bd006 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.157470 Nov 09 20:24:12.927131 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 818/1664] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:24:12 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:24:13.944527 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-16544b98-6b63-4d55-bfce-a93cb78879d5 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:24:13.945179 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-16544b98-6b63-4d55-bfce-a93cb78879d5 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:24:13.951299 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-16544b98-6b63-4d55-bfce-a93cb78879d5 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:24:13.951745 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-16544b98-6b63-4d55-bfce-a93cb78879d5 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:24:13.952565 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-16544b98-6b63-4d55-bfce-a93cb78879d5 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:24:13.953003 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-16544b98-6b63-4d55-bfce-a93cb78879d5 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:24:14.082690 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-16544b98-6b63-4d55-bfce-a93cb78879d5 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:24:14.090939 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-16544b98-6b63-4d55-bfce-a93cb78879d5 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.151072 Nov 09 20:24:14.091500 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 847/1665] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:24:13 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:24:15.107901 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-05791c1c-1142-4e91-982b-22adca4895eb tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:24:15.108529 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-05791c1c-1142-4e91-982b-22adca4895eb tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:24:15.114696 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-05791c1c-1142-4e91-982b-22adca4895eb tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:24:15.115420 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-05791c1c-1142-4e91-982b-22adca4895eb tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:24:15.116198 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-05791c1c-1142-4e91-982b-22adca4895eb tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:24:15.116651 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-05791c1c-1142-4e91-982b-22adca4895eb tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:24:15.244379 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-05791c1c-1142-4e91-982b-22adca4895eb tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:24:15.252080 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-05791c1c-1142-4e91-982b-22adca4895eb tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.147756 Nov 09 20:24:15.252678 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 819/1666] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:24:15 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:24:16.269581 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-fa324633-a672-4159-bdb9-0b584b94acff tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:24:16.270112 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-fa324633-a672-4159-bdb9-0b584b94acff tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:24:16.276681 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-fa324633-a672-4159-bdb9-0b584b94acff tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:24:16.277116 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-fa324633-a672-4159-bdb9-0b584b94acff tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:24:16.277867 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-fa324633-a672-4159-bdb9-0b584b94acff tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:24:16.278291 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-fa324633-a672-4159-bdb9-0b584b94acff tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:24:16.407764 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-fa324633-a672-4159-bdb9-0b584b94acff tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:24:16.415330 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-fa324633-a672-4159-bdb9-0b584b94acff tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.149525 Nov 09 20:24:16.415884 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 848/1667] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:24:16 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:24:17.432138 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-fd8a79bf-dc6d-4e18-a151-c51459543971 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:24:17.432766 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-fd8a79bf-dc6d-4e18-a151-c51459543971 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:24:17.438916 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fd8a79bf-dc6d-4e18-a151-c51459543971 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:24:17.439355 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fd8a79bf-dc6d-4e18-a151-c51459543971 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:24:17.440110 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fd8a79bf-dc6d-4e18-a151-c51459543971 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:24:17.440570 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fd8a79bf-dc6d-4e18-a151-c51459543971 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:24:17.566496 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-fd8a79bf-dc6d-4e18-a151-c51459543971 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:24:17.574099 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-fd8a79bf-dc6d-4e18-a151-c51459543971 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.146394 Nov 09 20:24:17.574656 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 820/1668] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:24:17 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:24:18.591133 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-914bc524-b3e5-48b1-8a87-160b2681b49d tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:24:18.591731 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-914bc524-b3e5-48b1-8a87-160b2681b49d tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:24:18.597969 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-914bc524-b3e5-48b1-8a87-160b2681b49d tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:24:18.598419 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-914bc524-b3e5-48b1-8a87-160b2681b49d tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:24:18.599193 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-914bc524-b3e5-48b1-8a87-160b2681b49d tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:24:18.600275 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-914bc524-b3e5-48b1-8a87-160b2681b49d tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:24:18.731824 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-914bc524-b3e5-48b1-8a87-160b2681b49d tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:24:18.739483 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-914bc524-b3e5-48b1-8a87-160b2681b49d tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.152130 Nov 09 20:24:18.741363 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 849/1669] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:24:18 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:24:19.758105 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-8c655a47-a1a0-4730-bc9d-9d1e74226c3b tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:24:19.758731 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-8c655a47-a1a0-4730-bc9d-9d1e74226c3b tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:24:19.764993 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8c655a47-a1a0-4730-bc9d-9d1e74226c3b tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:24:19.765434 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8c655a47-a1a0-4730-bc9d-9d1e74226c3b tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:24:19.766196 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8c655a47-a1a0-4730-bc9d-9d1e74226c3b tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:24:19.766619 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8c655a47-a1a0-4730-bc9d-9d1e74226c3b tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:24:19.893158 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-8c655a47-a1a0-4730-bc9d-9d1e74226c3b tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:24:19.900916 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-8c655a47-a1a0-4730-bc9d-9d1e74226c3b tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.147103 Nov 09 20:24:19.901438 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 821/1670] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:24:19 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:24:20.918170 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-0bfd4aa6-bd99-4e53-9fca-b8acee310494 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:24:20.918805 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-0bfd4aa6-bd99-4e53-9fca-b8acee310494 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:24:20.925036 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-0bfd4aa6-bd99-4e53-9fca-b8acee310494 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:24:20.925481 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-0bfd4aa6-bd99-4e53-9fca-b8acee310494 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:24:20.926250 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-0bfd4aa6-bd99-4e53-9fca-b8acee310494 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:24:20.926681 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-0bfd4aa6-bd99-4e53-9fca-b8acee310494 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:24:21.056337 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-0bfd4aa6-bd99-4e53-9fca-b8acee310494 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:24:21.064011 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-0bfd4aa6-bd99-4e53-9fca-b8acee310494 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.149540 Nov 09 20:24:21.064610 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 850/1671] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:24:20 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:24:22.081879 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-c1229893-8eb8-4390-9109-09123e5f7454 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:24:22.082525 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-c1229893-8eb8-4390-9109-09123e5f7454 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:24:22.089441 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c1229893-8eb8-4390-9109-09123e5f7454 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:24:22.089892 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c1229893-8eb8-4390-9109-09123e5f7454 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:24:22.090673 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c1229893-8eb8-4390-9109-09123e5f7454 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:24:22.091107 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c1229893-8eb8-4390-9109-09123e5f7454 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:24:22.219637 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-c1229893-8eb8-4390-9109-09123e5f7454 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:24:22.228375 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-c1229893-8eb8-4390-9109-09123e5f7454 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.150112 Nov 09 20:24:22.228960 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 822/1672] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:24:22 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:24:23.246095 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-6ac6bc95-e463-47e4-b612-b96377150fe4 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:24:23.246721 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-6ac6bc95-e463-47e4-b612-b96377150fe4 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:24:23.252915 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6ac6bc95-e463-47e4-b612-b96377150fe4 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:24:23.253363 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6ac6bc95-e463-47e4-b612-b96377150fe4 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:24:23.254127 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6ac6bc95-e463-47e4-b612-b96377150fe4 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:24:23.254587 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6ac6bc95-e463-47e4-b612-b96377150fe4 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:24:23.385936 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-6ac6bc95-e463-47e4-b612-b96377150fe4 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:24:23.393785 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-6ac6bc95-e463-47e4-b612-b96377150fe4 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.151367 Nov 09 20:24:23.394339 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 851/1673] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:24:23 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:24:24.410535 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-af3d528a-05ce-4080-9e39-427dd5731113 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:24:24.411143 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-af3d528a-05ce-4080-9e39-427dd5731113 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:24:24.417932 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-af3d528a-05ce-4080-9e39-427dd5731113 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:24:24.418376 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-af3d528a-05ce-4080-9e39-427dd5731113 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:24:24.419145 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-af3d528a-05ce-4080-9e39-427dd5731113 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:24:24.419573 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-af3d528a-05ce-4080-9e39-427dd5731113 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:24:24.552557 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-af3d528a-05ce-4080-9e39-427dd5731113 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:24:24.560297 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-af3d528a-05ce-4080-9e39-427dd5731113 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.153494 Nov 09 20:24:24.560883 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 823/1674] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:24:24 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:24:25.578000 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-7d02570c-cec4-4928-bb77-24dc5ce71ec4 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:24:25.578519 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-7d02570c-cec4-4928-bb77-24dc5ce71ec4 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:24:25.584754 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-7d02570c-cec4-4928-bb77-24dc5ce71ec4 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:24:25.585204 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-7d02570c-cec4-4928-bb77-24dc5ce71ec4 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:24:25.586008 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-7d02570c-cec4-4928-bb77-24dc5ce71ec4 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:24:25.586439 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-7d02570c-cec4-4928-bb77-24dc5ce71ec4 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:24:25.714676 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-7d02570c-cec4-4928-bb77-24dc5ce71ec4 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:24:25.722352 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-7d02570c-cec4-4928-bb77-24dc5ce71ec4 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.148115 Nov 09 20:24:25.722916 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 852/1675] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:24:25 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:24:26.740579 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-e099bf06-df01-45c5-9139-2d10fbcb91b3 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:24:26.741214 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-e099bf06-df01-45c5-9139-2d10fbcb91b3 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:24:26.746836 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e099bf06-df01-45c5-9139-2d10fbcb91b3 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:24:26.747272 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e099bf06-df01-45c5-9139-2d10fbcb91b3 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:24:26.748031 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e099bf06-df01-45c5-9139-2d10fbcb91b3 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:24:26.748475 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e099bf06-df01-45c5-9139-2d10fbcb91b3 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:24:26.877544 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-e099bf06-df01-45c5-9139-2d10fbcb91b3 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:24:26.885895 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-e099bf06-df01-45c5-9139-2d10fbcb91b3 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.149729 Nov 09 20:24:26.886454 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 824/1676] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:24:26 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:24:27.903262 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-cb1a519a-d467-4d8b-90b7-3b511b368ab2 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:24:27.903860 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-cb1a519a-d467-4d8b-90b7-3b511b368ab2 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:24:27.910034 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-cb1a519a-d467-4d8b-90b7-3b511b368ab2 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:24:27.910476 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-cb1a519a-d467-4d8b-90b7-3b511b368ab2 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:24:27.911236 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-cb1a519a-d467-4d8b-90b7-3b511b368ab2 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:24:27.911664 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-cb1a519a-d467-4d8b-90b7-3b511b368ab2 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:24:28.037297 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-cb1a519a-d467-4d8b-90b7-3b511b368ab2 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:24:28.045102 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-cb1a519a-d467-4d8b-90b7-3b511b368ab2 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.145452 Nov 09 20:24:28.045663 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 853/1677] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:24:27 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 20:24:29.062595 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-00404962-8663-4a17-b91d-8c1cb55f9c1e tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:24:29.063187 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-00404962-8663-4a17-b91d-8c1cb55f9c1e tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:24:29.070070 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-00404962-8663-4a17-b91d-8c1cb55f9c1e tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:24:29.070509 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-00404962-8663-4a17-b91d-8c1cb55f9c1e tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:24:29.071347 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-00404962-8663-4a17-b91d-8c1cb55f9c1e tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:24:29.071770 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-00404962-8663-4a17-b91d-8c1cb55f9c1e tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:24:29.203273 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-00404962-8663-4a17-b91d-8c1cb55f9c1e tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:24:29.211698 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-00404962-8663-4a17-b91d-8c1cb55f9c1e tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.152683 Nov 09 20:24:29.212267 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 825/1678] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:24:29 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:24:30.229760 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-d4a9e8c4-a1e1-41d8-8a36-43691782e056 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:24:30.230394 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-d4a9e8c4-a1e1-41d8-8a36-43691782e056 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:24:30.236109 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d4a9e8c4-a1e1-41d8-8a36-43691782e056 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:24:30.236583 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d4a9e8c4-a1e1-41d8-8a36-43691782e056 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:24:30.237341 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d4a9e8c4-a1e1-41d8-8a36-43691782e056 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:24:30.237785 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d4a9e8c4-a1e1-41d8-8a36-43691782e056 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:24:30.373186 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-d4a9e8c4-a1e1-41d8-8a36-43691782e056 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:24:30.380758 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-d4a9e8c4-a1e1-41d8-8a36-43691782e056 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.155752 Nov 09 20:24:30.381395 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 854/1679] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:24:30 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:24:31.398281 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-93fa8998-494b-4375-965c-c6a403f85ffe tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:24:31.398878 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-93fa8998-494b-4375-965c-c6a403f85ffe tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:24:31.405378 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-93fa8998-494b-4375-965c-c6a403f85ffe tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:24:31.405816 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-93fa8998-494b-4375-965c-c6a403f85ffe tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:24:31.406571 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-93fa8998-494b-4375-965c-c6a403f85ffe tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:24:31.406994 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-93fa8998-494b-4375-965c-c6a403f85ffe tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:24:31.534652 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-93fa8998-494b-4375-965c-c6a403f85ffe tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:24:31.543036 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-93fa8998-494b-4375-965c-c6a403f85ffe tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.148398 Nov 09 20:24:31.543594 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 826/1680] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:24:31 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:24:32.561251 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-7fa26a27-8920-4bcc-8334-57a982dbfedc tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:24:32.561855 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-7fa26a27-8920-4bcc-8334-57a982dbfedc tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:24:32.568354 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-7fa26a27-8920-4bcc-8334-57a982dbfedc tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:24:32.568829 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-7fa26a27-8920-4bcc-8334-57a982dbfedc tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:24:32.569598 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-7fa26a27-8920-4bcc-8334-57a982dbfedc tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:24:32.570695 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-7fa26a27-8920-4bcc-8334-57a982dbfedc tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:24:32.705068 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-7fa26a27-8920-4bcc-8334-57a982dbfedc tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:24:32.713100 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-7fa26a27-8920-4bcc-8334-57a982dbfedc tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.155319 Nov 09 20:24:32.713438 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 855/1681] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:24:32 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:24:33.730132 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-1e1ff49a-6f66-4d75-9a41-ae29f9783921 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:24:33.730804 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-1e1ff49a-6f66-4d75-9a41-ae29f9783921 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:24:33.737160 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1e1ff49a-6f66-4d75-9a41-ae29f9783921 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:24:33.737604 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1e1ff49a-6f66-4d75-9a41-ae29f9783921 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:24:33.738370 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1e1ff49a-6f66-4d75-9a41-ae29f9783921 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:24:33.738797 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1e1ff49a-6f66-4d75-9a41-ae29f9783921 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:24:33.879612 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-1e1ff49a-6f66-4d75-9a41-ae29f9783921 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:24:33.888091 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-1e1ff49a-6f66-4d75-9a41-ae29f9783921 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.162203 Nov 09 20:24:33.888691 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 827/1682] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:24:33 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:24:34.905819 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-dc730da1-03d1-4d16-ba1f-2f41c937e52f tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:24:34.906738 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-dc730da1-03d1-4d16-ba1f-2f41c937e52f tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:24:34.913163 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-dc730da1-03d1-4d16-ba1f-2f41c937e52f tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:24:34.913605 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-dc730da1-03d1-4d16-ba1f-2f41c937e52f tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:24:34.915252 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-dc730da1-03d1-4d16-ba1f-2f41c937e52f tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:24:34.915687 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-dc730da1-03d1-4d16-ba1f-2f41c937e52f tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:24:35.041965 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-dc730da1-03d1-4d16-ba1f-2f41c937e52f tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:24:35.049579 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-dc730da1-03d1-4d16-ba1f-2f41c937e52f tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.147902 Nov 09 20:24:35.050259 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 856/1683] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:24:34 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:24:36.066102 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-7df2e06d-3cec-4b00-8911-7a9b50678b3e tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:24:36.066712 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-7df2e06d-3cec-4b00-8911-7a9b50678b3e tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:24:36.073709 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7df2e06d-3cec-4b00-8911-7a9b50678b3e tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:24:36.074239 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7df2e06d-3cec-4b00-8911-7a9b50678b3e tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:24:36.075191 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7df2e06d-3cec-4b00-8911-7a9b50678b3e tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:24:36.075647 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7df2e06d-3cec-4b00-8911-7a9b50678b3e tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:24:36.207580 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-7df2e06d-3cec-4b00-8911-7a9b50678b3e tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:24:36.215683 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-7df2e06d-3cec-4b00-8911-7a9b50678b3e tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.153235 Nov 09 20:24:36.216446 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 828/1684] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:24:36 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:24:37.233496 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-0924e43a-251e-4a80-bb1b-c254ab96da96 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:24:37.233992 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-0924e43a-251e-4a80-bb1b-c254ab96da96 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:24:37.240452 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-0924e43a-251e-4a80-bb1b-c254ab96da96 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:24:37.240930 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-0924e43a-251e-4a80-bb1b-c254ab96da96 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:24:37.241689 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-0924e43a-251e-4a80-bb1b-c254ab96da96 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:24:37.242115 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-0924e43a-251e-4a80-bb1b-c254ab96da96 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:24:37.373200 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-0924e43a-251e-4a80-bb1b-c254ab96da96 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:24:37.380811 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-0924e43a-251e-4a80-bb1b-c254ab96da96 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.151021 Nov 09 20:24:37.381368 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 857/1685] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:24:37 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:24:38.397067 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-dc69df37-d15b-4c5a-80e9-ca20cb7871ef tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:24:38.397673 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-dc69df37-d15b-4c5a-80e9-ca20cb7871ef tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:24:38.404314 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-dc69df37-d15b-4c5a-80e9-ca20cb7871ef tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:24:38.404800 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-dc69df37-d15b-4c5a-80e9-ca20cb7871ef tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:24:38.405574 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-dc69df37-d15b-4c5a-80e9-ca20cb7871ef tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:24:38.406013 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-dc69df37-d15b-4c5a-80e9-ca20cb7871ef tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:24:38.537270 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-dc69df37-d15b-4c5a-80e9-ca20cb7871ef tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:24:38.545263 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-dc69df37-d15b-4c5a-80e9-ca20cb7871ef tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.151841 Nov 09 20:24:38.545818 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 829/1686] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:24:38 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:24:39.561935 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-ffed99f1-73d9-474e-b1e4-183696d30d2c tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:24:39.562571 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-ffed99f1-73d9-474e-b1e4-183696d30d2c tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:24:39.569491 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ffed99f1-73d9-474e-b1e4-183696d30d2c tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:24:39.569939 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ffed99f1-73d9-474e-b1e4-183696d30d2c tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:24:39.571318 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ffed99f1-73d9-474e-b1e4-183696d30d2c tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:24:39.571996 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ffed99f1-73d9-474e-b1e4-183696d30d2c tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:24:39.699057 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-ffed99f1-73d9-474e-b1e4-183696d30d2c tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:24:39.706706 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-ffed99f1-73d9-474e-b1e4-183696d30d2c tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.148437 Nov 09 20:24:39.707268 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 858/1687] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:24:39 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:24:40.724622 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-1270bd9a-2b5d-4f5d-b09e-d68cf69b6b43 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:24:40.725233 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-1270bd9a-2b5d-4f5d-b09e-d68cf69b6b43 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:24:40.731629 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1270bd9a-2b5d-4f5d-b09e-d68cf69b6b43 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:24:40.732072 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1270bd9a-2b5d-4f5d-b09e-d68cf69b6b43 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:24:40.732878 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1270bd9a-2b5d-4f5d-b09e-d68cf69b6b43 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:24:40.733311 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1270bd9a-2b5d-4f5d-b09e-d68cf69b6b43 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:24:40.865587 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-1270bd9a-2b5d-4f5d-b09e-d68cf69b6b43 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:24:40.874016 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-1270bd9a-2b5d-4f5d-b09e-d68cf69b6b43 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.153095 Nov 09 20:24:40.874570 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 830/1688] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:24:40 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:24:41.891433 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-de663e5f-183a-46de-bda9-67a00b111762 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:24:41.892060 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-de663e5f-183a-46de-bda9-67a00b111762 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:24:41.898281 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-de663e5f-183a-46de-bda9-67a00b111762 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:24:41.898659 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-de663e5f-183a-46de-bda9-67a00b111762 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:24:41.899418 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-de663e5f-183a-46de-bda9-67a00b111762 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:24:41.899844 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-de663e5f-183a-46de-bda9-67a00b111762 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:24:42.027971 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-de663e5f-183a-46de-bda9-67a00b111762 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:24:42.035599 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-de663e5f-183a-46de-bda9-67a00b111762 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.147787 Nov 09 20:24:42.036158 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 859/1689] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:24:41 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:24:43.052527 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-9071e285-9a8c-42d0-8db3-e55860fdcf7a tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:24:43.053090 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-9071e285-9a8c-42d0-8db3-e55860fdcf7a tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:24:43.059875 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9071e285-9a8c-42d0-8db3-e55860fdcf7a tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:24:43.060312 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9071e285-9a8c-42d0-8db3-e55860fdcf7a tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:24:43.061114 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9071e285-9a8c-42d0-8db3-e55860fdcf7a tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:24:43.061536 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9071e285-9a8c-42d0-8db3-e55860fdcf7a tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:24:43.190667 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-9071e285-9a8c-42d0-8db3-e55860fdcf7a tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:24:43.199149 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-9071e285-9a8c-42d0-8db3-e55860fdcf7a tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.150316 Nov 09 20:24:43.199707 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 831/1690] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:24:43 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:24:44.216462 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-31bd200b-4986-4b4f-a950-a4a58cfbdb37 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:24:44.217066 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-31bd200b-4986-4b4f-a950-a4a58cfbdb37 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:24:44.223346 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-31bd200b-4986-4b4f-a950-a4a58cfbdb37 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:24:44.223794 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-31bd200b-4986-4b4f-a950-a4a58cfbdb37 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:24:44.224605 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-31bd200b-4986-4b4f-a950-a4a58cfbdb37 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:24:44.225044 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-31bd200b-4986-4b4f-a950-a4a58cfbdb37 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:24:44.363598 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-31bd200b-4986-4b4f-a950-a4a58cfbdb37 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:24:44.371555 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-31bd200b-4986-4b4f-a950-a4a58cfbdb37 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.159186 Nov 09 20:24:44.372121 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 860/1691] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:24:44 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:24:45.390155 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-2c490266-2272-4781-8151-9b49bdbe7003 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:24:45.390842 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-2c490266-2272-4781-8151-9b49bdbe7003 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:24:45.397364 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2c490266-2272-4781-8151-9b49bdbe7003 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:24:45.398091 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2c490266-2272-4781-8151-9b49bdbe7003 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:24:45.398814 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2c490266-2272-4781-8151-9b49bdbe7003 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:24:45.399248 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2c490266-2272-4781-8151-9b49bdbe7003 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:24:45.527722 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-2c490266-2272-4781-8151-9b49bdbe7003 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:24:45.535363 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-2c490266-2272-4781-8151-9b49bdbe7003 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.149026 Nov 09 20:24:45.535841 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 832/1692] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:24:45 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:24:46.552884 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-c32738b8-d204-4d22-bf28-3f80abdeee11 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:24:46.553413 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-c32738b8-d204-4d22-bf28-3f80abdeee11 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:24:46.559672 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c32738b8-d204-4d22-bf28-3f80abdeee11 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:24:46.560111 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c32738b8-d204-4d22-bf28-3f80abdeee11 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:24:46.560899 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c32738b8-d204-4d22-bf28-3f80abdeee11 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:24:46.561325 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c32738b8-d204-4d22-bf28-3f80abdeee11 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:24:46.691792 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-c32738b8-d204-4d22-bf28-3f80abdeee11 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:24:46.699904 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-c32738b8-d204-4d22-bf28-3f80abdeee11 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.150911 Nov 09 20:24:46.700477 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 861/1693] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:24:46 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:24:47.546511 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 09 20:24:47.547030 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: Tue Nov 9 20:24:47 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 09 20:24:47.717395 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-242b53dc-99e9-427b-bbf1-a9bf0a8ceed4 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:24:47.718025 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-242b53dc-99e9-427b-bbf1-a9bf0a8ceed4 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:24:47.724262 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-242b53dc-99e9-427b-bbf1-a9bf0a8ceed4 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:24:47.724731 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-242b53dc-99e9-427b-bbf1-a9bf0a8ceed4 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:24:47.725487 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-242b53dc-99e9-427b-bbf1-a9bf0a8ceed4 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:24:47.725911 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-242b53dc-99e9-427b-bbf1-a9bf0a8ceed4 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:24:47.851756 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-242b53dc-99e9-427b-bbf1-a9bf0a8ceed4 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:24:47.859558 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-242b53dc-99e9-427b-bbf1-a9bf0a8ceed4 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.146316 Nov 09 20:24:47.860100 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 833/1694] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:24:47 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:24:48.877385 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-bbf16cc9-2de2-4f8f-808d-8563e1a58c94 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:24:48.877998 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-bbf16cc9-2de2-4f8f-808d-8563e1a58c94 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:24:48.884171 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-bbf16cc9-2de2-4f8f-808d-8563e1a58c94 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:24:48.884653 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-bbf16cc9-2de2-4f8f-808d-8563e1a58c94 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:24:48.885429 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-bbf16cc9-2de2-4f8f-808d-8563e1a58c94 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:24:48.885865 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-bbf16cc9-2de2-4f8f-808d-8563e1a58c94 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:24:49.013484 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-bbf16cc9-2de2-4f8f-808d-8563e1a58c94 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:24:49.021881 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-bbf16cc9-2de2-4f8f-808d-8563e1a58c94 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.148872 Nov 09 20:24:49.022437 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 862/1695] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:24:48 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:24:50.039310 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-53c84190-27f2-420c-80cc-48c9a64df0f5 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:24:50.039921 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-53c84190-27f2-420c-80cc-48c9a64df0f5 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:24:50.046955 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-53c84190-27f2-420c-80cc-48c9a64df0f5 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:24:50.047434 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-53c84190-27f2-420c-80cc-48c9a64df0f5 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:24:50.048210 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-53c84190-27f2-420c-80cc-48c9a64df0f5 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:24:50.048666 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-53c84190-27f2-420c-80cc-48c9a64df0f5 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:24:50.178464 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-53c84190-27f2-420c-80cc-48c9a64df0f5 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:24:50.186843 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-53c84190-27f2-420c-80cc-48c9a64df0f5 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.151193 Nov 09 20:24:50.187399 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 834/1696] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:24:50 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:24:51.203458 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-675e1f03-c3c7-4576-ac88-d2b2e5bf4149 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:24:51.204058 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-675e1f03-c3c7-4576-ac88-d2b2e5bf4149 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:24:51.210265 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-675e1f03-c3c7-4576-ac88-d2b2e5bf4149 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:24:51.210705 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-675e1f03-c3c7-4576-ac88-d2b2e5bf4149 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:24:51.211466 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-675e1f03-c3c7-4576-ac88-d2b2e5bf4149 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:24:51.211892 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-675e1f03-c3c7-4576-ac88-d2b2e5bf4149 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:24:51.346845 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-675e1f03-c3c7-4576-ac88-d2b2e5bf4149 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:24:51.354500 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-675e1f03-c3c7-4576-ac88-d2b2e5bf4149 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.155358 Nov 09 20:24:51.355052 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 863/1697] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:24:51 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:24:52.372003 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-6d912ff1-61a6-45e5-8482-09667eda2139 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:24:52.372712 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-6d912ff1-61a6-45e5-8482-09667eda2139 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:24:52.378943 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6d912ff1-61a6-45e5-8482-09667eda2139 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:24:52.379383 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6d912ff1-61a6-45e5-8482-09667eda2139 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:24:52.380149 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6d912ff1-61a6-45e5-8482-09667eda2139 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:24:52.380615 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6d912ff1-61a6-45e5-8482-09667eda2139 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:24:52.520001 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-6d912ff1-61a6-45e5-8482-09667eda2139 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:24:52.527733 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-6d912ff1-61a6-45e5-8482-09667eda2139 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.159425 Nov 09 20:24:52.528285 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 835/1698] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:24:52 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:24:53.544849 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-963236d4-ccdb-4df2-b92b-3c0b6c33e902 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:24:53.546062 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-963236d4-ccdb-4df2-b92b-3c0b6c33e902 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:24:53.552172 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-963236d4-ccdb-4df2-b92b-3c0b6c33e902 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:24:53.552644 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-963236d4-ccdb-4df2-b92b-3c0b6c33e902 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:24:53.553410 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-963236d4-ccdb-4df2-b92b-3c0b6c33e902 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:24:53.553838 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-963236d4-ccdb-4df2-b92b-3c0b6c33e902 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:24:53.687371 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-963236d4-ccdb-4df2-b92b-3c0b6c33e902 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:24:53.695282 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-963236d4-ccdb-4df2-b92b-3c0b6c33e902 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.154158 Nov 09 20:24:53.695843 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 864/1699] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:24:53 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:24:54.713300 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-718659c7-b4a0-4214-858c-9b0a29848861 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:24:54.713936 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-718659c7-b4a0-4214-858c-9b0a29848861 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:24:54.720960 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-718659c7-b4a0-4214-858c-9b0a29848861 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:24:54.721401 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-718659c7-b4a0-4214-858c-9b0a29848861 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:24:54.722158 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-718659c7-b4a0-4214-858c-9b0a29848861 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:24:54.722584 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-718659c7-b4a0-4214-858c-9b0a29848861 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:24:54.854675 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-718659c7-b4a0-4214-858c-9b0a29848861 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:24:54.864756 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-718659c7-b4a0-4214-858c-9b0a29848861 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.154097 Nov 09 20:24:54.865344 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 836/1700] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:24:54 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:24:55.882627 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-ae7a12ab-2273-4573-ad95-8ceab47f8afb tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:24:55.883237 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-ae7a12ab-2273-4573-ad95-8ceab47f8afb tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:24:55.889867 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ae7a12ab-2273-4573-ad95-8ceab47f8afb tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:24:55.890317 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ae7a12ab-2273-4573-ad95-8ceab47f8afb tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:24:55.891092 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ae7a12ab-2273-4573-ad95-8ceab47f8afb tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:24:55.891532 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ae7a12ab-2273-4573-ad95-8ceab47f8afb tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:24:56.018637 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-ae7a12ab-2273-4573-ad95-8ceab47f8afb tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:24:56.026288 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-ae7a12ab-2273-4573-ad95-8ceab47f8afb tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.147263 Nov 09 20:24:56.026848 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 865/1701] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:24:55 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:24:57.047509 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-f6b552fb-3a5e-4105-b0ad-88e5dbf5fb81 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:24:57.048192 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-f6b552fb-3a5e-4105-b0ad-88e5dbf5fb81 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:24:57.054296 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f6b552fb-3a5e-4105-b0ad-88e5dbf5fb81 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:24:57.054731 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f6b552fb-3a5e-4105-b0ad-88e5dbf5fb81 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:24:57.055504 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f6b552fb-3a5e-4105-b0ad-88e5dbf5fb81 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:24:57.055926 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f6b552fb-3a5e-4105-b0ad-88e5dbf5fb81 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:24:57.186296 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-f6b552fb-3a5e-4105-b0ad-88e5dbf5fb81 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:24:57.194067 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-f6b552fb-3a5e-4105-b0ad-88e5dbf5fb81 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.150847 Nov 09 20:24:57.194642 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 837/1702] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:24:57 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:24:58.211183 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-f5ef101f-e505-481f-8b0c-b467eef4f0f4 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:24:58.211727 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-f5ef101f-e505-481f-8b0c-b467eef4f0f4 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:24:58.217943 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f5ef101f-e505-481f-8b0c-b467eef4f0f4 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:24:58.218386 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f5ef101f-e505-481f-8b0c-b467eef4f0f4 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:24:58.219162 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f5ef101f-e505-481f-8b0c-b467eef4f0f4 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:24:58.219597 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f5ef101f-e505-481f-8b0c-b467eef4f0f4 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:24:58.351132 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-f5ef101f-e505-481f-8b0c-b467eef4f0f4 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:24:58.359329 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-f5ef101f-e505-481f-8b0c-b467eef4f0f4 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.151813 Nov 09 20:24:58.359886 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 866/1703] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:24:58 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:24:59.376763 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-47d51a12-6a33-4c60-8077-64766a30cb9a tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:24:59.377390 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-47d51a12-6a33-4c60-8077-64766a30cb9a tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:24:59.383661 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-47d51a12-6a33-4c60-8077-64766a30cb9a tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:24:59.384108 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-47d51a12-6a33-4c60-8077-64766a30cb9a tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:24:59.384910 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-47d51a12-6a33-4c60-8077-64766a30cb9a tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:24:59.385345 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-47d51a12-6a33-4c60-8077-64766a30cb9a tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:24:59.511660 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-47d51a12-6a33-4c60-8077-64766a30cb9a tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:24:59.519860 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-47d51a12-6a33-4c60-8077-64766a30cb9a tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.147055 Nov 09 20:24:59.520477 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 838/1704] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:24:59 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:25:00.537153 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-641dda25-d2b0-4ce0-b312-d50a913f61db tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:25:00.537721 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-641dda25-d2b0-4ce0-b312-d50a913f61db tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:25:00.544766 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-641dda25-d2b0-4ce0-b312-d50a913f61db tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:25:00.545208 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-641dda25-d2b0-4ce0-b312-d50a913f61db tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:25:00.546009 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-641dda25-d2b0-4ce0-b312-d50a913f61db tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:25:00.546431 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-641dda25-d2b0-4ce0-b312-d50a913f61db tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:25:00.681381 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-641dda25-d2b0-4ce0-b312-d50a913f61db tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:25:00.689019 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-641dda25-d2b0-4ce0-b312-d50a913f61db tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.155542 Nov 09 20:25:00.689584 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 867/1705] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:25:00 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:25:01.705810 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-3858b251-fd54-446b-9304-84a2cb42457a tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:25:01.706432 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-3858b251-fd54-446b-9304-84a2cb42457a tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:25:01.712580 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3858b251-fd54-446b-9304-84a2cb42457a tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:25:01.713015 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3858b251-fd54-446b-9304-84a2cb42457a tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:25:01.713766 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3858b251-fd54-446b-9304-84a2cb42457a tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:25:01.714189 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3858b251-fd54-446b-9304-84a2cb42457a tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:25:01.840000 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-3858b251-fd54-446b-9304-84a2cb42457a tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:25:01.848193 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-3858b251-fd54-446b-9304-84a2cb42457a tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.146014 Nov 09 20:25:01.848844 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 839/1706] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:25:01 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:25:02.865395 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-289d6926-cfbe-4b9c-8844-67ba287be6b7 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:25:02.866256 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-289d6926-cfbe-4b9c-8844-67ba287be6b7 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:25:02.872388 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-289d6926-cfbe-4b9c-8844-67ba287be6b7 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:25:02.872861 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-289d6926-cfbe-4b9c-8844-67ba287be6b7 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:25:02.873628 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-289d6926-cfbe-4b9c-8844-67ba287be6b7 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:25:02.874058 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-289d6926-cfbe-4b9c-8844-67ba287be6b7 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:25:02.999959 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-289d6926-cfbe-4b9c-8844-67ba287be6b7 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:25:03.008178 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-289d6926-cfbe-4b9c-8844-67ba287be6b7 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.146392 Nov 09 20:25:03.008768 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 868/1707] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:25:02 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:25:04.071906 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-90d4a022-efa6-4595-ac36-0ec0fa38686b tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:25:04.072532 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-90d4a022-efa6-4595-ac36-0ec0fa38686b tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:25:04.079270 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-90d4a022-efa6-4595-ac36-0ec0fa38686b tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:25:04.079703 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-90d4a022-efa6-4595-ac36-0ec0fa38686b tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:25:04.080481 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-90d4a022-efa6-4595-ac36-0ec0fa38686b tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:25:04.080911 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-90d4a022-efa6-4595-ac36-0ec0fa38686b tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:25:04.210375 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-90d4a022-efa6-4595-ac36-0ec0fa38686b tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:25:04.218071 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-90d4a022-efa6-4595-ac36-0ec0fa38686b tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.149811 Nov 09 20:25:04.219536 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 840/1708] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:25:04 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:25:05.235159 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-3163d529-c5ba-439b-a2c0-6bf8da7b8ab0 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:25:05.235796 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-3163d529-c5ba-439b-a2c0-6bf8da7b8ab0 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:25:05.242333 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-3163d529-c5ba-439b-a2c0-6bf8da7b8ab0 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:25:05.242778 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-3163d529-c5ba-439b-a2c0-6bf8da7b8ab0 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:25:05.243540 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-3163d529-c5ba-439b-a2c0-6bf8da7b8ab0 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:25:05.243966 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-3163d529-c5ba-439b-a2c0-6bf8da7b8ab0 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:25:05.373022 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-3163d529-c5ba-439b-a2c0-6bf8da7b8ab0 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:25:05.380928 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-3163d529-c5ba-439b-a2c0-6bf8da7b8ab0 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.149328 Nov 09 20:25:05.381501 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 869/1709] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:25:05 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:25:06.397779 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-9e39bf1a-9d62-4abc-8a2b-1ea2bf433331 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:25:06.398454 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-9e39bf1a-9d62-4abc-8a2b-1ea2bf433331 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:25:06.404242 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9e39bf1a-9d62-4abc-8a2b-1ea2bf433331 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:25:06.404729 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9e39bf1a-9d62-4abc-8a2b-1ea2bf433331 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:25:06.405504 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9e39bf1a-9d62-4abc-8a2b-1ea2bf433331 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:25:06.405933 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9e39bf1a-9d62-4abc-8a2b-1ea2bf433331 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:25:06.536451 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-9e39bf1a-9d62-4abc-8a2b-1ea2bf433331 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:25:06.543996 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-9e39bf1a-9d62-4abc-8a2b-1ea2bf433331 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.150204 Nov 09 20:25:06.544585 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 841/1710] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:25:06 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:25:07.562073 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-149db41d-b873-4228-9098-9fabbcf4e3be tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:25:07.562613 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-149db41d-b873-4228-9098-9fabbcf4e3be tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:25:07.569507 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-149db41d-b873-4228-9098-9fabbcf4e3be tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:25:07.569952 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-149db41d-b873-4228-9098-9fabbcf4e3be tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:25:07.570720 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-149db41d-b873-4228-9098-9fabbcf4e3be tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:25:07.571148 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-149db41d-b873-4228-9098-9fabbcf4e3be tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:25:07.698379 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-149db41d-b873-4228-9098-9fabbcf4e3be tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:25:07.706119 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-149db41d-b873-4228-9098-9fabbcf4e3be tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.147813 Nov 09 20:25:07.706675 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 870/1711] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:25:07 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:25:08.722934 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-1e43340b-bff5-47ed-a119-b1ae8478dc80 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:25:08.723453 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-1e43340b-bff5-47ed-a119-b1ae8478dc80 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:25:08.729660 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1e43340b-bff5-47ed-a119-b1ae8478dc80 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:25:08.730104 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1e43340b-bff5-47ed-a119-b1ae8478dc80 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:25:08.730873 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1e43340b-bff5-47ed-a119-b1ae8478dc80 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:25:08.731307 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1e43340b-bff5-47ed-a119-b1ae8478dc80 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:25:08.859966 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-1e43340b-bff5-47ed-a119-b1ae8478dc80 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:25:08.867972 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-1e43340b-bff5-47ed-a119-b1ae8478dc80 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.148771 Nov 09 20:25:08.868557 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 842/1712] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:25:08 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:25:09.885561 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-1dd1a7e6-e819-4219-ad59-e5688753b182 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:25:09.886169 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-1dd1a7e6-e819-4219-ad59-e5688753b182 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:25:09.892566 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-1dd1a7e6-e819-4219-ad59-e5688753b182 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:25:09.893016 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-1dd1a7e6-e819-4219-ad59-e5688753b182 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:25:09.893788 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-1dd1a7e6-e819-4219-ad59-e5688753b182 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:25:09.894221 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-1dd1a7e6-e819-4219-ad59-e5688753b182 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:25:10.025603 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-1dd1a7e6-e819-4219-ad59-e5688753b182 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:25:10.033366 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-1dd1a7e6-e819-4219-ad59-e5688753b182 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.151444 Nov 09 20:25:10.033929 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 871/1713] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:25:09 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:25:11.050766 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-fb0a4e33-81ba-414d-a6fc-581a564336a5 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:25:11.051404 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-fb0a4e33-81ba-414d-a6fc-581a564336a5 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:25:11.057499 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fb0a4e33-81ba-414d-a6fc-581a564336a5 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:25:11.057935 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fb0a4e33-81ba-414d-a6fc-581a564336a5 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:25:11.058692 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fb0a4e33-81ba-414d-a6fc-581a564336a5 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:25:11.059112 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fb0a4e33-81ba-414d-a6fc-581a564336a5 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:25:11.189001 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-fb0a4e33-81ba-414d-a6fc-581a564336a5 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:25:11.196669 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-fb0a4e33-81ba-414d-a6fc-581a564336a5 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.150120 Nov 09 20:25:11.197232 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 843/1714] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:25:11 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:25:12.213742 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-974437b8-8c2f-4b31-a647-2c402b36be26 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:25:12.214284 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-974437b8-8c2f-4b31-a647-2c402b36be26 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:25:12.221254 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-974437b8-8c2f-4b31-a647-2c402b36be26 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:25:12.221707 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-974437b8-8c2f-4b31-a647-2c402b36be26 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:25:12.222484 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-974437b8-8c2f-4b31-a647-2c402b36be26 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:25:12.222920 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-974437b8-8c2f-4b31-a647-2c402b36be26 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:25:12.353251 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-974437b8-8c2f-4b31-a647-2c402b36be26 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:25:12.360969 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-974437b8-8c2f-4b31-a647-2c402b36be26 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.150952 Nov 09 20:25:12.361529 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 872/1715] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:25:12 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:25:13.378485 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-84ce2735-b9c8-4062-9f98-72c2ddecd192 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:25:13.379082 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-84ce2735-b9c8-4062-9f98-72c2ddecd192 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:25:13.385237 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-84ce2735-b9c8-4062-9f98-72c2ddecd192 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:25:13.385681 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-84ce2735-b9c8-4062-9f98-72c2ddecd192 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:25:13.386432 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-84ce2735-b9c8-4062-9f98-72c2ddecd192 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:25:13.386854 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-84ce2735-b9c8-4062-9f98-72c2ddecd192 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:25:13.512683 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-84ce2735-b9c8-4062-9f98-72c2ddecd192 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:25:13.521295 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-84ce2735-b9c8-4062-9f98-72c2ddecd192 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.146514 Nov 09 20:25:13.521857 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 844/1716] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:25:13 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:25:14.538143 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-3d5aa117-f66c-43b7-883c-3e5eafaa1c3c tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:25:14.538759 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-3d5aa117-f66c-43b7-883c-3e5eafaa1c3c tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:25:14.544970 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-3d5aa117-f66c-43b7-883c-3e5eafaa1c3c tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:25:14.545423 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-3d5aa117-f66c-43b7-883c-3e5eafaa1c3c tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:25:14.546195 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-3d5aa117-f66c-43b7-883c-3e5eafaa1c3c tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:25:14.546630 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-3d5aa117-f66c-43b7-883c-3e5eafaa1c3c tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:25:14.680319 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-3d5aa117-f66c-43b7-883c-3e5eafaa1c3c tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:25:14.687997 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-3d5aa117-f66c-43b7-883c-3e5eafaa1c3c tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.153595 Nov 09 20:25:14.688749 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 873/1717] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:25:14 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:25:15.705313 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-a71d9a02-2a97-4e5d-923b-9394ba824b1c tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:25:15.705920 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-a71d9a02-2a97-4e5d-923b-9394ba824b1c tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:25:15.712133 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a71d9a02-2a97-4e5d-923b-9394ba824b1c tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:25:15.712618 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a71d9a02-2a97-4e5d-923b-9394ba824b1c tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:25:15.713387 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a71d9a02-2a97-4e5d-923b-9394ba824b1c tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:25:15.713821 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a71d9a02-2a97-4e5d-923b-9394ba824b1c tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:25:15.840873 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-a71d9a02-2a97-4e5d-923b-9394ba824b1c tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:25:15.848807 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-a71d9a02-2a97-4e5d-923b-9394ba824b1c tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.147280 Nov 09 20:25:15.849360 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 845/1718] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:25:15 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:25:16.865456 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-79c938c8-170f-4be7-8775-4f3c39ad9f4b tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:25:16.866307 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-79c938c8-170f-4be7-8775-4f3c39ad9f4b tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:25:16.872356 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-79c938c8-170f-4be7-8775-4f3c39ad9f4b tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:25:16.872810 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-79c938c8-170f-4be7-8775-4f3c39ad9f4b tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:25:16.873575 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-79c938c8-170f-4be7-8775-4f3c39ad9f4b tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:25:16.873999 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-79c938c8-170f-4be7-8775-4f3c39ad9f4b tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:25:17.003841 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-79c938c8-170f-4be7-8775-4f3c39ad9f4b tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:25:17.011505 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-79c938c8-170f-4be7-8775-4f3c39ad9f4b tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.149644 Nov 09 20:25:17.012065 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 874/1719] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:25:16 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:25:18.028979 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-517787bc-97aa-4b0e-8ecf-8a6bffcbe808 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:25:18.029579 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-517787bc-97aa-4b0e-8ecf-8a6bffcbe808 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:25:18.036324 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-517787bc-97aa-4b0e-8ecf-8a6bffcbe808 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:25:18.036858 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-517787bc-97aa-4b0e-8ecf-8a6bffcbe808 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:25:18.037614 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-517787bc-97aa-4b0e-8ecf-8a6bffcbe808 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:25:18.038038 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-517787bc-97aa-4b0e-8ecf-8a6bffcbe808 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:25:18.166606 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-517787bc-97aa-4b0e-8ecf-8a6bffcbe808 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:25:18.174143 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-517787bc-97aa-4b0e-8ecf-8a6bffcbe808 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.148713 Nov 09 20:25:18.174698 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 846/1720] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:25:18 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:25:19.191095 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-20c8267c-4a4b-4556-9eb5-3212dbc5c729 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:25:19.191636 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-20c8267c-4a4b-4556-9eb5-3212dbc5c729 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:25:19.197805 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-20c8267c-4a4b-4556-9eb5-3212dbc5c729 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:25:19.198247 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-20c8267c-4a4b-4556-9eb5-3212dbc5c729 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:25:19.199010 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-20c8267c-4a4b-4556-9eb5-3212dbc5c729 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:25:19.199439 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-20c8267c-4a4b-4556-9eb5-3212dbc5c729 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:25:19.328363 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-20c8267c-4a4b-4556-9eb5-3212dbc5c729 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:25:19.336066 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-20c8267c-4a4b-4556-9eb5-3212dbc5c729 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.148823 Nov 09 20:25:19.336650 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 875/1721] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:25:19 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:25:20.353726 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-ac28c5cb-587c-4d62-9769-159907e1e3a6 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:25:20.354351 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-ac28c5cb-587c-4d62-9769-159907e1e3a6 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:25:20.361375 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ac28c5cb-587c-4d62-9769-159907e1e3a6 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:25:20.361825 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ac28c5cb-587c-4d62-9769-159907e1e3a6 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:25:20.362585 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ac28c5cb-587c-4d62-9769-159907e1e3a6 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:25:20.363014 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ac28c5cb-587c-4d62-9769-159907e1e3a6 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:25:20.492667 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-ac28c5cb-587c-4d62-9769-159907e1e3a6 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:25:20.500835 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-ac28c5cb-587c-4d62-9769-159907e1e3a6 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.150205 Nov 09 20:25:20.501388 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 847/1722] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:25:20 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:25:21.518379 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-a319024d-e7cc-474b-a95a-6c64902d598a tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:25:21.518975 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-a319024d-e7cc-474b-a95a-6c64902d598a tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:25:21.525277 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a319024d-e7cc-474b-a95a-6c64902d598a tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:25:21.525718 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a319024d-e7cc-474b-a95a-6c64902d598a tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:25:21.526503 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a319024d-e7cc-474b-a95a-6c64902d598a tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:25:21.526928 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a319024d-e7cc-474b-a95a-6c64902d598a tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:25:21.652985 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-a319024d-e7cc-474b-a95a-6c64902d598a tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:25:21.660853 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-a319024d-e7cc-474b-a95a-6c64902d598a tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.146860 Nov 09 20:25:21.661408 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 876/1723] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:25:21 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:25:22.678085 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-20289a14-d931-4c5f-a0ac-c15317346b3e tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:25:22.678645 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-20289a14-d931-4c5f-a0ac-c15317346b3e tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:25:22.684878 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-20289a14-d931-4c5f-a0ac-c15317346b3e tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:25:22.685325 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-20289a14-d931-4c5f-a0ac-c15317346b3e tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:25:22.686094 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-20289a14-d931-4c5f-a0ac-c15317346b3e tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:25:22.686522 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-20289a14-d931-4c5f-a0ac-c15317346b3e tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:25:22.815960 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-20289a14-d931-4c5f-a0ac-c15317346b3e tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:25:22.823808 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-20289a14-d931-4c5f-a0ac-c15317346b3e tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.149454 Nov 09 20:25:22.824370 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 848/1724] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:25:22 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:25:23.841126 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-d7346694-ee7b-47ec-be7e-663a49f46aaa tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:25:23.841733 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-d7346694-ee7b-47ec-be7e-663a49f46aaa tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:25:23.848650 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d7346694-ee7b-47ec-be7e-663a49f46aaa tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:25:23.849094 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d7346694-ee7b-47ec-be7e-663a49f46aaa tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:25:23.849863 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d7346694-ee7b-47ec-be7e-663a49f46aaa tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:25:23.850292 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d7346694-ee7b-47ec-be7e-663a49f46aaa tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:25:23.978546 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-d7346694-ee7b-47ec-be7e-663a49f46aaa tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:25:23.986784 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-d7346694-ee7b-47ec-be7e-663a49f46aaa tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.149360 Nov 09 20:25:23.987351 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 877/1725] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:25:23 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:25:25.004746 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-27f43ed5-2525-4216-9a29-e8b980dab21e tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:25:25.005345 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-27f43ed5-2525-4216-9a29-e8b980dab21e tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:25:25.011407 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-27f43ed5-2525-4216-9a29-e8b980dab21e tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:25:25.011871 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-27f43ed5-2525-4216-9a29-e8b980dab21e tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:25:25.012663 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-27f43ed5-2525-4216-9a29-e8b980dab21e tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:25:25.013079 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-27f43ed5-2525-4216-9a29-e8b980dab21e tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:25:25.140521 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-27f43ed5-2525-4216-9a29-e8b980dab21e tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:25:25.148057 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-27f43ed5-2525-4216-9a29-e8b980dab21e tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.147735 Nov 09 20:25:25.148638 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 849/1726] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:25:24 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:25:26.165126 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-e67aadc5-a794-4b59-9ef6-5cb121351e62 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:25:26.165755 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-e67aadc5-a794-4b59-9ef6-5cb121351e62 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:25:26.172695 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e67aadc5-a794-4b59-9ef6-5cb121351e62 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:25:26.173170 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e67aadc5-a794-4b59-9ef6-5cb121351e62 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:25:26.173947 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e67aadc5-a794-4b59-9ef6-5cb121351e62 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:25:26.174404 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e67aadc5-a794-4b59-9ef6-5cb121351e62 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:25:26.306381 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-e67aadc5-a794-4b59-9ef6-5cb121351e62 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:25:26.314691 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-e67aadc5-a794-4b59-9ef6-5cb121351e62 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.153183 Nov 09 20:25:26.315264 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 878/1727] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:25:26 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 20:25:27.331927 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-42984106-9e2e-4fe3-9398-358ee63e8344 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:25:27.332577 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-42984106-9e2e-4fe3-9398-358ee63e8344 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:25:27.338191 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-42984106-9e2e-4fe3-9398-358ee63e8344 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:25:27.338628 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-42984106-9e2e-4fe3-9398-358ee63e8344 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:25:27.339385 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-42984106-9e2e-4fe3-9398-358ee63e8344 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:25:27.339810 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-42984106-9e2e-4fe3-9398-358ee63e8344 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:25:27.467143 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-42984106-9e2e-4fe3-9398-358ee63e8344 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:25:27.474803 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-42984106-9e2e-4fe3-9398-358ee63e8344 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.146908 Nov 09 20:25:27.475356 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 850/1728] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:25:27 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:25:28.492263 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-899a010d-1a3b-4902-af82-9f24304b3d33 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:25:28.492906 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-899a010d-1a3b-4902-af82-9f24304b3d33 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:25:28.499020 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-899a010d-1a3b-4902-af82-9f24304b3d33 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:25:28.499458 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-899a010d-1a3b-4902-af82-9f24304b3d33 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:25:28.500218 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-899a010d-1a3b-4902-af82-9f24304b3d33 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:25:28.500735 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-899a010d-1a3b-4902-af82-9f24304b3d33 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:25:28.630034 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-899a010d-1a3b-4902-af82-9f24304b3d33 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:25:28.637878 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-899a010d-1a3b-4902-af82-9f24304b3d33 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.149407 Nov 09 20:25:28.638438 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 879/1729] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:25:28 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:25:29.654623 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-5ce25375-1e72-490b-8356-73ceaeca8013 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:25:29.655263 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-5ce25375-1e72-490b-8356-73ceaeca8013 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:25:29.662023 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5ce25375-1e72-490b-8356-73ceaeca8013 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:25:29.662469 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5ce25375-1e72-490b-8356-73ceaeca8013 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:25:29.663235 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5ce25375-1e72-490b-8356-73ceaeca8013 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:25:29.663666 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5ce25375-1e72-490b-8356-73ceaeca8013 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:25:29.789788 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-5ce25375-1e72-490b-8356-73ceaeca8013 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:25:29.798213 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-5ce25375-1e72-490b-8356-73ceaeca8013 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.147215 Nov 09 20:25:29.798782 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 851/1730] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:25:29 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:25:30.815233 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-ea14f720-0757-4663-959c-d7ae1ab0aee8 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:25:30.815835 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-ea14f720-0757-4663-959c-d7ae1ab0aee8 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:25:30.821960 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ea14f720-0757-4663-959c-d7ae1ab0aee8 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:25:30.822397 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ea14f720-0757-4663-959c-d7ae1ab0aee8 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:25:30.823157 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ea14f720-0757-4663-959c-d7ae1ab0aee8 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:25:30.823578 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ea14f720-0757-4663-959c-d7ae1ab0aee8 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:25:30.949365 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-ea14f720-0757-4663-959c-d7ae1ab0aee8 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:25:30.957191 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-ea14f720-0757-4663-959c-d7ae1ab0aee8 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.146188 Nov 09 20:25:30.957756 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 880/1731] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:25:30 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 20:25:31.974003 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-6fd97adf-6c54-4576-82a6-baef601179ab tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:25:31.974598 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-6fd97adf-6c54-4576-82a6-baef601179ab tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:25:31.980718 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6fd97adf-6c54-4576-82a6-baef601179ab tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:25:31.981157 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6fd97adf-6c54-4576-82a6-baef601179ab tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:25:31.981917 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6fd97adf-6c54-4576-82a6-baef601179ab tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:25:31.982347 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6fd97adf-6c54-4576-82a6-baef601179ab tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:25:32.111690 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-6fd97adf-6c54-4576-82a6-baef601179ab tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:25:32.119552 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-6fd97adf-6c54-4576-82a6-baef601179ab tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.149171 Nov 09 20:25:32.120112 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 852/1732] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:25:31 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:25:33.137267 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-73867aad-96ac-4a6b-99f4-31b45f179d10 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:25:33.137820 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-73867aad-96ac-4a6b-99f4-31b45f179d10 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:25:33.144663 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-73867aad-96ac-4a6b-99f4-31b45f179d10 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:25:33.145115 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-73867aad-96ac-4a6b-99f4-31b45f179d10 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:25:33.145893 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-73867aad-96ac-4a6b-99f4-31b45f179d10 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:25:33.146327 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-73867aad-96ac-4a6b-99f4-31b45f179d10 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:25:33.274597 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-73867aad-96ac-4a6b-99f4-31b45f179d10 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:25:33.282399 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-73867aad-96ac-4a6b-99f4-31b45f179d10 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.148812 Nov 09 20:25:33.282955 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 881/1733] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:25:33 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:25:34.300348 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-3a568041-03ee-4a9b-ae01-31d7e78f244c tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:25:34.301018 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-3a568041-03ee-4a9b-ae01-31d7e78f244c tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:25:34.307216 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3a568041-03ee-4a9b-ae01-31d7e78f244c tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:25:34.307655 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3a568041-03ee-4a9b-ae01-31d7e78f244c tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:25:34.308439 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3a568041-03ee-4a9b-ae01-31d7e78f244c tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:25:34.308875 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3a568041-03ee-4a9b-ae01-31d7e78f244c tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:25:34.439505 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-3a568041-03ee-4a9b-ae01-31d7e78f244c tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:25:34.447056 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-3a568041-03ee-4a9b-ae01-31d7e78f244c tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.151450 Nov 09 20:25:34.447606 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 853/1734] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:25:34 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:25:35.464259 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-c851ef27-f0e3-42b9-a1c3-de0403b001fc tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:25:35.464913 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-c851ef27-f0e3-42b9-a1c3-de0403b001fc tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:25:35.471147 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c851ef27-f0e3-42b9-a1c3-de0403b001fc tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:25:35.471589 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c851ef27-f0e3-42b9-a1c3-de0403b001fc tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:25:35.472351 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c851ef27-f0e3-42b9-a1c3-de0403b001fc tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:25:35.472843 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c851ef27-f0e3-42b9-a1c3-de0403b001fc tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:25:35.600757 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-c851ef27-f0e3-42b9-a1c3-de0403b001fc tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:25:35.608503 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-c851ef27-f0e3-42b9-a1c3-de0403b001fc tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.147833 Nov 09 20:25:35.609070 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 882/1735] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:25:35 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:25:36.626812 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-dc420a0c-baf4-4e6e-a0d4-c18284639099 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:25:36.627388 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-dc420a0c-baf4-4e6e-a0d4-c18284639099 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:25:36.633585 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-dc420a0c-baf4-4e6e-a0d4-c18284639099 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:25:36.634018 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-dc420a0c-baf4-4e6e-a0d4-c18284639099 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:25:36.634773 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-dc420a0c-baf4-4e6e-a0d4-c18284639099 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:25:36.635202 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-dc420a0c-baf4-4e6e-a0d4-c18284639099 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:25:36.767018 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-dc420a0c-baf4-4e6e-a0d4-c18284639099 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:25:36.774810 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-dc420a0c-baf4-4e6e-a0d4-c18284639099 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.152141 Nov 09 20:25:36.775383 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 854/1736] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:25:36 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:25:37.792100 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-fe17fd33-18c0-45d6-a426-ca79af86ac8f tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:25:37.792738 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-fe17fd33-18c0-45d6-a426-ca79af86ac8f tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:25:37.799377 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-fe17fd33-18c0-45d6-a426-ca79af86ac8f tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:25:37.799829 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-fe17fd33-18c0-45d6-a426-ca79af86ac8f tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:25:37.800643 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-fe17fd33-18c0-45d6-a426-ca79af86ac8f tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:25:37.801082 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-fe17fd33-18c0-45d6-a426-ca79af86ac8f tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:25:37.932282 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-fe17fd33-18c0-45d6-a426-ca79af86ac8f tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:25:37.940882 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-fe17fd33-18c0-45d6-a426-ca79af86ac8f tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.152461 Nov 09 20:25:37.941450 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 883/1737] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:25:37 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:25:38.957722 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-fa19601f-7f9d-4a1f-bd99-9bad69e26f1d tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:25:38.958397 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-fa19601f-7f9d-4a1f-bd99-9bad69e26f1d tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:25:38.964778 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fa19601f-7f9d-4a1f-bd99-9bad69e26f1d tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:25:38.965216 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fa19601f-7f9d-4a1f-bd99-9bad69e26f1d tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:25:38.965982 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fa19601f-7f9d-4a1f-bd99-9bad69e26f1d tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:25:38.966419 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fa19601f-7f9d-4a1f-bd99-9bad69e26f1d tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:25:39.095713 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-fa19601f-7f9d-4a1f-bd99-9bad69e26f1d tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:25:39.103545 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-fa19601f-7f9d-4a1f-bd99-9bad69e26f1d tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.149604 Nov 09 20:25:39.104032 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 855/1738] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:25:38 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:25:40.121596 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-6b9e8984-4eb7-4c14-8aac-ecfe9b207240 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:25:40.122210 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-6b9e8984-4eb7-4c14-8aac-ecfe9b207240 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:25:40.129343 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6b9e8984-4eb7-4c14-8aac-ecfe9b207240 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:25:40.129792 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6b9e8984-4eb7-4c14-8aac-ecfe9b207240 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:25:40.130584 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6b9e8984-4eb7-4c14-8aac-ecfe9b207240 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:25:40.131004 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6b9e8984-4eb7-4c14-8aac-ecfe9b207240 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:25:40.498785 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-6b9e8984-4eb7-4c14-8aac-ecfe9b207240 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:25:40.507129 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-6b9e8984-4eb7-4c14-8aac-ecfe9b207240 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.389212 Nov 09 20:25:40.507694 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 884/1739] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:25:40 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:25:41.524325 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-eb6673d9-763d-47e0-b06d-b2b02b824a15 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:25:41.524911 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-eb6673d9-763d-47e0-b06d-b2b02b824a15 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:25:41.531037 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-eb6673d9-763d-47e0-b06d-b2b02b824a15 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:25:41.531473 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-eb6673d9-763d-47e0-b06d-b2b02b824a15 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:25:41.532942 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-eb6673d9-763d-47e0-b06d-b2b02b824a15 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:25:41.533362 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-eb6673d9-763d-47e0-b06d-b2b02b824a15 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:25:41.660132 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-eb6673d9-763d-47e0-b06d-b2b02b824a15 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:25:41.667705 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-eb6673d9-763d-47e0-b06d-b2b02b824a15 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.147058 Nov 09 20:25:41.668251 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 856/1740] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:25:41 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:25:42.684844 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-f0f21beb-43d4-4cd1-84e5-adf8f1689662 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:25:42.685443 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-f0f21beb-43d4-4cd1-84e5-adf8f1689662 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:25:42.691820 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f0f21beb-43d4-4cd1-84e5-adf8f1689662 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:25:42.692274 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f0f21beb-43d4-4cd1-84e5-adf8f1689662 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:25:42.693077 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f0f21beb-43d4-4cd1-84e5-adf8f1689662 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:25:42.693514 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f0f21beb-43d4-4cd1-84e5-adf8f1689662 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:25:42.823135 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-f0f21beb-43d4-4cd1-84e5-adf8f1689662 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:25:42.831649 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-f0f21beb-43d4-4cd1-84e5-adf8f1689662 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.150504 Nov 09 20:25:42.832205 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 885/1741] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:25:42 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:25:43.849328 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-890e7737-71fd-4fd2-b7bf-a97a15de6f37 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:25:43.849921 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-890e7737-71fd-4fd2-b7bf-a97a15de6f37 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:25:43.856199 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-890e7737-71fd-4fd2-b7bf-a97a15de6f37 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:25:43.856663 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-890e7737-71fd-4fd2-b7bf-a97a15de6f37 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:25:43.857420 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-890e7737-71fd-4fd2-b7bf-a97a15de6f37 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:25:43.857842 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-890e7737-71fd-4fd2-b7bf-a97a15de6f37 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:25:43.981385 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-890e7737-71fd-4fd2-b7bf-a97a15de6f37 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:25:43.989719 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-890e7737-71fd-4fd2-b7bf-a97a15de6f37 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.144017 Nov 09 20:25:43.990271 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 857/1742] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:25:43 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:25:45.006814 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-487fbd38-11ef-407b-8783-6df59f8a0c98 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:25:45.007414 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-487fbd38-11ef-407b-8783-6df59f8a0c98 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:25:45.013569 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-487fbd38-11ef-407b-8783-6df59f8a0c98 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:25:45.014039 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-487fbd38-11ef-407b-8783-6df59f8a0c98 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:25:45.014803 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-487fbd38-11ef-407b-8783-6df59f8a0c98 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:25:45.015226 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-487fbd38-11ef-407b-8783-6df59f8a0c98 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:25:45.141954 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-487fbd38-11ef-407b-8783-6df59f8a0c98 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:25:45.149625 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-487fbd38-11ef-407b-8783-6df59f8a0c98 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.146510 Nov 09 20:25:45.150190 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 886/1743] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:25:45 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:25:46.167314 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-7febffa9-4d7a-424a-ae75-cd0087f5a715 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:25:46.167916 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-7febffa9-4d7a-424a-ae75-cd0087f5a715 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:25:46.175159 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7febffa9-4d7a-424a-ae75-cd0087f5a715 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:25:46.175600 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7febffa9-4d7a-424a-ae75-cd0087f5a715 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:25:46.176364 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7febffa9-4d7a-424a-ae75-cd0087f5a715 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:25:46.176818 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7febffa9-4d7a-424a-ae75-cd0087f5a715 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:25:46.313849 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-7febffa9-4d7a-424a-ae75-cd0087f5a715 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:25:46.321591 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-7febffa9-4d7a-424a-ae75-cd0087f5a715 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.157926 Nov 09 20:25:46.322133 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 858/1744] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:25:46 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:25:47.338588 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-8f2b5865-1e55-4ad0-9034-4059ac634343 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:25:47.339232 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-8f2b5865-1e55-4ad0-9034-4059ac634343 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:25:47.345500 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-8f2b5865-1e55-4ad0-9034-4059ac634343 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:25:47.345950 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-8f2b5865-1e55-4ad0-9034-4059ac634343 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:25:47.346728 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-8f2b5865-1e55-4ad0-9034-4059ac634343 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:25:47.347166 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-8f2b5865-1e55-4ad0-9034-4059ac634343 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:25:47.474130 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-8f2b5865-1e55-4ad0-9034-4059ac634343 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:25:47.481705 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-8f2b5865-1e55-4ad0-9034-4059ac634343 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.146739 Nov 09 20:25:47.482261 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 887/1745] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:25:47 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:25:48.499062 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-0fcc7af2-a5c8-4d54-8fed-3272ede69653 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:25:48.499664 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-0fcc7af2-a5c8-4d54-8fed-3272ede69653 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:25:48.505816 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0fcc7af2-a5c8-4d54-8fed-3272ede69653 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:25:48.506253 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0fcc7af2-a5c8-4d54-8fed-3272ede69653 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:25:48.507002 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0fcc7af2-a5c8-4d54-8fed-3272ede69653 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:25:48.507425 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0fcc7af2-a5c8-4d54-8fed-3272ede69653 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:25:48.639387 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-0fcc7af2-a5c8-4d54-8fed-3272ede69653 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:25:48.647090 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-0fcc7af2-a5c8-4d54-8fed-3272ede69653 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.151620 Nov 09 20:25:48.647642 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 859/1746] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:25:48 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:25:49.664714 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-797b9831-b70c-431c-8ef0-415c3bb43d80 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:25:49.665321 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-797b9831-b70c-431c-8ef0-415c3bb43d80 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:25:49.671528 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-797b9831-b70c-431c-8ef0-415c3bb43d80 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:25:49.671973 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-797b9831-b70c-431c-8ef0-415c3bb43d80 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:25:49.673290 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-797b9831-b70c-431c-8ef0-415c3bb43d80 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:25:49.673722 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-797b9831-b70c-431c-8ef0-415c3bb43d80 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:25:49.799687 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-797b9831-b70c-431c-8ef0-415c3bb43d80 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:25:49.807366 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-797b9831-b70c-431c-8ef0-415c3bb43d80 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.146383 Nov 09 20:25:49.807929 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 888/1747] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:25:49 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:25:50.823841 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-401735c2-72b6-4b84-8a0b-2872d0e702c7 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:25:50.824473 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-401735c2-72b6-4b84-8a0b-2872d0e702c7 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:25:50.830458 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-401735c2-72b6-4b84-8a0b-2872d0e702c7 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:25:50.830903 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-401735c2-72b6-4b84-8a0b-2872d0e702c7 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:25:50.831678 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-401735c2-72b6-4b84-8a0b-2872d0e702c7 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:25:50.832165 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-401735c2-72b6-4b84-8a0b-2872d0e702c7 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:25:50.958820 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-401735c2-72b6-4b84-8a0b-2872d0e702c7 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:25:50.966468 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-401735c2-72b6-4b84-8a0b-2872d0e702c7 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.146214 Nov 09 20:25:50.967068 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 860/1748] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:25:50 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:25:51.983977 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-c7261582-853c-40d2-b88b-3a726982f898 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:25:51.984613 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-c7261582-853c-40d2-b88b-3a726982f898 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:25:51.991035 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c7261582-853c-40d2-b88b-3a726982f898 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:25:51.991740 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c7261582-853c-40d2-b88b-3a726982f898 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:25:51.992542 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c7261582-853c-40d2-b88b-3a726982f898 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:25:51.992980 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c7261582-853c-40d2-b88b-3a726982f898 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:25:52.123452 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-c7261582-853c-40d2-b88b-3a726982f898 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:25:52.131974 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-c7261582-853c-40d2-b88b-3a726982f898 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.151618 Nov 09 20:25:52.132554 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 889/1749] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:25:51 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:25:53.149928 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-1ce445fb-e720-4be1-b8bb-c940a0cc8460 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:25:53.150566 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-1ce445fb-e720-4be1-b8bb-c940a0cc8460 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:25:53.158955 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1ce445fb-e720-4be1-b8bb-c940a0cc8460 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:25:53.159427 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1ce445fb-e720-4be1-b8bb-c940a0cc8460 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:25:53.160902 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1ce445fb-e720-4be1-b8bb-c940a0cc8460 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:25:53.160902 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1ce445fb-e720-4be1-b8bb-c940a0cc8460 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:25:53.304309 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-1ce445fb-e720-4be1-b8bb-c940a0cc8460 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:25:53.311904 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-1ce445fb-e720-4be1-b8bb-c940a0cc8460 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.165684 Nov 09 20:25:53.312465 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 861/1750] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:25:53 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:25:54.327926 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-c1c62a40-58a7-43dd-9b0b-0124cdefcb25 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:25:54.328626 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-c1c62a40-58a7-43dd-9b0b-0124cdefcb25 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:25:54.335491 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c1c62a40-58a7-43dd-9b0b-0124cdefcb25 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:25:54.335872 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c1c62a40-58a7-43dd-9b0b-0124cdefcb25 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:25:54.336662 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c1c62a40-58a7-43dd-9b0b-0124cdefcb25 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:25:54.337092 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c1c62a40-58a7-43dd-9b0b-0124cdefcb25 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:25:54.473015 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-c1c62a40-58a7-43dd-9b0b-0124cdefcb25 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:25:54.480983 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-c1c62a40-58a7-43dd-9b0b-0124cdefcb25 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.156655 Nov 09 20:25:54.481544 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 890/1751] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:25:54 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:25:55.498037 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-1b9a77fd-9e71-4745-967c-a2d1a81530fd tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:25:55.498634 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-1b9a77fd-9e71-4745-967c-a2d1a81530fd tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:25:55.504954 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1b9a77fd-9e71-4745-967c-a2d1a81530fd tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:25:55.505391 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1b9a77fd-9e71-4745-967c-a2d1a81530fd tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:25:55.506148 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1b9a77fd-9e71-4745-967c-a2d1a81530fd tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:25:55.506572 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1b9a77fd-9e71-4745-967c-a2d1a81530fd tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:25:55.635001 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-1b9a77fd-9e71-4745-967c-a2d1a81530fd tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:25:55.643671 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-1b9a77fd-9e71-4745-967c-a2d1a81530fd tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.149225 Nov 09 20:25:55.644241 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 862/1752] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:25:55 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:25:56.661401 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-ea0866f4-6d9c-472c-b3ca-e7031ed2e23f tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:25:56.661985 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-ea0866f4-6d9c-472c-b3ca-e7031ed2e23f tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:25:56.668114 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ea0866f4-6d9c-472c-b3ca-e7031ed2e23f tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:25:56.668591 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ea0866f4-6d9c-472c-b3ca-e7031ed2e23f tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:25:56.669352 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ea0866f4-6d9c-472c-b3ca-e7031ed2e23f tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:25:56.669779 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ea0866f4-6d9c-472c-b3ca-e7031ed2e23f tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:25:56.815842 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-ea0866f4-6d9c-472c-b3ca-e7031ed2e23f tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:25:56.823815 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-ea0866f4-6d9c-472c-b3ca-e7031ed2e23f tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.166971 Nov 09 20:25:56.824797 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 891/1753] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:25:56 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:25:57.840530 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-93f42e03-aa82-478f-8f18-3710e3335eae tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:25:57.841132 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-93f42e03-aa82-478f-8f18-3710e3335eae tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:25:57.847020 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-93f42e03-aa82-478f-8f18-3710e3335eae tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:25:57.847657 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-93f42e03-aa82-478f-8f18-3710e3335eae tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:25:57.848436 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-93f42e03-aa82-478f-8f18-3710e3335eae tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:25:57.848868 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-93f42e03-aa82-478f-8f18-3710e3335eae tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:25:57.976219 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-93f42e03-aa82-478f-8f18-3710e3335eae tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:25:57.983740 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-93f42e03-aa82-478f-8f18-3710e3335eae tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.146947 Nov 09 20:25:57.984292 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 863/1754] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:25:57 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:25:59.003020 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-5b5460ee-e575-491f-b71e-1b77d9e8e254 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:25:59.003455 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-5b5460ee-e575-491f-b71e-1b77d9e8e254 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:25:59.009604 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-5b5460ee-e575-491f-b71e-1b77d9e8e254 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:25:59.010055 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-5b5460ee-e575-491f-b71e-1b77d9e8e254 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:25:59.010892 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-5b5460ee-e575-491f-b71e-1b77d9e8e254 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:25:59.011554 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-5b5460ee-e575-491f-b71e-1b77d9e8e254 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:25:59.097611 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 09 20:25:59.100091 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: Tue Nov 9 20:25:59 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 (ip 10.222.0.25) !!! Nov 09 20:25:59.146028 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-5b5460ee-e575-491f-b71e-1b77d9e8e254 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:25:59.154495 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-5b5460ee-e575-491f-b71e-1b77d9e8e254 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.156028 Nov 09 20:25:59.155077 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 892/1755] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:25:58 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:26:00.171560 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-be90fcb5-ff01-4ca2-a498-df8a8b7b818e tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:26:00.172238 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-be90fcb5-ff01-4ca2-a498-df8a8b7b818e tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:26:00.178624 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-be90fcb5-ff01-4ca2-a498-df8a8b7b818e tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:26:00.179064 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-be90fcb5-ff01-4ca2-a498-df8a8b7b818e tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:26:00.179823 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-be90fcb5-ff01-4ca2-a498-df8a8b7b818e tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:26:00.180248 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-be90fcb5-ff01-4ca2-a498-df8a8b7b818e tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:26:00.311599 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-be90fcb5-ff01-4ca2-a498-df8a8b7b818e tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:26:00.319938 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-be90fcb5-ff01-4ca2-a498-df8a8b7b818e tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.151963 Nov 09 20:26:00.320531 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 864/1756] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:26:00 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:26:01.337433 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-370ff5c8-a3ba-4b6c-887e-2239e6946d5e tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:26:01.338033 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-370ff5c8-a3ba-4b6c-887e-2239e6946d5e tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:26:01.344819 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-370ff5c8-a3ba-4b6c-887e-2239e6946d5e tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:26:01.345273 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-370ff5c8-a3ba-4b6c-887e-2239e6946d5e tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:26:01.346039 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-370ff5c8-a3ba-4b6c-887e-2239e6946d5e tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:26:01.346463 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-370ff5c8-a3ba-4b6c-887e-2239e6946d5e tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:26:01.475432 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-370ff5c8-a3ba-4b6c-887e-2239e6946d5e tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:26:01.483211 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-370ff5c8-a3ba-4b6c-887e-2239e6946d5e tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.149422 Nov 09 20:26:01.483773 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 893/1757] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:26:01 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:26:02.501123 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-3c41eec8-5965-4d1b-ac05-70e3fbe096ca tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:26:02.501814 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-3c41eec8-5965-4d1b-ac05-70e3fbe096ca tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:26:02.508114 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3c41eec8-5965-4d1b-ac05-70e3fbe096ca tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:26:02.508596 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3c41eec8-5965-4d1b-ac05-70e3fbe096ca tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:26:02.509359 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3c41eec8-5965-4d1b-ac05-70e3fbe096ca tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:26:02.509795 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3c41eec8-5965-4d1b-ac05-70e3fbe096ca tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:26:02.640781 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-3c41eec8-5965-4d1b-ac05-70e3fbe096ca tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:26:02.648826 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-3c41eec8-5965-4d1b-ac05-70e3fbe096ca tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.151988 Nov 09 20:26:02.649385 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 865/1758] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:26:02 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:26:03.666857 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-e253d8aa-bef6-4aef-906e-fb4eeef6f9ea tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:26:03.667463 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-e253d8aa-bef6-4aef-906e-fb4eeef6f9ea tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:26:03.674449 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e253d8aa-bef6-4aef-906e-fb4eeef6f9ea tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:26:03.674926 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e253d8aa-bef6-4aef-906e-fb4eeef6f9ea tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:26:03.675724 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e253d8aa-bef6-4aef-906e-fb4eeef6f9ea tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:26:03.676156 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e253d8aa-bef6-4aef-906e-fb4eeef6f9ea tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:26:03.803925 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-e253d8aa-bef6-4aef-906e-fb4eeef6f9ea tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:26:03.811617 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-e253d8aa-bef6-4aef-906e-fb4eeef6f9ea tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.148470 Nov 09 20:26:03.812185 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 894/1759] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:26:03 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:26:04.829806 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-029a99a7-8493-41cf-ad6b-77a053cc38c5 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:26:04.830401 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-029a99a7-8493-41cf-ad6b-77a053cc38c5 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:26:04.836554 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-029a99a7-8493-41cf-ad6b-77a053cc38c5 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:26:04.836991 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-029a99a7-8493-41cf-ad6b-77a053cc38c5 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:26:04.837746 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-029a99a7-8493-41cf-ad6b-77a053cc38c5 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:26:04.838170 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-029a99a7-8493-41cf-ad6b-77a053cc38c5 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:26:04.966484 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-029a99a7-8493-41cf-ad6b-77a053cc38c5 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:26:04.974421 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-029a99a7-8493-41cf-ad6b-77a053cc38c5 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.149000 Nov 09 20:26:04.974969 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 866/1760] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:26:04 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:26:05.610373 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 09 20:26:05.610928 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: Tue Nov 9 20:26:05 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 09 20:26:05.992131 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-adf1df0c-bc1a-453a-894e-0636a705195c tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:26:05.992693 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-adf1df0c-bc1a-453a-894e-0636a705195c tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:26:05.998933 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-adf1df0c-bc1a-453a-894e-0636a705195c tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:26:05.999373 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-adf1df0c-bc1a-453a-894e-0636a705195c tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:26:06.000140 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-adf1df0c-bc1a-453a-894e-0636a705195c tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:26:06.001435 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-adf1df0c-bc1a-453a-894e-0636a705195c tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:26:06.146778 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-adf1df0c-bc1a-453a-894e-0636a705195c tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:26:06.157428 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-adf1df0c-bc1a-453a-894e-0636a705195c tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.169060 Nov 09 20:26:06.158435 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 895/1761] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:26:05 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:26:07.174873 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-4fe45b4a-fa94-491b-a249-798b81c26db4 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:26:07.175468 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-4fe45b4a-fa94-491b-a249-798b81c26db4 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:26:07.181632 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4fe45b4a-fa94-491b-a249-798b81c26db4 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:26:07.182071 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4fe45b4a-fa94-491b-a249-798b81c26db4 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:26:07.182829 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4fe45b4a-fa94-491b-a249-798b81c26db4 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:26:07.183256 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4fe45b4a-fa94-491b-a249-798b81c26db4 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:26:07.319813 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-4fe45b4a-fa94-491b-a249-798b81c26db4 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:26:07.327474 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-4fe45b4a-fa94-491b-a249-798b81c26db4 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.156997 Nov 09 20:26:07.328022 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 867/1762] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:26:07 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:26:08.344898 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-ae47e002-2650-4cf6-adde-d13c332c5bd6 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:26:08.345602 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-ae47e002-2650-4cf6-adde-d13c332c5bd6 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:26:08.351587 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ae47e002-2650-4cf6-adde-d13c332c5bd6 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:26:08.352032 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ae47e002-2650-4cf6-adde-d13c332c5bd6 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:26:08.352823 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ae47e002-2650-4cf6-adde-d13c332c5bd6 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:26:08.353255 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ae47e002-2650-4cf6-adde-d13c332c5bd6 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:26:08.483858 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-ae47e002-2650-4cf6-adde-d13c332c5bd6 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:26:08.491544 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-ae47e002-2650-4cf6-adde-d13c332c5bd6 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.150881 Nov 09 20:26:08.492346 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 896/1763] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:26:08 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:26:09.507623 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-37ba5a36-0554-47f9-a79c-d7f691183dc8 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:26:09.508210 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-37ba5a36-0554-47f9-a79c-d7f691183dc8 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:26:09.514429 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-37ba5a36-0554-47f9-a79c-d7f691183dc8 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:26:09.514872 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-37ba5a36-0554-47f9-a79c-d7f691183dc8 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:26:09.515633 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-37ba5a36-0554-47f9-a79c-d7f691183dc8 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:26:09.516212 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-37ba5a36-0554-47f9-a79c-d7f691183dc8 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:26:09.644264 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-37ba5a36-0554-47f9-a79c-d7f691183dc8 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:26:09.651839 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-37ba5a36-0554-47f9-a79c-d7f691183dc8 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.147839 Nov 09 20:26:09.652392 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 868/1764] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:26:09 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:26:10.669142 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-cf7f40fb-cb20-467e-add7-338b3ab36325 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:26:10.669961 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-cf7f40fb-cb20-467e-add7-338b3ab36325 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:26:10.676958 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-cf7f40fb-cb20-467e-add7-338b3ab36325 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:26:10.677396 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-cf7f40fb-cb20-467e-add7-338b3ab36325 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:26:10.678182 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-cf7f40fb-cb20-467e-add7-338b3ab36325 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:26:10.678625 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-cf7f40fb-cb20-467e-add7-338b3ab36325 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:26:10.810290 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-cf7f40fb-cb20-467e-add7-338b3ab36325 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:26:10.818237 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-cf7f40fb-cb20-467e-add7-338b3ab36325 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.152707 Nov 09 20:26:10.818795 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 897/1765] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:26:10 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:26:11.835370 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-b97245d2-50ae-4bc4-a827-b2aa8d72fc35 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:26:11.835981 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-b97245d2-50ae-4bc4-a827-b2aa8d72fc35 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:26:11.842154 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b97245d2-50ae-4bc4-a827-b2aa8d72fc35 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:26:11.842592 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b97245d2-50ae-4bc4-a827-b2aa8d72fc35 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:26:11.843343 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b97245d2-50ae-4bc4-a827-b2aa8d72fc35 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:26:11.843767 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b97245d2-50ae-4bc4-a827-b2aa8d72fc35 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:26:11.971030 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-b97245d2-50ae-4bc4-a827-b2aa8d72fc35 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:26:11.978587 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-b97245d2-50ae-4bc4-a827-b2aa8d72fc35 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.146805 Nov 09 20:26:11.979139 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 869/1766] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:26:11 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:26:12.215876 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 09 20:26:12.216053 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: Tue Nov 9 20:26:12 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 09 20:26:12.995860 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-34255256-5a67-4bb9-89a1-94b45e4d5898 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:26:12.996500 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-34255256-5a67-4bb9-89a1-94b45e4d5898 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:26:13.002868 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-34255256-5a67-4bb9-89a1-94b45e4d5898 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:26:13.003315 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-34255256-5a67-4bb9-89a1-94b45e4d5898 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:26:13.004092 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-34255256-5a67-4bb9-89a1-94b45e4d5898 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:26:13.004563 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-34255256-5a67-4bb9-89a1-94b45e4d5898 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:26:13.134263 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-34255256-5a67-4bb9-89a1-94b45e4d5898 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:26:13.142576 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-34255256-5a67-4bb9-89a1-94b45e4d5898 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.150703 Nov 09 20:26:13.143134 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 898/1767] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:26:12 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:26:14.159530 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-5093801c-eaeb-45c7-9cb4-6af42223b6ba tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:26:14.160123 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-5093801c-eaeb-45c7-9cb4-6af42223b6ba tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:26:14.166266 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5093801c-eaeb-45c7-9cb4-6af42223b6ba tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:26:14.166704 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5093801c-eaeb-45c7-9cb4-6af42223b6ba tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:26:14.167459 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5093801c-eaeb-45c7-9cb4-6af42223b6ba tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:26:14.167880 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5093801c-eaeb-45c7-9cb4-6af42223b6ba tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:26:14.299053 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-5093801c-eaeb-45c7-9cb4-6af42223b6ba tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:26:14.306957 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-5093801c-eaeb-45c7-9cb4-6af42223b6ba tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.151202 Nov 09 20:26:14.307507 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 870/1768] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:26:14 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:26:15.324428 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-c890f5fd-d12d-4fa9-a589-8a4e6b8c8a16 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:26:15.325043 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-c890f5fd-d12d-4fa9-a589-8a4e6b8c8a16 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:26:15.331566 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c890f5fd-d12d-4fa9-a589-8a4e6b8c8a16 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:26:15.332005 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c890f5fd-d12d-4fa9-a589-8a4e6b8c8a16 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:26:15.332803 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c890f5fd-d12d-4fa9-a589-8a4e6b8c8a16 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:26:15.333227 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c890f5fd-d12d-4fa9-a589-8a4e6b8c8a16 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:26:15.463104 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-c890f5fd-d12d-4fa9-a589-8a4e6b8c8a16 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:26:15.470833 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-c890f5fd-d12d-4fa9-a589-8a4e6b8c8a16 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.150058 Nov 09 20:26:15.471391 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 899/1769] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:26:15 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:26:16.486775 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-f9a2e2c9-571f-4147-96d4-98c0e0b1330c tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:26:16.487379 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-f9a2e2c9-571f-4147-96d4-98c0e0b1330c tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:26:16.493864 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f9a2e2c9-571f-4147-96d4-98c0e0b1330c tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:26:16.494312 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f9a2e2c9-571f-4147-96d4-98c0e0b1330c tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:26:16.495078 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f9a2e2c9-571f-4147-96d4-98c0e0b1330c tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:26:16.495505 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f9a2e2c9-571f-4147-96d4-98c0e0b1330c tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:26:16.624939 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-f9a2e2c9-571f-4147-96d4-98c0e0b1330c tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:26:16.632828 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-f9a2e2c9-571f-4147-96d4-98c0e0b1330c tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.149656 Nov 09 20:26:16.633394 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 871/1770] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:26:16 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:26:17.650767 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-e1ed3aa5-7719-4aac-a4cf-0b6019854922 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:26:17.651374 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-e1ed3aa5-7719-4aac-a4cf-0b6019854922 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:26:17.658166 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e1ed3aa5-7719-4aac-a4cf-0b6019854922 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:26:17.658604 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e1ed3aa5-7719-4aac-a4cf-0b6019854922 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:26:17.659375 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e1ed3aa5-7719-4aac-a4cf-0b6019854922 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:26:17.659803 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e1ed3aa5-7719-4aac-a4cf-0b6019854922 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:26:17.793611 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-e1ed3aa5-7719-4aac-a4cf-0b6019854922 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:26:17.801924 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-e1ed3aa5-7719-4aac-a4cf-0b6019854922 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.154849 Nov 09 20:26:17.802480 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 900/1771] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:26:17 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:26:18.819327 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-713af936-2979-4e24-a45b-1179ba684458 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:26:18.819923 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-713af936-2979-4e24-a45b-1179ba684458 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:26:18.826071 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-713af936-2979-4e24-a45b-1179ba684458 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:26:18.826505 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-713af936-2979-4e24-a45b-1179ba684458 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:26:18.827268 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-713af936-2979-4e24-a45b-1179ba684458 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:26:18.827689 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-713af936-2979-4e24-a45b-1179ba684458 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:26:18.954771 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-713af936-2979-4e24-a45b-1179ba684458 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:26:18.962256 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-713af936-2979-4e24-a45b-1179ba684458 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.146553 Nov 09 20:26:18.962806 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 872/1772] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:26:18 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:26:19.979377 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-ca370baa-b975-4292-9869-7fcd8a8bb071 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:26:19.979985 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-ca370baa-b975-4292-9869-7fcd8a8bb071 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:26:19.986198 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ca370baa-b975-4292-9869-7fcd8a8bb071 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:26:19.986641 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ca370baa-b975-4292-9869-7fcd8a8bb071 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:26:19.987405 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ca370baa-b975-4292-9869-7fcd8a8bb071 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:26:19.987837 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ca370baa-b975-4292-9869-7fcd8a8bb071 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:26:20.120015 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-ca370baa-b975-4292-9869-7fcd8a8bb071 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:26:20.128661 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-ca370baa-b975-4292-9869-7fcd8a8bb071 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.152925 Nov 09 20:26:20.129218 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 901/1773] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:26:19 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:26:21.145821 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-d287ddbc-0a41-4e15-9073-72ae24bc09a8 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:26:21.146423 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-d287ddbc-0a41-4e15-9073-72ae24bc09a8 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:26:21.152856 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d287ddbc-0a41-4e15-9073-72ae24bc09a8 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:26:21.153292 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d287ddbc-0a41-4e15-9073-72ae24bc09a8 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:26:21.154082 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d287ddbc-0a41-4e15-9073-72ae24bc09a8 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:26:21.154505 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d287ddbc-0a41-4e15-9073-72ae24bc09a8 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:26:21.283086 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-d287ddbc-0a41-4e15-9073-72ae24bc09a8 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:26:21.290964 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-d287ddbc-0a41-4e15-9073-72ae24bc09a8 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.148760 Nov 09 20:26:21.291517 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 873/1774] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:26:21 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:26:22.308368 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-af092c0a-80f6-40b7-9a03-ce42160b936c tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:26:22.308995 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-af092c0a-80f6-40b7-9a03-ce42160b936c tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:26:22.315617 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-af092c0a-80f6-40b7-9a03-ce42160b936c tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:26:22.316061 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-af092c0a-80f6-40b7-9a03-ce42160b936c tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:26:22.316866 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-af092c0a-80f6-40b7-9a03-ce42160b936c tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:26:22.317301 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-af092c0a-80f6-40b7-9a03-ce42160b936c tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:26:22.448341 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-af092c0a-80f6-40b7-9a03-ce42160b936c tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:26:22.457048 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-af092c0a-80f6-40b7-9a03-ce42160b936c tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.152322 Nov 09 20:26:22.457608 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 902/1775] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:26:22 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:26:23.474549 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-8192d5fe-1475-4f7d-8ec3-b8b8fdf94f71 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:26:23.475148 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-8192d5fe-1475-4f7d-8ec3-b8b8fdf94f71 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:26:23.481289 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8192d5fe-1475-4f7d-8ec3-b8b8fdf94f71 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:26:23.481727 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8192d5fe-1475-4f7d-8ec3-b8b8fdf94f71 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:26:23.482484 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8192d5fe-1475-4f7d-8ec3-b8b8fdf94f71 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:26:23.482907 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8192d5fe-1475-4f7d-8ec3-b8b8fdf94f71 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:26:23.609857 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-8192d5fe-1475-4f7d-8ec3-b8b8fdf94f71 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:26:23.618701 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-8192d5fe-1475-4f7d-8ec3-b8b8fdf94f71 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.147732 Nov 09 20:26:23.619262 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 874/1776] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:26:23 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:26:24.635352 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-493734b0-f21e-480f-892e-60bb12e25534 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:26:24.635950 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-493734b0-f21e-480f-892e-60bb12e25534 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:26:24.642931 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-493734b0-f21e-480f-892e-60bb12e25534 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:26:24.643379 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-493734b0-f21e-480f-892e-60bb12e25534 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:26:24.644156 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-493734b0-f21e-480f-892e-60bb12e25534 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:26:24.644625 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-493734b0-f21e-480f-892e-60bb12e25534 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:26:24.776248 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-493734b0-f21e-480f-892e-60bb12e25534 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:26:24.784637 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-493734b0-f21e-480f-892e-60bb12e25534 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.152913 Nov 09 20:26:24.785197 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 903/1777] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:26:24 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:26:25.802497 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-391eb5ee-b36f-4cef-b730-ec58764fc8db tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:26:25.803106 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-391eb5ee-b36f-4cef-b730-ec58764fc8db tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:26:25.809397 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-391eb5ee-b36f-4cef-b730-ec58764fc8db tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:26:25.809842 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-391eb5ee-b36f-4cef-b730-ec58764fc8db tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:26:25.810608 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-391eb5ee-b36f-4cef-b730-ec58764fc8db tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:26:25.811038 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-391eb5ee-b36f-4cef-b730-ec58764fc8db tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:26:25.940730 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-391eb5ee-b36f-4cef-b730-ec58764fc8db tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:26:25.948359 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-391eb5ee-b36f-4cef-b730-ec58764fc8db tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.149539 Nov 09 20:26:25.948938 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 875/1778] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:26:25 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:26:26.217449 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 09 20:26:26.217935 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: Tue Nov 9 20:26:26 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 09 20:26:26.966029 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-a9084ebc-3959-4a71-a58f-45aa76f5ab36 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:26:26.966660 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-a9084ebc-3959-4a71-a58f-45aa76f5ab36 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:26:26.973678 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a9084ebc-3959-4a71-a58f-45aa76f5ab36 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:26:26.974114 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a9084ebc-3959-4a71-a58f-45aa76f5ab36 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:26:26.974874 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a9084ebc-3959-4a71-a58f-45aa76f5ab36 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:26:26.975299 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a9084ebc-3959-4a71-a58f-45aa76f5ab36 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:26:27.106501 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-a9084ebc-3959-4a71-a58f-45aa76f5ab36 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:26:27.114142 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-a9084ebc-3959-4a71-a58f-45aa76f5ab36 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.151710 Nov 09 20:26:27.114699 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 904/1779] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:26:26 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:26:28.130723 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-ea72d162-d9eb-4f1b-bb36-62bf44162981 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:26:28.131318 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-ea72d162-d9eb-4f1b-bb36-62bf44162981 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:26:28.137485 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ea72d162-d9eb-4f1b-bb36-62bf44162981 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:26:28.137927 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ea72d162-d9eb-4f1b-bb36-62bf44162981 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:26:28.138684 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ea72d162-d9eb-4f1b-bb36-62bf44162981 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:26:28.139108 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ea72d162-d9eb-4f1b-bb36-62bf44162981 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:26:28.270507 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-ea72d162-d9eb-4f1b-bb36-62bf44162981 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:26:28.278976 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-ea72d162-d9eb-4f1b-bb36-62bf44162981 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.151837 Nov 09 20:26:28.279533 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 876/1780] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:26:28 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:26:29.296551 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-254cda5a-ae64-46d4-a7b1-f8be37e589c9 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:26:29.297152 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-254cda5a-ae64-46d4-a7b1-f8be37e589c9 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:26:29.304129 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-254cda5a-ae64-46d4-a7b1-f8be37e589c9 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:26:29.304611 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-254cda5a-ae64-46d4-a7b1-f8be37e589c9 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:26:29.305387 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-254cda5a-ae64-46d4-a7b1-f8be37e589c9 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:26:29.305814 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-254cda5a-ae64-46d4-a7b1-f8be37e589c9 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:26:29.442595 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-254cda5a-ae64-46d4-a7b1-f8be37e589c9 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:26:29.450205 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-254cda5a-ae64-46d4-a7b1-f8be37e589c9 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.157270 Nov 09 20:26:29.450764 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 905/1781] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:26:29 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:26:30.467078 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-947fb199-8606-4d47-bb4c-c400e3e4478a tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:26:30.467727 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-947fb199-8606-4d47-bb4c-c400e3e4478a tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:26:30.474120 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-947fb199-8606-4d47-bb4c-c400e3e4478a tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:26:30.474558 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-947fb199-8606-4d47-bb4c-c400e3e4478a tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:26:30.475310 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-947fb199-8606-4d47-bb4c-c400e3e4478a tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:26:30.475731 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-947fb199-8606-4d47-bb4c-c400e3e4478a tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:26:30.609036 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-947fb199-8606-4d47-bb4c-c400e3e4478a tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:26:30.616752 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-947fb199-8606-4d47-bb4c-c400e3e4478a tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.153264 Nov 09 20:26:30.617554 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 877/1782] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:26:30 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:26:31.634284 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-37837c29-f5ff-4f9e-8259-c12e5cab6c17 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:26:31.634895 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-37837c29-f5ff-4f9e-8259-c12e5cab6c17 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:26:31.641766 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-37837c29-f5ff-4f9e-8259-c12e5cab6c17 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:26:31.642230 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-37837c29-f5ff-4f9e-8259-c12e5cab6c17 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:26:31.643003 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-37837c29-f5ff-4f9e-8259-c12e5cab6c17 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:26:31.643438 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-37837c29-f5ff-4f9e-8259-c12e5cab6c17 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:26:31.771714 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-37837c29-f5ff-4f9e-8259-c12e5cab6c17 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:26:31.779362 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-37837c29-f5ff-4f9e-8259-c12e5cab6c17 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.148714 Nov 09 20:26:31.779929 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 906/1783] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:26:31 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:26:32.795883 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-2ecb3ae5-40c5-48d9-b040-5775c75fb9d4 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:26:32.796503 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-2ecb3ae5-40c5-48d9-b040-5775c75fb9d4 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:26:32.803444 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2ecb3ae5-40c5-48d9-b040-5775c75fb9d4 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:26:32.803882 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2ecb3ae5-40c5-48d9-b040-5775c75fb9d4 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:26:32.804665 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2ecb3ae5-40c5-48d9-b040-5775c75fb9d4 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:26:32.805093 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2ecb3ae5-40c5-48d9-b040-5775c75fb9d4 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:26:32.937791 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-2ecb3ae5-40c5-48d9-b040-5775c75fb9d4 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:26:32.945419 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-2ecb3ae5-40c5-48d9-b040-5775c75fb9d4 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.153176 Nov 09 20:26:32.945965 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 878/1784] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:26:32 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:26:33.962608 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-4e8ce819-e5e9-4394-a4d0-c61b12c96f59 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:26:33.963187 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-4e8ce819-e5e9-4394-a4d0-c61b12c96f59 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:26:33.969504 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-4e8ce819-e5e9-4394-a4d0-c61b12c96f59 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:26:33.970032 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-4e8ce819-e5e9-4394-a4d0-c61b12c96f59 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:26:33.970793 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-4e8ce819-e5e9-4394-a4d0-c61b12c96f59 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:26:33.971221 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-4e8ce819-e5e9-4394-a4d0-c61b12c96f59 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:26:34.102875 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-4e8ce819-e5e9-4394-a4d0-c61b12c96f59 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:26:34.111449 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-4e8ce819-e5e9-4394-a4d0-c61b12c96f59 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.152453 Nov 09 20:26:34.112000 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 907/1785] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:26:33 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:26:35.129051 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-f54f36a9-0ec9-460b-94e6-cd2f203c382a tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:26:35.129652 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-f54f36a9-0ec9-460b-94e6-cd2f203c382a tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:26:35.135731 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f54f36a9-0ec9-460b-94e6-cd2f203c382a tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:26:35.136175 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f54f36a9-0ec9-460b-94e6-cd2f203c382a tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:26:35.136971 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f54f36a9-0ec9-460b-94e6-cd2f203c382a tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:26:35.137399 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f54f36a9-0ec9-460b-94e6-cd2f203c382a tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:26:35.266687 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-f54f36a9-0ec9-460b-94e6-cd2f203c382a tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:26:35.274300 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-f54f36a9-0ec9-460b-94e6-cd2f203c382a tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.149375 Nov 09 20:26:35.274847 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 879/1786] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:26:35 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:26:36.291165 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-3eca92b6-267e-42cc-aafe-953d583979b0 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:26:36.291772 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-3eca92b6-267e-42cc-aafe-953d583979b0 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:26:36.298157 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-3eca92b6-267e-42cc-aafe-953d583979b0 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:26:36.298605 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-3eca92b6-267e-42cc-aafe-953d583979b0 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:26:36.299377 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-3eca92b6-267e-42cc-aafe-953d583979b0 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:26:36.299808 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-3eca92b6-267e-42cc-aafe-953d583979b0 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:26:36.429379 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-3eca92b6-267e-42cc-aafe-953d583979b0 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:26:36.437021 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-3eca92b6-267e-42cc-aafe-953d583979b0 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.149518 Nov 09 20:26:36.437580 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 908/1787] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:26:36 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:26:37.455024 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-85e560c8-d48e-4f52-a0ed-719735adc599 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:26:37.455621 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-85e560c8-d48e-4f52-a0ed-719735adc599 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:26:37.461817 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-85e560c8-d48e-4f52-a0ed-719735adc599 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:26:37.462251 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-85e560c8-d48e-4f52-a0ed-719735adc599 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:26:37.463006 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-85e560c8-d48e-4f52-a0ed-719735adc599 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:26:37.463433 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-85e560c8-d48e-4f52-a0ed-719735adc599 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:26:37.592124 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-85e560c8-d48e-4f52-a0ed-719735adc599 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:26:37.600287 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-85e560c8-d48e-4f52-a0ed-719735adc599 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.149425 Nov 09 20:26:37.600872 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 880/1788] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:26:37 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:26:38.617647 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-3cc17ae6-8e1b-46a7-8e16-b19365658b98 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:26:38.618247 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-3cc17ae6-8e1b-46a7-8e16-b19365658b98 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:26:38.624419 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-3cc17ae6-8e1b-46a7-8e16-b19365658b98 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:26:38.624873 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-3cc17ae6-8e1b-46a7-8e16-b19365658b98 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:26:38.626186 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-3cc17ae6-8e1b-46a7-8e16-b19365658b98 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:26:38.626610 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-3cc17ae6-8e1b-46a7-8e16-b19365658b98 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:26:38.757161 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-3cc17ae6-8e1b-46a7-8e16-b19365658b98 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:26:38.764782 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-3cc17ae6-8e1b-46a7-8e16-b19365658b98 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.151008 Nov 09 20:26:38.765344 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 909/1789] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:26:38 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:26:39.783222 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-9cdda1b9-5429-48e9-9f22-430c9587d673 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:26:39.783865 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-9cdda1b9-5429-48e9-9f22-430c9587d673 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:26:39.790103 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9cdda1b9-5429-48e9-9f22-430c9587d673 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:26:39.790444 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9cdda1b9-5429-48e9-9f22-430c9587d673 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:26:39.791223 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9cdda1b9-5429-48e9-9f22-430c9587d673 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:26:39.791655 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9cdda1b9-5429-48e9-9f22-430c9587d673 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:26:39.921927 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-9cdda1b9-5429-48e9-9f22-430c9587d673 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:26:39.929592 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-9cdda1b9-5429-48e9-9f22-430c9587d673 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.150610 Nov 09 20:26:39.930135 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 881/1790] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:26:39 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:26:40.946560 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-1f1a9459-bd5f-4d66-960b-74d580a8f4cc tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:26:40.947171 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-1f1a9459-bd5f-4d66-960b-74d580a8f4cc tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:26:40.953316 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-1f1a9459-bd5f-4d66-960b-74d580a8f4cc tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:26:40.953901 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-1f1a9459-bd5f-4d66-960b-74d580a8f4cc tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:26:40.954712 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-1f1a9459-bd5f-4d66-960b-74d580a8f4cc tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:26:40.955146 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-1f1a9459-bd5f-4d66-960b-74d580a8f4cc tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:26:41.080235 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-1f1a9459-bd5f-4d66-960b-74d580a8f4cc tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:26:41.087826 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-1f1a9459-bd5f-4d66-960b-74d580a8f4cc tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.144884 Nov 09 20:26:41.088385 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 910/1791] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:26:40 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:26:42.104335 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-b5b74066-68fb-41fd-a17b-34c58b66dc73 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:26:42.105004 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-b5b74066-68fb-41fd-a17b-34c58b66dc73 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:26:42.112563 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b5b74066-68fb-41fd-a17b-34c58b66dc73 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:26:42.113011 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b5b74066-68fb-41fd-a17b-34c58b66dc73 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:26:42.113784 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b5b74066-68fb-41fd-a17b-34c58b66dc73 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:26:42.114239 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b5b74066-68fb-41fd-a17b-34c58b66dc73 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:26:42.251016 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-b5b74066-68fb-41fd-a17b-34c58b66dc73 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:26:42.258686 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-b5b74066-68fb-41fd-a17b-34c58b66dc73 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.157895 Nov 09 20:26:42.259243 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 882/1792] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:26:42 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:26:43.275665 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-fa239852-60ff-43cd-8e0e-41cd70e1501d tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:26:43.276270 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-fa239852-60ff-43cd-8e0e-41cd70e1501d tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:26:43.282520 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-fa239852-60ff-43cd-8e0e-41cd70e1501d tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:26:43.283589 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-fa239852-60ff-43cd-8e0e-41cd70e1501d tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:26:43.284370 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-fa239852-60ff-43cd-8e0e-41cd70e1501d tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:26:43.284826 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-fa239852-60ff-43cd-8e0e-41cd70e1501d tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:26:43.411370 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-fa239852-60ff-43cd-8e0e-41cd70e1501d tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:26:43.418976 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-fa239852-60ff-43cd-8e0e-41cd70e1501d tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.147018 Nov 09 20:26:43.419463 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 911/1793] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:26:43 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:26:44.435631 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-8bec6e15-0cb0-4603-822e-ac82a4d00f7f tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:26:44.436240 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-8bec6e15-0cb0-4603-822e-ac82a4d00f7f tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:26:44.443087 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8bec6e15-0cb0-4603-822e-ac82a4d00f7f tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:26:44.443569 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8bec6e15-0cb0-4603-822e-ac82a4d00f7f tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:26:44.444335 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8bec6e15-0cb0-4603-822e-ac82a4d00f7f tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:26:44.444800 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8bec6e15-0cb0-4603-822e-ac82a4d00f7f tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:26:44.574897 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-8bec6e15-0cb0-4603-822e-ac82a4d00f7f tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:26:44.582721 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-8bec6e15-0cb0-4603-822e-ac82a4d00f7f tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.150703 Nov 09 20:26:44.583306 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 883/1794] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:26:44 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:26:45.599738 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-49bccf16-387b-4cb0-ab7f-76599d525d6a tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:26:45.600351 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-49bccf16-387b-4cb0-ab7f-76599d525d6a tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:26:45.606302 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-49bccf16-387b-4cb0-ab7f-76599d525d6a tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:26:45.606748 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-49bccf16-387b-4cb0-ab7f-76599d525d6a tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:26:45.607530 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-49bccf16-387b-4cb0-ab7f-76599d525d6a tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:26:45.607965 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-49bccf16-387b-4cb0-ab7f-76599d525d6a tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:26:45.735656 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-49bccf16-387b-4cb0-ab7f-76599d525d6a tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:26:45.744031 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-49bccf16-387b-4cb0-ab7f-76599d525d6a tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.148023 Nov 09 20:26:45.744627 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 912/1795] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:26:45 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:26:46.761806 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-3f193eda-5575-4eb0-8749-d737f07bfeab tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:26:46.762415 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-3f193eda-5575-4eb0-8749-d737f07bfeab tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:26:46.769314 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3f193eda-5575-4eb0-8749-d737f07bfeab tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:26:46.769760 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3f193eda-5575-4eb0-8749-d737f07bfeab tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:26:46.770525 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3f193eda-5575-4eb0-8749-d737f07bfeab tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:26:46.770957 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3f193eda-5575-4eb0-8749-d737f07bfeab tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:26:46.898926 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-3f193eda-5575-4eb0-8749-d737f07bfeab tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:26:46.906772 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-3f193eda-5575-4eb0-8749-d737f07bfeab tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.148719 Nov 09 20:26:46.907331 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 884/1796] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:26:46 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:26:47.923922 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-5c8ff01a-dc24-4616-b968-2a3d386786e3 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:26:47.924612 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-5c8ff01a-dc24-4616-b968-2a3d386786e3 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:26:47.930976 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-5c8ff01a-dc24-4616-b968-2a3d386786e3 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:26:47.931423 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-5c8ff01a-dc24-4616-b968-2a3d386786e3 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:26:47.932185 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-5c8ff01a-dc24-4616-b968-2a3d386786e3 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:26:47.932640 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-5c8ff01a-dc24-4616-b968-2a3d386786e3 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:26:48.061068 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-5c8ff01a-dc24-4616-b968-2a3d386786e3 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:26:48.068771 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-5c8ff01a-dc24-4616-b968-2a3d386786e3 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.148417 Nov 09 20:26:48.069326 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 913/1797] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:26:47 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:26:49.085738 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-c24ae50d-a16a-4367-bbb5-1caf27423a53 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:26:49.086325 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-c24ae50d-a16a-4367-bbb5-1caf27423a53 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:26:49.092552 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c24ae50d-a16a-4367-bbb5-1caf27423a53 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:26:49.092997 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c24ae50d-a16a-4367-bbb5-1caf27423a53 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:26:49.093760 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c24ae50d-a16a-4367-bbb5-1caf27423a53 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:26:49.094190 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c24ae50d-a16a-4367-bbb5-1caf27423a53 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:26:49.222459 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-c24ae50d-a16a-4367-bbb5-1caf27423a53 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:26:49.230106 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-c24ae50d-a16a-4367-bbb5-1caf27423a53 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.148015 Nov 09 20:26:49.230693 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 885/1798] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:26:49 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:26:50.248136 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-72842e3c-51fd-4509-945c-55ec0e5457b2 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:26:50.248710 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-72842e3c-51fd-4509-945c-55ec0e5457b2 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:26:50.256127 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-72842e3c-51fd-4509-945c-55ec0e5457b2 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:26:50.256607 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-72842e3c-51fd-4509-945c-55ec0e5457b2 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:26:50.257396 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-72842e3c-51fd-4509-945c-55ec0e5457b2 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:26:50.257863 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-72842e3c-51fd-4509-945c-55ec0e5457b2 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:26:50.400725 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-72842e3c-51fd-4509-945c-55ec0e5457b2 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:26:50.408316 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-72842e3c-51fd-4509-945c-55ec0e5457b2 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.163977 Nov 09 20:26:50.409123 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 914/1799] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:26:50 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:26:51.425265 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-6bd146a3-3470-4a8c-a485-91920160d122 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:26:51.425876 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-6bd146a3-3470-4a8c-a485-91920160d122 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:26:51.432150 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6bd146a3-3470-4a8c-a485-91920160d122 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:26:51.432640 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6bd146a3-3470-4a8c-a485-91920160d122 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:26:51.433425 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6bd146a3-3470-4a8c-a485-91920160d122 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:26:51.433857 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6bd146a3-3470-4a8c-a485-91920160d122 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:26:51.560795 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-6bd146a3-3470-4a8c-a485-91920160d122 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:26:51.569222 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-6bd146a3-3470-4a8c-a485-91920160d122 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.147500 Nov 09 20:26:51.569780 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 886/1800] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:26:51 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:26:52.586514 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-15d0de3b-2c51-43e5-a2b3-734e2da7f855 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:26:52.587119 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-15d0de3b-2c51-43e5-a2b3-734e2da7f855 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:26:52.593295 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-15d0de3b-2c51-43e5-a2b3-734e2da7f855 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:26:52.593740 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-15d0de3b-2c51-43e5-a2b3-734e2da7f855 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:26:52.594511 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-15d0de3b-2c51-43e5-a2b3-734e2da7f855 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:26:52.594971 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-15d0de3b-2c51-43e5-a2b3-734e2da7f855 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:26:52.723132 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-15d0de3b-2c51-43e5-a2b3-734e2da7f855 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:26:52.730681 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-15d0de3b-2c51-43e5-a2b3-734e2da7f855 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.147763 Nov 09 20:26:52.731241 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 915/1801] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:26:52 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:26:53.748058 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-2219ecf1-2b6c-4741-b726-f790b3e82577 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:26:53.748648 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-2219ecf1-2b6c-4741-b726-f790b3e82577 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:26:53.754852 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2219ecf1-2b6c-4741-b726-f790b3e82577 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:26:53.755290 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2219ecf1-2b6c-4741-b726-f790b3e82577 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:26:53.756046 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2219ecf1-2b6c-4741-b726-f790b3e82577 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:26:53.756496 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2219ecf1-2b6c-4741-b726-f790b3e82577 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:26:53.886320 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-2219ecf1-2b6c-4741-b726-f790b3e82577 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:26:53.894709 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-2219ecf1-2b6c-4741-b726-f790b3e82577 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.150388 Nov 09 20:26:53.895259 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 887/1802] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:26:53 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:26:54.911009 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-b79a39af-cf99-4d17-b5c9-d2181a9f6660 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:26:54.911605 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-b79a39af-cf99-4d17-b5c9-d2181a9f6660 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:26:54.917851 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b79a39af-cf99-4d17-b5c9-d2181a9f6660 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:26:54.918306 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b79a39af-cf99-4d17-b5c9-d2181a9f6660 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:26:54.919089 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b79a39af-cf99-4d17-b5c9-d2181a9f6660 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:26:54.919540 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b79a39af-cf99-4d17-b5c9-d2181a9f6660 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:26:55.063662 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-b79a39af-cf99-4d17-b5c9-d2181a9f6660 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:26:55.075329 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-b79a39af-cf99-4d17-b5c9-d2181a9f6660 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.167747 Nov 09 20:26:55.076495 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 916/1803] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:26:54 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:26:56.093917 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-4bed9cd1-1ad7-431c-9584-bfa209018232 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:26:56.094506 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-4bed9cd1-1ad7-431c-9584-bfa209018232 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:26:56.101685 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4bed9cd1-1ad7-431c-9584-bfa209018232 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:26:56.101816 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4bed9cd1-1ad7-431c-9584-bfa209018232 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:26:56.103962 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4bed9cd1-1ad7-431c-9584-bfa209018232 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:26:56.103962 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4bed9cd1-1ad7-431c-9584-bfa209018232 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:26:56.400626 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-4bed9cd1-1ad7-431c-9584-bfa209018232 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:26:56.408335 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-4bed9cd1-1ad7-431c-9584-bfa209018232 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.318082 Nov 09 20:26:56.408923 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 888/1804] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:26:56 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:26:57.425385 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-c960defb-ab03-47b6-9fa5-9f0673310126 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:26:57.425973 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-c960defb-ab03-47b6-9fa5-9f0673310126 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:26:57.432102 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c960defb-ab03-47b6-9fa5-9f0673310126 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:26:57.432582 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c960defb-ab03-47b6-9fa5-9f0673310126 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:26:57.433371 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c960defb-ab03-47b6-9fa5-9f0673310126 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:26:57.433797 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c960defb-ab03-47b6-9fa5-9f0673310126 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:26:57.561052 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-c960defb-ab03-47b6-9fa5-9f0673310126 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:26:57.569233 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-c960defb-ab03-47b6-9fa5-9f0673310126 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.147664 Nov 09 20:26:57.569789 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 917/1805] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:26:57 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:26:58.586801 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-afb11b12-0ae0-43e4-a641-918028ce8d0d tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:26:58.587339 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-afb11b12-0ae0-43e4-a641-918028ce8d0d tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:26:58.593575 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-afb11b12-0ae0-43e4-a641-918028ce8d0d tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:26:58.594022 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-afb11b12-0ae0-43e4-a641-918028ce8d0d tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:26:58.594783 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-afb11b12-0ae0-43e4-a641-918028ce8d0d tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:26:58.595212 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-afb11b12-0ae0-43e4-a641-918028ce8d0d tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:26:58.727718 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-afb11b12-0ae0-43e4-a641-918028ce8d0d tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:26:58.736039 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-afb11b12-0ae0-43e4-a641-918028ce8d0d tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.152950 Nov 09 20:26:58.736713 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 889/1806] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:26:58 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:26:59.753777 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-f874e2a5-a96a-40fc-9c61-61a9acc6d01b tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:26:59.755690 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-f874e2a5-a96a-40fc-9c61-61a9acc6d01b tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:26:59.762320 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f874e2a5-a96a-40fc-9c61-61a9acc6d01b tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:26:59.762855 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f874e2a5-a96a-40fc-9c61-61a9acc6d01b tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:26:59.763699 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f874e2a5-a96a-40fc-9c61-61a9acc6d01b tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:26:59.764201 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f874e2a5-a96a-40fc-9c61-61a9acc6d01b tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:26:59.906632 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-f874e2a5-a96a-40fc-9c61-61a9acc6d01b tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:26:59.915092 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-f874e2a5-a96a-40fc-9c61-61a9acc6d01b tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.165051 Nov 09 20:26:59.915662 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 918/1807] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:26:59 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:27:00.931970 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-64895ab0-d466-4766-ad08-66c635002501 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:27:00.932697 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-64895ab0-d466-4766-ad08-66c635002501 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:27:00.938772 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-64895ab0-d466-4766-ad08-66c635002501 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:27:00.939203 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-64895ab0-d466-4766-ad08-66c635002501 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:27:00.940597 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-64895ab0-d466-4766-ad08-66c635002501 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:27:00.941020 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-64895ab0-d466-4766-ad08-66c635002501 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:27:01.066574 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-64895ab0-d466-4766-ad08-66c635002501 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:27:01.074158 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-64895ab0-d466-4766-ad08-66c635002501 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.145793 Nov 09 20:27:01.074706 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 890/1808] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:27:00 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:27:02.090965 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-63262793-4729-42d0-ad49-418908ac11b1 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:27:02.091564 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-63262793-4729-42d0-ad49-418908ac11b1 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:27:02.097987 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-63262793-4729-42d0-ad49-418908ac11b1 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:27:02.098426 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-63262793-4729-42d0-ad49-418908ac11b1 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:27:02.099187 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-63262793-4729-42d0-ad49-418908ac11b1 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:27:02.099610 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-63262793-4729-42d0-ad49-418908ac11b1 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:27:02.231265 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-63262793-4729-42d0-ad49-418908ac11b1 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:27:02.239415 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-63262793-4729-42d0-ad49-418908ac11b1 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.152037 Nov 09 20:27:02.239974 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 919/1809] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:27:02 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:27:03.257450 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-f63e2f92-85c1-4747-8f3b-605e97123b5b tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:27:03.257983 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-f63e2f92-85c1-4747-8f3b-605e97123b5b tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:27:03.264158 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f63e2f92-85c1-4747-8f3b-605e97123b5b tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:27:03.264636 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f63e2f92-85c1-4747-8f3b-605e97123b5b tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:27:03.265398 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f63e2f92-85c1-4747-8f3b-605e97123b5b tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:27:03.265824 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f63e2f92-85c1-4747-8f3b-605e97123b5b tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:27:03.395821 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-f63e2f92-85c1-4747-8f3b-605e97123b5b tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:27:03.403459 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-f63e2f92-85c1-4747-8f3b-605e97123b5b tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.149725 Nov 09 20:27:03.404013 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 891/1810] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:27:03 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:27:04.420698 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-1d69f677-aa54-4d06-ace5-9a7abbb76281 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:27:04.421309 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-1d69f677-aa54-4d06-ace5-9a7abbb76281 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:27:04.427697 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-1d69f677-aa54-4d06-ace5-9a7abbb76281 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:27:04.428144 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-1d69f677-aa54-4d06-ace5-9a7abbb76281 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:27:04.428942 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-1d69f677-aa54-4d06-ace5-9a7abbb76281 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:27:04.429374 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-1d69f677-aa54-4d06-ace5-9a7abbb76281 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:27:04.564453 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-1d69f677-aa54-4d06-ace5-9a7abbb76281 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:27:04.571992 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-1d69f677-aa54-4d06-ace5-9a7abbb76281 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.155060 Nov 09 20:27:04.572576 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 920/1811] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:27:04 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:27:05.588920 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-8df6e4c7-a925-45f7-addb-69f2fe13ee42 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:27:05.589465 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-8df6e4c7-a925-45f7-addb-69f2fe13ee42 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:27:05.596511 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8df6e4c7-a925-45f7-addb-69f2fe13ee42 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:27:05.597075 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8df6e4c7-a925-45f7-addb-69f2fe13ee42 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:27:05.597862 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8df6e4c7-a925-45f7-addb-69f2fe13ee42 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:27:05.598293 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8df6e4c7-a925-45f7-addb-69f2fe13ee42 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:27:05.723827 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-8df6e4c7-a925-45f7-addb-69f2fe13ee42 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:27:05.731420 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-8df6e4c7-a925-45f7-addb-69f2fe13ee42 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.146207 Nov 09 20:27:05.731996 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 892/1812] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:27:05 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:27:06.748516 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-317bf6b9-7b7f-48f9-954e-11ae30e6b60e tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:27:06.749135 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-317bf6b9-7b7f-48f9-954e-11ae30e6b60e tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:27:06.755825 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-317bf6b9-7b7f-48f9-954e-11ae30e6b60e tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:27:06.756273 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-317bf6b9-7b7f-48f9-954e-11ae30e6b60e tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:27:06.757085 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-317bf6b9-7b7f-48f9-954e-11ae30e6b60e tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:27:06.757519 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-317bf6b9-7b7f-48f9-954e-11ae30e6b60e tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:27:06.889692 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-317bf6b9-7b7f-48f9-954e-11ae30e6b60e tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:27:06.897729 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-317bf6b9-7b7f-48f9-954e-11ae30e6b60e tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.152937 Nov 09 20:27:06.898292 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 921/1813] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:27:06 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:27:07.914163 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-9354f637-96c3-450c-915d-517239560883 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:27:07.914767 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-9354f637-96c3-450c-915d-517239560883 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:27:07.920992 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9354f637-96c3-450c-915d-517239560883 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:27:07.921453 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9354f637-96c3-450c-915d-517239560883 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:27:07.922199 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9354f637-96c3-450c-915d-517239560883 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:27:07.922658 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9354f637-96c3-450c-915d-517239560883 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:27:08.049084 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-9354f637-96c3-450c-915d-517239560883 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:27:08.056666 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-9354f637-96c3-450c-915d-517239560883 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.146152 Nov 09 20:27:08.057225 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 893/1814] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:27:07 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:27:09.074338 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-8bf637e6-2c13-43d4-8717-7054bd3be430 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:27:09.074944 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-8bf637e6-2c13-43d4-8717-7054bd3be430 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:27:09.081357 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-8bf637e6-2c13-43d4-8717-7054bd3be430 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:27:09.081800 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-8bf637e6-2c13-43d4-8717-7054bd3be430 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:27:09.082563 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-8bf637e6-2c13-43d4-8717-7054bd3be430 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:27:09.082990 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-8bf637e6-2c13-43d4-8717-7054bd3be430 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:27:09.224264 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-8bf637e6-2c13-43d4-8717-7054bd3be430 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:27:09.231835 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-8bf637e6-2c13-43d4-8717-7054bd3be430 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.161182 Nov 09 20:27:09.232393 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 922/1815] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:27:09 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 20:27:10.249603 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-1184d86a-e132-45e2-b67d-4f2c12d79851 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:27:10.250209 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-1184d86a-e132-45e2-b67d-4f2c12d79851 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:27:10.259485 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1184d86a-e132-45e2-b67d-4f2c12d79851 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:27:10.259485 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1184d86a-e132-45e2-b67d-4f2c12d79851 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:27:10.259485 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1184d86a-e132-45e2-b67d-4f2c12d79851 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:27:10.259485 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1184d86a-e132-45e2-b67d-4f2c12d79851 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:27:10.392362 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-1184d86a-e132-45e2-b67d-4f2c12d79851 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:27:10.400186 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-1184d86a-e132-45e2-b67d-4f2c12d79851 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.154214 Nov 09 20:27:10.400773 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 894/1816] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:27:10 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:27:11.417186 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-8005407e-a1ee-4fd0-bba2-e1f45ef6fd93 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:27:11.417797 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-8005407e-a1ee-4fd0-bba2-e1f45ef6fd93 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:27:11.424968 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-8005407e-a1ee-4fd0-bba2-e1f45ef6fd93 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:27:11.425418 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-8005407e-a1ee-4fd0-bba2-e1f45ef6fd93 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:27:11.426190 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-8005407e-a1ee-4fd0-bba2-e1f45ef6fd93 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:27:11.426620 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-8005407e-a1ee-4fd0-bba2-e1f45ef6fd93 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:27:11.553120 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-8005407e-a1ee-4fd0-bba2-e1f45ef6fd93 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:27:11.560724 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-8005407e-a1ee-4fd0-bba2-e1f45ef6fd93 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.147222 Nov 09 20:27:11.561290 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 923/1817] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:27:11 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:27:12.578242 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-2d4145df-69af-4e31-9204-eac0f4e9f92a tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:27:12.578847 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-2d4145df-69af-4e31-9204-eac0f4e9f92a tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:27:12.585795 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2d4145df-69af-4e31-9204-eac0f4e9f92a tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:27:12.586244 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2d4145df-69af-4e31-9204-eac0f4e9f92a tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:27:12.587151 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2d4145df-69af-4e31-9204-eac0f4e9f92a tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:27:12.587588 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2d4145df-69af-4e31-9204-eac0f4e9f92a tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:27:12.717733 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-2d4145df-69af-4e31-9204-eac0f4e9f92a tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:27:12.725507 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-2d4145df-69af-4e31-9204-eac0f4e9f92a tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.150949 Nov 09 20:27:12.726057 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 895/1818] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:27:12 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:27:13.742488 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-96dab285-c39d-49fc-835e-f5d70a16bc7e tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:27:13.743355 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-96dab285-c39d-49fc-835e-f5d70a16bc7e tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:27:13.749506 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-96dab285-c39d-49fc-835e-f5d70a16bc7e tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:27:13.749957 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-96dab285-c39d-49fc-835e-f5d70a16bc7e tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:27:13.750730 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-96dab285-c39d-49fc-835e-f5d70a16bc7e tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:27:13.751160 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-96dab285-c39d-49fc-835e-f5d70a16bc7e tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:27:13.877627 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-96dab285-c39d-49fc-835e-f5d70a16bc7e tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:27:13.886143 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-96dab285-c39d-49fc-835e-f5d70a16bc7e tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.147319 Nov 09 20:27:13.886711 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 924/1819] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:27:13 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:27:14.903946 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-80e22eaf-4d19-47cd-a012-41029de0c0f1 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:27:14.904572 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-80e22eaf-4d19-47cd-a012-41029de0c0f1 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:27:14.911662 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-80e22eaf-4d19-47cd-a012-41029de0c0f1 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:27:14.912380 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-80e22eaf-4d19-47cd-a012-41029de0c0f1 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:27:14.913179 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-80e22eaf-4d19-47cd-a012-41029de0c0f1 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:27:14.913643 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-80e22eaf-4d19-47cd-a012-41029de0c0f1 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:27:15.039051 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-80e22eaf-4d19-47cd-a012-41029de0c0f1 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:27:15.046625 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-80e22eaf-4d19-47cd-a012-41029de0c0f1 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.146283 Nov 09 20:27:15.047176 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 896/1820] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:27:14 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 20:27:16.063160 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-993b0611-87df-4464-b4b2-d212d8de247f tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:27:16.063763 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-993b0611-87df-4464-b4b2-d212d8de247f tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:27:16.069794 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-993b0611-87df-4464-b4b2-d212d8de247f tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:27:16.070235 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-993b0611-87df-4464-b4b2-d212d8de247f tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:27:16.071003 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-993b0611-87df-4464-b4b2-d212d8de247f tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:27:16.071435 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-993b0611-87df-4464-b4b2-d212d8de247f tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:27:16.249093 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-993b0611-87df-4464-b4b2-d212d8de247f tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:27:16.256702 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-993b0611-87df-4464-b4b2-d212d8de247f tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.197286 Nov 09 20:27:16.257266 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 925/1821] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:27:16 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:27:17.273446 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-fbd05d5e-3e01-4e7c-9458-54c144b21ce0 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:27:17.274040 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-fbd05d5e-3e01-4e7c-9458-54c144b21ce0 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:27:17.280267 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fbd05d5e-3e01-4e7c-9458-54c144b21ce0 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:27:17.280743 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fbd05d5e-3e01-4e7c-9458-54c144b21ce0 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:27:17.281502 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fbd05d5e-3e01-4e7c-9458-54c144b21ce0 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:27:17.281922 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fbd05d5e-3e01-4e7c-9458-54c144b21ce0 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:27:17.407550 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-fbd05d5e-3e01-4e7c-9458-54c144b21ce0 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:27:17.416052 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-fbd05d5e-3e01-4e7c-9458-54c144b21ce0 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.146776 Nov 09 20:27:17.416639 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 897/1822] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:27:17 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:27:18.433580 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-5a078791-6d12-4c5d-95d2-415a173f8e2c tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:27:18.434120 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-5a078791-6d12-4c5d-95d2-415a173f8e2c tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:27:18.440324 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-5a078791-6d12-4c5d-95d2-415a173f8e2c tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:27:18.440806 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-5a078791-6d12-4c5d-95d2-415a173f8e2c tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:27:18.441762 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-5a078791-6d12-4c5d-95d2-415a173f8e2c tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:27:18.442247 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-5a078791-6d12-4c5d-95d2-415a173f8e2c tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:27:18.572155 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-5a078791-6d12-4c5d-95d2-415a173f8e2c tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:27:18.579914 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-5a078791-6d12-4c5d-95d2-415a173f8e2c tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.150152 Nov 09 20:27:18.580497 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 926/1823] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:27:18 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:27:19.598213 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-db3b783f-2ffc-426b-8671-e24af695081a tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:27:19.599011 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-db3b783f-2ffc-426b-8671-e24af695081a tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:27:19.605227 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-db3b783f-2ffc-426b-8671-e24af695081a tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:27:19.605672 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-db3b783f-2ffc-426b-8671-e24af695081a tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:27:19.606440 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-db3b783f-2ffc-426b-8671-e24af695081a tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:27:19.606871 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-db3b783f-2ffc-426b-8671-e24af695081a tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:27:19.735785 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-db3b783f-2ffc-426b-8671-e24af695081a tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:27:19.744310 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-db3b783f-2ffc-426b-8671-e24af695081a tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.150376 Nov 09 20:27:19.744905 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 898/1824] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:27:19 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:27:20.761825 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-1f9beb26-4b95-4ca2-9fe5-80dde66bb557 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:27:20.762435 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-1f9beb26-4b95-4ca2-9fe5-80dde66bb557 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:27:20.768664 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-1f9beb26-4b95-4ca2-9fe5-80dde66bb557 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:27:20.769112 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-1f9beb26-4b95-4ca2-9fe5-80dde66bb557 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:27:20.769980 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-1f9beb26-4b95-4ca2-9fe5-80dde66bb557 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:27:20.770417 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-1f9beb26-4b95-4ca2-9fe5-80dde66bb557 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:27:20.905336 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-1f9beb26-4b95-4ca2-9fe5-80dde66bb557 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:27:20.913897 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-1f9beb26-4b95-4ca2-9fe5-80dde66bb557 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.155708 Nov 09 20:27:20.914458 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 927/1825] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:27:20 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:27:21.931239 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-917eedd6-9567-47dc-93e8-15a7202232f0 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:27:21.931841 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-917eedd6-9567-47dc-93e8-15a7202232f0 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:27:21.938002 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-917eedd6-9567-47dc-93e8-15a7202232f0 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:27:21.938449 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-917eedd6-9567-47dc-93e8-15a7202232f0 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:27:21.939214 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-917eedd6-9567-47dc-93e8-15a7202232f0 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:27:21.939646 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-917eedd6-9567-47dc-93e8-15a7202232f0 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:27:22.065471 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-917eedd6-9567-47dc-93e8-15a7202232f0 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:27:22.073338 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-917eedd6-9567-47dc-93e8-15a7202232f0 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.145710 Nov 09 20:27:22.073895 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 899/1826] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:27:21 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 20:27:23.090209 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-ed615389-20ce-4b37-99f3-5eab95913274 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:27:23.090739 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-ed615389-20ce-4b37-99f3-5eab95913274 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:27:23.096964 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ed615389-20ce-4b37-99f3-5eab95913274 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:27:23.097413 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ed615389-20ce-4b37-99f3-5eab95913274 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:27:23.098310 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ed615389-20ce-4b37-99f3-5eab95913274 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:27:23.098746 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ed615389-20ce-4b37-99f3-5eab95913274 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:27:23.227325 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-ed615389-20ce-4b37-99f3-5eab95913274 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:27:23.234879 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-ed615389-20ce-4b37-99f3-5eab95913274 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.148422 Nov 09 20:27:23.235436 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 928/1827] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:27:23 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:27:24.253005 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-4a16403f-6060-4403-885f-b2567ccd4c8e tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:27:24.254193 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-4a16403f-6060-4403-885f-b2567ccd4c8e tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:27:24.260476 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4a16403f-6060-4403-885f-b2567ccd4c8e tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:27:24.260919 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4a16403f-6060-4403-885f-b2567ccd4c8e tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:27:24.261685 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4a16403f-6060-4403-885f-b2567ccd4c8e tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:27:24.262104 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4a16403f-6060-4403-885f-b2567ccd4c8e tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:27:24.394053 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-4a16403f-6060-4403-885f-b2567ccd4c8e tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:27:24.404981 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-4a16403f-6060-4403-885f-b2567ccd4c8e tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.155758 Nov 09 20:27:24.406225 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 900/1828] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:27:24 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:27:25.422711 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-572047a9-9b81-46ea-b112-839e45ca8693 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:27:25.423315 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-572047a9-9b81-46ea-b112-839e45ca8693 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:27:25.430210 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-572047a9-9b81-46ea-b112-839e45ca8693 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:27:25.430656 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-572047a9-9b81-46ea-b112-839e45ca8693 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:27:25.431432 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-572047a9-9b81-46ea-b112-839e45ca8693 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:27:25.431862 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-572047a9-9b81-46ea-b112-839e45ca8693 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:27:25.557755 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-572047a9-9b81-46ea-b112-839e45ca8693 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:27:25.565366 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-572047a9-9b81-46ea-b112-839e45ca8693 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.146337 Nov 09 20:27:25.565930 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 929/1829] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:27:25 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:27:26.582780 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-5b0b0868-d16c-4bcb-81ab-8d272b284d94 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:27:26.583329 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-5b0b0868-d16c-4bcb-81ab-8d272b284d94 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:27:26.589237 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5b0b0868-d16c-4bcb-81ab-8d272b284d94 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:27:26.589681 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5b0b0868-d16c-4bcb-81ab-8d272b284d94 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:27:26.590450 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5b0b0868-d16c-4bcb-81ab-8d272b284d94 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:27:26.590875 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5b0b0868-d16c-4bcb-81ab-8d272b284d94 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:27:26.720868 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-5b0b0868-d16c-4bcb-81ab-8d272b284d94 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:27:26.728951 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-5b0b0868-d16c-4bcb-81ab-8d272b284d94 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.150269 Nov 09 20:27:26.729507 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 901/1830] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:27:26 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:27:27.746734 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-bc832fbe-eee6-4cd0-b0b2-6ca5ff67a333 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:27:27.747323 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-bc832fbe-eee6-4cd0-b0b2-6ca5ff67a333 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:27:27.753581 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-bc832fbe-eee6-4cd0-b0b2-6ca5ff67a333 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:27:27.754017 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-bc832fbe-eee6-4cd0-b0b2-6ca5ff67a333 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:27:27.754779 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-bc832fbe-eee6-4cd0-b0b2-6ca5ff67a333 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:27:27.755204 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-bc832fbe-eee6-4cd0-b0b2-6ca5ff67a333 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:27:27.880604 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-bc832fbe-eee6-4cd0-b0b2-6ca5ff67a333 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:27:27.888347 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-bc832fbe-eee6-4cd0-b0b2-6ca5ff67a333 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.145478 Nov 09 20:27:27.888993 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 930/1831] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:27:27 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:27:28.906254 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-d150351e-a29d-434c-8e7c-fe743454091c tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:27:28.906851 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-d150351e-a29d-434c-8e7c-fe743454091c tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:27:28.913727 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d150351e-a29d-434c-8e7c-fe743454091c tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:27:28.914166 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d150351e-a29d-434c-8e7c-fe743454091c tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:27:28.914920 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d150351e-a29d-434c-8e7c-fe743454091c tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:27:28.915343 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d150351e-a29d-434c-8e7c-fe743454091c tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:27:29.040447 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-d150351e-a29d-434c-8e7c-fe743454091c tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:27:29.047997 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-d150351e-a29d-434c-8e7c-fe743454091c tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.145365 Nov 09 20:27:29.048586 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 902/1832] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:27:28 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:27:30.065557 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-1f5613ba-2199-4d37-9798-d6926756d52b tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:27:30.066870 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-1f5613ba-2199-4d37-9798-d6926756d52b tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:27:30.073261 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-1f5613ba-2199-4d37-9798-d6926756d52b tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:27:30.073707 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-1f5613ba-2199-4d37-9798-d6926756d52b tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:27:30.074487 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-1f5613ba-2199-4d37-9798-d6926756d52b tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:27:30.074918 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-1f5613ba-2199-4d37-9798-d6926756d52b tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:27:30.208185 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-1f5613ba-2199-4d37-9798-d6926756d52b tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:27:30.215952 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-1f5613ba-2199-4d37-9798-d6926756d52b tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.154022 Nov 09 20:27:30.216540 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 931/1833] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:27:30 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:27:31.233500 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-6dd5cc8b-cb4c-4295-a9fd-480a3fb7fe6d tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:27:31.234110 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-6dd5cc8b-cb4c-4295-a9fd-480a3fb7fe6d tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:27:31.241241 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6dd5cc8b-cb4c-4295-a9fd-480a3fb7fe6d tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:27:31.241695 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6dd5cc8b-cb4c-4295-a9fd-480a3fb7fe6d tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:27:31.242487 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6dd5cc8b-cb4c-4295-a9fd-480a3fb7fe6d tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:27:31.243185 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6dd5cc8b-cb4c-4295-a9fd-480a3fb7fe6d tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:27:31.374498 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-6dd5cc8b-cb4c-4295-a9fd-480a3fb7fe6d tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:27:31.382186 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-6dd5cc8b-cb4c-4295-a9fd-480a3fb7fe6d tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.152292 Nov 09 20:27:31.382736 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 903/1834] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:27:31 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:27:32.399197 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-14fb1658-b1ec-4c8d-9106-27bb42610a1d tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:27:32.399832 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-14fb1658-b1ec-4c8d-9106-27bb42610a1d tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:27:32.405728 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-14fb1658-b1ec-4c8d-9106-27bb42610a1d tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:27:32.406178 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-14fb1658-b1ec-4c8d-9106-27bb42610a1d tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:27:32.406943 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-14fb1658-b1ec-4c8d-9106-27bb42610a1d tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:27:32.407375 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-14fb1658-b1ec-4c8d-9106-27bb42610a1d tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:27:32.538693 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-14fb1658-b1ec-4c8d-9106-27bb42610a1d tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:27:32.546405 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-14fb1658-b1ec-4c8d-9106-27bb42610a1d tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.150770 Nov 09 20:27:32.546973 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 932/1835] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:27:32 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:27:33.563955 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-8afca07a-d6bd-49dd-ad96-381c11dbd037 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:27:33.564530 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-8afca07a-d6bd-49dd-ad96-381c11dbd037 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:27:33.571196 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8afca07a-d6bd-49dd-ad96-381c11dbd037 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:27:33.571634 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8afca07a-d6bd-49dd-ad96-381c11dbd037 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:27:33.572394 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8afca07a-d6bd-49dd-ad96-381c11dbd037 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:27:33.572843 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8afca07a-d6bd-49dd-ad96-381c11dbd037 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:27:33.699625 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-8afca07a-d6bd-49dd-ad96-381c11dbd037 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:27:33.707187 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-8afca07a-d6bd-49dd-ad96-381c11dbd037 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.146955 Nov 09 20:27:33.707739 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 904/1836] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:27:33 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:27:34.723256 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-d70da3c8-bdc5-4b1b-b6ab-49c3d72157c2 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:27:34.723798 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-d70da3c8-bdc5-4b1b-b6ab-49c3d72157c2 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:27:34.729895 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d70da3c8-bdc5-4b1b-b6ab-49c3d72157c2 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:27:34.730346 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d70da3c8-bdc5-4b1b-b6ab-49c3d72157c2 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:27:34.731120 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d70da3c8-bdc5-4b1b-b6ab-49c3d72157c2 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:27:34.731557 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d70da3c8-bdc5-4b1b-b6ab-49c3d72157c2 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:27:34.860661 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-d70da3c8-bdc5-4b1b-b6ab-49c3d72157c2 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:27:34.869099 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-d70da3c8-bdc5-4b1b-b6ab-49c3d72157c2 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.149605 Nov 09 20:27:34.869658 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 933/1837] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:27:34 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:27:35.886114 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-488c362f-973b-43ff-a23c-a04615053012 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:27:35.886713 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-488c362f-973b-43ff-a23c-a04615053012 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:27:35.892896 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-488c362f-973b-43ff-a23c-a04615053012 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:27:35.893337 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-488c362f-973b-43ff-a23c-a04615053012 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:27:35.894657 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-488c362f-973b-43ff-a23c-a04615053012 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:27:35.895091 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-488c362f-973b-43ff-a23c-a04615053012 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:27:36.020808 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-488c362f-973b-43ff-a23c-a04615053012 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:27:36.028494 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-488c362f-973b-43ff-a23c-a04615053012 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.145978 Nov 09 20:27:36.029052 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 905/1838] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:27:35 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:27:37.046243 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-ec94cf07-a762-4878-8123-93a50a55c25d tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:27:37.046835 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-ec94cf07-a762-4878-8123-93a50a55c25d tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:27:37.053773 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ec94cf07-a762-4878-8123-93a50a55c25d tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:27:37.054213 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ec94cf07-a762-4878-8123-93a50a55c25d tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:27:37.054981 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ec94cf07-a762-4878-8123-93a50a55c25d tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:27:37.055412 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ec94cf07-a762-4878-8123-93a50a55c25d tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:27:37.180200 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-ec94cf07-a762-4878-8123-93a50a55c25d tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:27:37.187875 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-ec94cf07-a762-4878-8123-93a50a55c25d tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.145405 Nov 09 20:27:37.188454 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 934/1839] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:27:37 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:27:38.205364 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-cc7b027a-fc36-43a7-9e2a-42dfbe46bb07 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:27:38.205961 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-cc7b027a-fc36-43a7-9e2a-42dfbe46bb07 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:27:38.212838 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cc7b027a-fc36-43a7-9e2a-42dfbe46bb07 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:27:38.213278 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cc7b027a-fc36-43a7-9e2a-42dfbe46bb07 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:27:38.214034 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cc7b027a-fc36-43a7-9e2a-42dfbe46bb07 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:27:38.214461 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cc7b027a-fc36-43a7-9e2a-42dfbe46bb07 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:27:38.344321 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-cc7b027a-fc36-43a7-9e2a-42dfbe46bb07 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:27:38.352700 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-cc7b027a-fc36-43a7-9e2a-42dfbe46bb07 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.151029 Nov 09 20:27:38.353254 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 906/1840] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:27:38 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:27:39.370199 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-96abe6bb-df1b-4ba9-842e-e25305ba87fc tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:27:39.370796 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-96abe6bb-df1b-4ba9-842e-e25305ba87fc tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:27:39.377023 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-96abe6bb-df1b-4ba9-842e-e25305ba87fc tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:27:39.377464 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-96abe6bb-df1b-4ba9-842e-e25305ba87fc tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:27:39.378251 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-96abe6bb-df1b-4ba9-842e-e25305ba87fc tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:27:39.378675 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-96abe6bb-df1b-4ba9-842e-e25305ba87fc tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:27:39.506216 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-96abe6bb-df1b-4ba9-842e-e25305ba87fc tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:27:39.513811 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-96abe6bb-df1b-4ba9-842e-e25305ba87fc tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.147498 Nov 09 20:27:39.514363 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 935/1841] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:27:39 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:27:40.531326 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-33f625c9-f0e4-4c64-9bfd-0d90b62331eb tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:27:40.531889 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-33f625c9-f0e4-4c64-9bfd-0d90b62331eb tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:27:40.539074 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-33f625c9-f0e4-4c64-9bfd-0d90b62331eb tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:27:40.539521 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-33f625c9-f0e4-4c64-9bfd-0d90b62331eb tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:27:40.540315 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-33f625c9-f0e4-4c64-9bfd-0d90b62331eb tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:27:40.540774 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-33f625c9-f0e4-4c64-9bfd-0d90b62331eb tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:27:40.678107 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-33f625c9-f0e4-4c64-9bfd-0d90b62331eb tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:27:40.685760 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-33f625c9-f0e4-4c64-9bfd-0d90b62331eb tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.158156 Nov 09 20:27:40.686320 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 907/1842] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:27:40 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:27:41.702798 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-de158cf1-e761-46b3-8eb1-bfa94b9ca998 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:27:41.703187 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-de158cf1-e761-46b3-8eb1-bfa94b9ca998 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:27:41.709996 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-de158cf1-e761-46b3-8eb1-bfa94b9ca998 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:27:41.710433 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-de158cf1-e761-46b3-8eb1-bfa94b9ca998 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:27:41.711205 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-de158cf1-e761-46b3-8eb1-bfa94b9ca998 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:27:41.711634 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-de158cf1-e761-46b3-8eb1-bfa94b9ca998 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:27:41.844776 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-de158cf1-e761-46b3-8eb1-bfa94b9ca998 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:27:41.853353 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-de158cf1-e761-46b3-8eb1-bfa94b9ca998 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.154405 Nov 09 20:27:41.853933 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 936/1843] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:27:41 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:27:42.870716 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-12e6a1c8-716e-4ea2-a4f9-4bcf9783fca6 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:27:42.871322 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-12e6a1c8-716e-4ea2-a4f9-4bcf9783fca6 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:27:42.877534 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-12e6a1c8-716e-4ea2-a4f9-4bcf9783fca6 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:27:42.877979 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-12e6a1c8-716e-4ea2-a4f9-4bcf9783fca6 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:27:42.878749 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-12e6a1c8-716e-4ea2-a4f9-4bcf9783fca6 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:27:42.879178 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-12e6a1c8-716e-4ea2-a4f9-4bcf9783fca6 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:27:43.007763 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-12e6a1c8-716e-4ea2-a4f9-4bcf9783fca6 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:27:43.015367 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-12e6a1c8-716e-4ea2-a4f9-4bcf9783fca6 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.148576 Nov 09 20:27:43.015921 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 908/1844] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:27:42 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:27:44.033849 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-f1e2895b-37a0-49cb-a64c-cd4bb3711d36 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:27:44.034451 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-f1e2895b-37a0-49cb-a64c-cd4bb3711d36 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:27:44.041037 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f1e2895b-37a0-49cb-a64c-cd4bb3711d36 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:27:44.041481 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f1e2895b-37a0-49cb-a64c-cd4bb3711d36 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:27:44.042314 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f1e2895b-37a0-49cb-a64c-cd4bb3711d36 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:27:44.042868 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f1e2895b-37a0-49cb-a64c-cd4bb3711d36 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:27:44.179586 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-f1e2895b-37a0-49cb-a64c-cd4bb3711d36 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:27:44.187410 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-f1e2895b-37a0-49cb-a64c-cd4bb3711d36 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.157985 Nov 09 20:27:44.187964 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 937/1845] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:27:44 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:27:45.204480 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-98a8263e-401c-474f-a968-e82cd7c9d00c tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:27:45.205020 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-98a8263e-401c-474f-a968-e82cd7c9d00c tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:27:45.211793 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-98a8263e-401c-474f-a968-e82cd7c9d00c tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:27:45.212234 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-98a8263e-401c-474f-a968-e82cd7c9d00c tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:27:45.213031 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-98a8263e-401c-474f-a968-e82cd7c9d00c tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:27:45.213456 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-98a8263e-401c-474f-a968-e82cd7c9d00c tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:27:45.339127 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-98a8263e-401c-474f-a968-e82cd7c9d00c tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:27:45.346991 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-98a8263e-401c-474f-a968-e82cd7c9d00c tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.146161 Nov 09 20:27:45.347542 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 909/1846] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:27:45 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:27:46.363896 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-94eff3ba-c4d8-42c8-bf77-108f651c5cff tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:27:46.364953 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-94eff3ba-c4d8-42c8-bf77-108f651c5cff tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:27:46.370642 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-94eff3ba-c4d8-42c8-bf77-108f651c5cff tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:27:46.371089 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-94eff3ba-c4d8-42c8-bf77-108f651c5cff tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:27:46.371868 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-94eff3ba-c4d8-42c8-bf77-108f651c5cff tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:27:46.372300 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-94eff3ba-c4d8-42c8-bf77-108f651c5cff tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:27:46.501513 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-94eff3ba-c4d8-42c8-bf77-108f651c5cff tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:27:46.509168 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-94eff3ba-c4d8-42c8-bf77-108f651c5cff tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.149115 Nov 09 20:27:46.509731 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 938/1847] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:27:46 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:27:47.525818 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-4bfc43b6-75ef-472f-ac4f-9e01715c7db9 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:27:47.526420 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-4bfc43b6-75ef-472f-ac4f-9e01715c7db9 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:27:47.532673 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4bfc43b6-75ef-472f-ac4f-9e01715c7db9 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:27:47.533115 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4bfc43b6-75ef-472f-ac4f-9e01715c7db9 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:27:47.533869 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4bfc43b6-75ef-472f-ac4f-9e01715c7db9 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:27:47.534291 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4bfc43b6-75ef-472f-ac4f-9e01715c7db9 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:27:47.662227 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-4bfc43b6-75ef-472f-ac4f-9e01715c7db9 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:27:47.669822 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-4bfc43b6-75ef-472f-ac4f-9e01715c7db9 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.147773 Nov 09 20:27:47.670378 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 910/1848] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:27:47 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:27:48.687666 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-e9ec7e99-a68d-4d8f-8b0c-e174707d9b47 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:27:48.688246 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-e9ec7e99-a68d-4d8f-8b0c-e174707d9b47 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:27:48.694500 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e9ec7e99-a68d-4d8f-8b0c-e174707d9b47 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:27:48.694939 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e9ec7e99-a68d-4d8f-8b0c-e174707d9b47 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:27:48.695698 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e9ec7e99-a68d-4d8f-8b0c-e174707d9b47 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:27:48.696124 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e9ec7e99-a68d-4d8f-8b0c-e174707d9b47 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:27:48.824556 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-e9ec7e99-a68d-4d8f-8b0c-e174707d9b47 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:27:48.832145 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-e9ec7e99-a68d-4d8f-8b0c-e174707d9b47 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.148210 Nov 09 20:27:48.833281 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 939/1849] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:27:48 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:27:49.849557 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-8fc12256-cd69-4b7d-ba50-abcd02bf1c88 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:27:49.850158 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-8fc12256-cd69-4b7d-ba50-abcd02bf1c88 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:27:49.856348 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8fc12256-cd69-4b7d-ba50-abcd02bf1c88 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:27:49.856815 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8fc12256-cd69-4b7d-ba50-abcd02bf1c88 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:27:49.857570 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8fc12256-cd69-4b7d-ba50-abcd02bf1c88 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:27:49.857994 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8fc12256-cd69-4b7d-ba50-abcd02bf1c88 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:27:49.984908 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-8fc12256-cd69-4b7d-ba50-abcd02bf1c88 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:27:49.993400 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-8fc12256-cd69-4b7d-ba50-abcd02bf1c88 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.147838 Nov 09 20:27:49.993961 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 911/1850] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:27:49 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:27:51.010702 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-967a1b06-9d11-4d33-a119-caa270a99c84 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:27:51.011335 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-967a1b06-9d11-4d33-a119-caa270a99c84 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:27:51.017721 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-967a1b06-9d11-4d33-a119-caa270a99c84 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:27:51.018187 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-967a1b06-9d11-4d33-a119-caa270a99c84 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:27:51.018944 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-967a1b06-9d11-4d33-a119-caa270a99c84 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:27:51.019379 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-967a1b06-9d11-4d33-a119-caa270a99c84 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:27:51.146851 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-967a1b06-9d11-4d33-a119-caa270a99c84 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:27:51.153425 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-967a1b06-9d11-4d33-a119-caa270a99c84 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.146371 Nov 09 20:27:51.153989 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 940/1851] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:27:51 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:27:52.170849 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-c00ddf52-6f7c-4eb3-8532-8c5c100c06c9 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:27:52.171452 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-c00ddf52-6f7c-4eb3-8532-8c5c100c06c9 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:27:52.178615 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c00ddf52-6f7c-4eb3-8532-8c5c100c06c9 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:27:52.179060 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c00ddf52-6f7c-4eb3-8532-8c5c100c06c9 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:27:52.179824 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c00ddf52-6f7c-4eb3-8532-8c5c100c06c9 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:27:52.180250 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c00ddf52-6f7c-4eb3-8532-8c5c100c06c9 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:27:52.312834 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-c00ddf52-6f7c-4eb3-8532-8c5c100c06c9 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:27:52.320677 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-c00ddf52-6f7c-4eb3-8532-8c5c100c06c9 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.153521 Nov 09 20:27:52.321220 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 912/1852] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:27:52 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:27:53.337383 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-35ca018b-7d20-4f43-930f-150c684e633b tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:27:53.337988 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-35ca018b-7d20-4f43-930f-150c684e633b tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:27:53.344206 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-35ca018b-7d20-4f43-930f-150c684e633b tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:27:53.344704 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-35ca018b-7d20-4f43-930f-150c684e633b tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:27:53.345489 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-35ca018b-7d20-4f43-930f-150c684e633b tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:27:53.345921 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-35ca018b-7d20-4f43-930f-150c684e633b tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:27:53.475208 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-35ca018b-7d20-4f43-930f-150c684e633b tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:27:53.483306 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-35ca018b-7d20-4f43-930f-150c684e633b tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.149466 Nov 09 20:27:53.487467 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 941/1853] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:27:53 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:27:54.500783 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-3166344c-a51a-4cdb-8463-a55d75490bec tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:27:54.501545 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-3166344c-a51a-4cdb-8463-a55d75490bec tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:27:54.507643 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3166344c-a51a-4cdb-8463-a55d75490bec tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:27:54.508080 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3166344c-a51a-4cdb-8463-a55d75490bec tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:27:54.508871 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3166344c-a51a-4cdb-8463-a55d75490bec tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:27:54.509294 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3166344c-a51a-4cdb-8463-a55d75490bec tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:27:54.650358 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-3166344c-a51a-4cdb-8463-a55d75490bec tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:27:54.658352 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-3166344c-a51a-4cdb-8463-a55d75490bec tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.161021 Nov 09 20:27:54.658851 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 913/1854] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:27:54 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:27:55.675442 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-baad7e43-482e-420d-95ff-8b5614a8ab5c tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:27:55.676042 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-baad7e43-482e-420d-95ff-8b5614a8ab5c tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 75e5847b-18ff-4332-be8a-f77ffae72997] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:27:55.682442 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-baad7e43-482e-420d-95ff-8b5614a8ab5c tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:27:55.682882 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-baad7e43-482e-420d-95ff-8b5614a8ab5c tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:27:55.683640 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-baad7e43-482e-420d-95ff-8b5614a8ab5c tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:27:55.684065 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-baad7e43-482e-420d-95ff-8b5614a8ab5c tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:27:55.809715 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-baad7e43-482e-420d-95ff-8b5614a8ab5c tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:27:55.818252 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-baad7e43-482e-420d-95ff-8b5614a8ab5c tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997" status: 200 len: 1560 microversion: 2.1 time: 0.146381 Nov 09 20:27:55.818809 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 942/1855] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:27:55 2021] GET /compute/v2.1/servers/75e5847b-18ff-4332-be8a-f77ffae72997 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:27:57.225592 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 09 20:27:57.226087 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: Tue Nov 9 20:27:57 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 09 20:28:07.563504 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 09 20:28:07.564156 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: Tue Nov 9 20:28:07 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 09 20:28:39.784923 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-882ffcf0-d278-405d-8c68-2134bd5d1d68 tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:28:39.786155 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-882ffcf0-d278-405d-8c68-2134bd5d1d68 tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] [instance: dd766376-8156-40fd-b5e3-78b38e646c6b] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:28:39.792644 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-882ffcf0-d278-405d-8c68-2134bd5d1d68 tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:28:39.792644 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-882ffcf0-d278-405d-8c68-2134bd5d1d68 tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:28:39.793086 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-882ffcf0-d278-405d-8c68-2134bd5d1d68 tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:28:39.793549 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-882ffcf0-d278-405d-8c68-2134bd5d1d68 tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:28:39.818808 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-882ffcf0-d278-405d-8c68-2134bd5d1d68 tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] [instance: dd766376-8156-40fd-b5e3-78b38e646c6b] Going to try to terminate instance {{(pid=116103) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 09 20:28:40.059326 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-882ffcf0-d278-405d-8c68-2134bd5d1d68 tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] 10.222.0.25 "DELETE /compute/v2.1/servers/dd766376-8156-40fd-b5e3-78b38e646c6b" status: 204 len: 0 microversion: 2.1 time: 0.277795 Nov 09 20:28:40.059814 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 914/1856] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Nov 9 20:28:39 2021] DELETE /compute/v2.1/servers/dd766376-8156-40fd-b5e3-78b38e646c6b => generated 0 bytes in 279 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 09 20:28:40.068712 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-1eb4e625-164d-4a4b-857e-a0f9a564001c tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:28:40.069343 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-1eb4e625-164d-4a4b-857e-a0f9a564001c tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] [instance: dd766376-8156-40fd-b5e3-78b38e646c6b] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:28:40.075242 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-1eb4e625-164d-4a4b-857e-a0f9a564001c tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:28:40.075683 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-1eb4e625-164d-4a4b-857e-a0f9a564001c tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:28:40.076468 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-1eb4e625-164d-4a4b-857e-a0f9a564001c tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:28:40.076895 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-1eb4e625-164d-4a4b-857e-a0f9a564001c tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:28:40.204221 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-1eb4e625-164d-4a4b-857e-a0f9a564001c tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6c68b3aef547a6b583c25f6e63beb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f02e47d7b7453f84fd8dd3881d1329', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:28:40.212042 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-1eb4e625-164d-4a4b-857e-a0f9a564001c tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] 10.222.0.25 "GET /compute/v2.1/servers/dd766376-8156-40fd-b5e3-78b38e646c6b" status: 200 len: 1555 microversion: 2.1 time: 0.147710 Nov 09 20:28:40.212624 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 943/1857] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:28:40 2021] GET /compute/v2.1/servers/dd766376-8156-40fd-b5e3-78b38e646c6b => generated 1555 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:28:41.039458 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [req-0ce81418-b118-439e-a2ac-71cf9fea47e8 req-5613309e-c97a-4259-8329-3de8ccd18a34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd766376-8156-40fd-b5e3-78b38e646c6b", "name": "network-vif-deleted", "tag": "59519f60-a468-440d-994e-53e9e3436175"}]} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:28:41.041132 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 20:28:41.041132 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: warnings.warn(msg) Nov 09 20:28:41.048793 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-0ce81418-b118-439e-a2ac-71cf9fea47e8 req-5613309e-c97a-4259-8329-3de8ccd18a34 service nova] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:28:41.049141 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-0ce81418-b118-439e-a2ac-71cf9fea47e8 req-5613309e-c97a-4259-8329-3de8ccd18a34 service nova] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:28:41.059141 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.compute.server_external_events [req-0ce81418-b118-439e-a2ac-71cf9fea47e8 req-5613309e-c97a-4259-8329-3de8ccd18a34 service nova] Creating event network-vif-deleted:59519f60-a468-440d-994e-53e9e3436175 for instance dd766376-8156-40fd-b5e3-78b38e646c6b on hv-cinder-80135 Nov 09 20:28:41.063760 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [req-0ce81418-b118-439e-a2ac-71cf9fea47e8 req-5613309e-c97a-4259-8329-3de8ccd18a34 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108692 Nov 09 20:28:41.064368 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 915/1858] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Nov 9 20:28:40 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:28:41.229618 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-44d60086-eb3a-4995-af59-d800281a26ae tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:28:41.230222 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-44d60086-eb3a-4995-af59-d800281a26ae tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] [instance: dd766376-8156-40fd-b5e3-78b38e646c6b] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:28:41.236948 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-44d60086-eb3a-4995-af59-d800281a26ae tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:28:41.237400 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-44d60086-eb3a-4995-af59-d800281a26ae tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:28:41.238200 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-44d60086-eb3a-4995-af59-d800281a26ae tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:28:41.239171 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-44d60086-eb3a-4995-af59-d800281a26ae tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:28:41.272353 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-44d60086-eb3a-4995-af59-d800281a26ae tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:28:41.272832 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-44d60086-eb3a-4995-af59-d800281a26ae tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:28:41.273279 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.objects.instance [None req-44d60086-eb3a-4995-af59-d800281a26ae tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] Lazy-loading 'fault' on Instance uuid dd766376-8156-40fd-b5e3-78b38e646c6b {{(pid=116102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 09 20:28:41.321198 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-44d60086-eb3a-4995-af59-d800281a26ae tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6c68b3aef547a6b583c25f6e63beb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f02e47d7b7453f84fd8dd3881d1329', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:28:41.328489 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-44d60086-eb3a-4995-af59-d800281a26ae tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] 10.222.0.25 "GET /compute/v2.1/servers/dd766376-8156-40fd-b5e3-78b38e646c6b" status: 200 len: 1348 microversion: 2.1 time: 0.102494 Nov 09 20:28:41.329072 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 944/1859] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:28:41 2021] GET /compute/v2.1/servers/dd766376-8156-40fd-b5e3-78b38e646c6b => generated 1348 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:28:42.347941 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-88c84a61-f8ed-4c7b-b7d2-d981a838c066 tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:28:42.349121 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-88c84a61-f8ed-4c7b-b7d2-d981a838c066 tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] [instance: dd766376-8156-40fd-b5e3-78b38e646c6b] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:28:42.355143 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-88c84a61-f8ed-4c7b-b7d2-d981a838c066 tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:28:42.355586 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-88c84a61-f8ed-4c7b-b7d2-d981a838c066 tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:28:42.356348 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-88c84a61-f8ed-4c7b-b7d2-d981a838c066 tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:28:42.356866 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-88c84a61-f8ed-4c7b-b7d2-d981a838c066 tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:28:42.370752 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.wsgi [None req-88c84a61-f8ed-4c7b-b7d2-d981a838c066 tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] HTTP exception thrown: Instance dd766376-8156-40fd-b5e3-78b38e646c6b could not be found. Nov 09 20:28:42.371323 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-88c84a61-f8ed-4c7b-b7d2-d981a838c066 tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] Returning 404 to user: Instance dd766376-8156-40fd-b5e3-78b38e646c6b could not be found. {{(pid=116103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 09 20:28:42.372119 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-88c84a61-f8ed-4c7b-b7d2-d981a838c066 tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] 10.222.0.25 "GET /compute/v2.1/servers/dd766376-8156-40fd-b5e3-78b38e646c6b" status: 404 len: 111 microversion: 2.1 time: 0.029105 Nov 09 20:28:42.372655 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 916/1860] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:28:42 2021] GET /compute/v2.1/servers/dd766376-8156-40fd-b5e3-78b38e646c6b => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 09 20:28:42.380515 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-4380e950-9bcd-484a-ade4-bf014a70138e tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] Calling method '.version_select at 0x7fab36e941f0>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:28:42.402707 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-4380e950-9bcd-484a-ade4-bf014a70138e tempest-TestMinimumBasicScenario-271053248 tempest-TestMinimumBasicScenario-271053248-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-642532956" status: 202 len: 0 microversion: 2.1 time: 0.025865 Nov 09 20:28:42.403300 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 945/1861] 10.222.0.25 () {58 vars in 1268 bytes} [Tue Nov 9 20:28:42 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-642532956 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 09 20:28:42.702163 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-e7198348-fbe6-4bae-b138-76fb5986a5c5 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:28:42.702701 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-e7198348-fbe6-4bae-b138-76fb5986a5c5 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:28:42.708897 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e7198348-fbe6-4bae-b138-76fb5986a5c5 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:28:42.709337 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e7198348-fbe6-4bae-b138-76fb5986a5c5 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:28:42.710094 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e7198348-fbe6-4bae-b138-76fb5986a5c5 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:28:42.710521 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e7198348-fbe6-4bae-b138-76fb5986a5c5 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:28:42.735216 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-e7198348-fbe6-4bae-b138-76fb5986a5c5 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Going to try to terminate instance {{(pid=116103) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 09 20:28:42.821025 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-e7198348-fbe6-4bae-b138-76fb5986a5c5 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "DELETE /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 204 len: 0 microversion: 2.1 time: 0.121948 Nov 09 20:28:42.821699 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 917/1862] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Nov 9 20:28:42 2021] DELETE /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 09 20:28:42.830842 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-f14740d4-b44f-43b6-a59e-ef9e1eff2976 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:28:42.831448 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-f14740d4-b44f-43b6-a59e-ef9e1eff2976 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:28:42.838505 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f14740d4-b44f-43b6-a59e-ef9e1eff2976 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:28:42.839075 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f14740d4-b44f-43b6-a59e-ef9e1eff2976 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:28:42.840057 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f14740d4-b44f-43b6-a59e-ef9e1eff2976 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:28:42.840538 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f14740d4-b44f-43b6-a59e-ef9e1eff2976 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:28:42.980172 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-f14740d4-b44f-43b6-a59e-ef9e1eff2976 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:28:42.989217 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-f14740d4-b44f-43b6-a59e-ef9e1eff2976 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1718 microversion: 2.1 time: 0.161341 Nov 09 20:28:42.989821 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 946/1863] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:28:42 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1718 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 20:28:44.007604 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-da2804da-dcfe-4f17-b139-8db393b2a9f8 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:28:44.008358 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-da2804da-dcfe-4f17-b139-8db393b2a9f8 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:28:44.015581 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-da2804da-dcfe-4f17-b139-8db393b2a9f8 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:28:44.016514 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-da2804da-dcfe-4f17-b139-8db393b2a9f8 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:28:44.017478 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-da2804da-dcfe-4f17-b139-8db393b2a9f8 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:28:44.018142 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-da2804da-dcfe-4f17-b139-8db393b2a9f8 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:28:44.092229 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-da2804da-dcfe-4f17-b139-8db393b2a9f8 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:28:44.104865 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-da2804da-dcfe-4f17-b139-8db393b2a9f8 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1651 microversion: 2.1 time: 0.102023 Nov 09 20:28:44.115468 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 918/1864] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:28:44 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1651 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:28:44.372886 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [req-49c32708-5bc9-449f-955b-345bd8e953e4 req-fac37546-47a9-4fa3-a708-100df10357b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "632b79c1-d378-423c-8404-3204223226a6", "name": "network-vif-deleted", "tag": "bf82cdc8-5318-4cd6-9fbe-fda62638d826"}]} {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:28:44.374419 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 20:28:44.374419 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: warnings.warn(msg) Nov 09 20:28:44.382696 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [req-49c32708-5bc9-449f-955b-345bd8e953e4 req-fac37546-47a9-4fa3-a708-100df10357b9 service nova] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:28:44.383521 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [req-49c32708-5bc9-449f-955b-345bd8e953e4 req-fac37546-47a9-4fa3-a708-100df10357b9 service nova] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:28:44.397425 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.compute.server_external_events [req-49c32708-5bc9-449f-955b-345bd8e953e4 req-fac37546-47a9-4fa3-a708-100df10357b9 service nova] Creating event network-vif-deleted:bf82cdc8-5318-4cd6-9fbe-fda62638d826 for instance 632b79c1-d378-423c-8404-3204223226a6 on hv-cinder-80135 Nov 09 20:28:44.404693 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [req-49c32708-5bc9-449f-955b-345bd8e953e4 req-fac37546-47a9-4fa3-a708-100df10357b9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035479 Nov 09 20:28:44.405850 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 947/1865] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Nov 9 20:28:44 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:28:45.122442 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-0d8c13a3-d0c3-451d-9c20-2d8edd55f1a0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:28:45.123043 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-0d8c13a3-d0c3-451d-9c20-2d8edd55f1a0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:28:45.132335 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0d8c13a3-d0c3-451d-9c20-2d8edd55f1a0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:28:45.132812 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0d8c13a3-d0c3-451d-9c20-2d8edd55f1a0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:28:45.133601 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0d8c13a3-d0c3-451d-9c20-2d8edd55f1a0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:28:45.134023 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0d8c13a3-d0c3-451d-9c20-2d8edd55f1a0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:28:45.230824 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-0d8c13a3-d0c3-451d-9c20-2d8edd55f1a0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:28:45.242363 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-0d8c13a3-d0c3-451d-9c20-2d8edd55f1a0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.123678 Nov 09 20:28:45.244336 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 919/1866] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:28:45 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:28:46.260487 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-75d9d9b9-be11-4c18-a97b-d6570404c5e0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:28:46.261799 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-75d9d9b9-be11-4c18-a97b-d6570404c5e0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:28:46.267930 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-75d9d9b9-be11-4c18-a97b-d6570404c5e0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:28:46.268605 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-75d9d9b9-be11-4c18-a97b-d6570404c5e0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:28:46.269606 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-75d9d9b9-be11-4c18-a97b-d6570404c5e0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:28:46.270207 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-75d9d9b9-be11-4c18-a97b-d6570404c5e0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:28:46.340697 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-75d9d9b9-be11-4c18-a97b-d6570404c5e0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:28:46.348549 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-75d9d9b9-be11-4c18-a97b-d6570404c5e0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.092524 Nov 09 20:28:46.349112 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 948/1867] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:28:46 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:28:47.365230 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-658ad84c-266a-4a12-9cb7-1d3987a3bdac tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:28:47.365827 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-658ad84c-266a-4a12-9cb7-1d3987a3bdac tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:28:47.372205 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-658ad84c-266a-4a12-9cb7-1d3987a3bdac tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:28:47.372678 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-658ad84c-266a-4a12-9cb7-1d3987a3bdac tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:28:47.373446 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-658ad84c-266a-4a12-9cb7-1d3987a3bdac tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:28:47.373875 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-658ad84c-266a-4a12-9cb7-1d3987a3bdac tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:28:47.460943 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-658ad84c-266a-4a12-9cb7-1d3987a3bdac tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:28:47.469517 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-658ad84c-266a-4a12-9cb7-1d3987a3bdac tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.108042 Nov 09 20:28:47.470085 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 920/1868] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:28:47 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:28:48.486241 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-88d8b496-3e17-40fb-86e2-5648bd5ab19e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:28:48.487205 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-88d8b496-3e17-40fb-86e2-5648bd5ab19e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:28:48.494892 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-88d8b496-3e17-40fb-86e2-5648bd5ab19e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:28:48.495513 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-88d8b496-3e17-40fb-86e2-5648bd5ab19e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:28:48.496412 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-88d8b496-3e17-40fb-86e2-5648bd5ab19e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:28:48.496962 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-88d8b496-3e17-40fb-86e2-5648bd5ab19e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:28:48.571572 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-88d8b496-3e17-40fb-86e2-5648bd5ab19e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:28:48.580200 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-88d8b496-3e17-40fb-86e2-5648bd5ab19e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.097584 Nov 09 20:28:48.590724 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 949/1869] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:28:48 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:28:49.597834 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-d2a9d52d-4c57-4d44-9027-53999a9077c4 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:28:49.598741 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-d2a9d52d-4c57-4d44-9027-53999a9077c4 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:28:49.604926 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d2a9d52d-4c57-4d44-9027-53999a9077c4 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:28:49.605370 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d2a9d52d-4c57-4d44-9027-53999a9077c4 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:28:49.606205 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d2a9d52d-4c57-4d44-9027-53999a9077c4 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:28:49.606636 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d2a9d52d-4c57-4d44-9027-53999a9077c4 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:28:49.671234 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-d2a9d52d-4c57-4d44-9027-53999a9077c4 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:28:49.680115 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-d2a9d52d-4c57-4d44-9027-53999a9077c4 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.085992 Nov 09 20:28:49.680705 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 921/1870] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:28:49 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:28:50.697583 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-89a27c0f-4158-4777-8c77-e49fb5c11e08 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:28:50.698194 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-89a27c0f-4158-4777-8c77-e49fb5c11e08 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:28:50.704076 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-89a27c0f-4158-4777-8c77-e49fb5c11e08 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:28:50.704563 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-89a27c0f-4158-4777-8c77-e49fb5c11e08 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:28:50.705433 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-89a27c0f-4158-4777-8c77-e49fb5c11e08 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:28:50.705876 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-89a27c0f-4158-4777-8c77-e49fb5c11e08 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:28:50.767141 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-89a27c0f-4158-4777-8c77-e49fb5c11e08 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:28:50.775071 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-89a27c0f-4158-4777-8c77-e49fb5c11e08 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.081064 Nov 09 20:28:50.775727 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 950/1871] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:28:50 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:28:51.792755 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-3ef1358d-2db8-4c1a-bd40-7c36a4809dfc tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:28:51.793354 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-3ef1358d-2db8-4c1a-bd40-7c36a4809dfc tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:28:51.799532 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3ef1358d-2db8-4c1a-bd40-7c36a4809dfc tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:28:51.799974 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3ef1358d-2db8-4c1a-bd40-7c36a4809dfc tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:28:51.801347 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3ef1358d-2db8-4c1a-bd40-7c36a4809dfc tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:28:51.801784 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3ef1358d-2db8-4c1a-bd40-7c36a4809dfc tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:28:51.859008 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-3ef1358d-2db8-4c1a-bd40-7c36a4809dfc tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:28:51.867173 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-3ef1358d-2db8-4c1a-bd40-7c36a4809dfc tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.078122 Nov 09 20:28:51.867725 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 922/1872] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:28:51 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:28:52.884533 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-bbafb319-7c5f-469a-8e0a-0508423e1f32 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:28:52.885126 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-bbafb319-7c5f-469a-8e0a-0508423e1f32 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:28:52.891294 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-bbafb319-7c5f-469a-8e0a-0508423e1f32 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:28:52.891731 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-bbafb319-7c5f-469a-8e0a-0508423e1f32 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:28:52.892529 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-bbafb319-7c5f-469a-8e0a-0508423e1f32 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:28:52.892960 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-bbafb319-7c5f-469a-8e0a-0508423e1f32 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:28:52.952746 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-bbafb319-7c5f-469a-8e0a-0508423e1f32 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:28:52.961077 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-bbafb319-7c5f-469a-8e0a-0508423e1f32 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.080339 Nov 09 20:28:52.961638 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 951/1873] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:28:52 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:28:53.977557 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-c81f3444-0662-42dc-b5db-6aef7c5000d4 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:28:53.978164 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-c81f3444-0662-42dc-b5db-6aef7c5000d4 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:28:53.984472 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c81f3444-0662-42dc-b5db-6aef7c5000d4 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:28:53.984925 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c81f3444-0662-42dc-b5db-6aef7c5000d4 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:28:53.985701 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c81f3444-0662-42dc-b5db-6aef7c5000d4 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:28:53.986135 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c81f3444-0662-42dc-b5db-6aef7c5000d4 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:28:54.048051 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-c81f3444-0662-42dc-b5db-6aef7c5000d4 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:28:54.056256 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-c81f3444-0662-42dc-b5db-6aef7c5000d4 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.082316 Nov 09 20:28:54.056851 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 923/1874] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:28:53 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:28:55.072619 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-ca16c1da-a5b5-4dfa-9ac4-81a5468b2c24 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:28:55.073239 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-ca16c1da-a5b5-4dfa-9ac4-81a5468b2c24 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:28:55.079732 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ca16c1da-a5b5-4dfa-9ac4-81a5468b2c24 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:28:55.080176 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ca16c1da-a5b5-4dfa-9ac4-81a5468b2c24 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:28:55.080970 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ca16c1da-a5b5-4dfa-9ac4-81a5468b2c24 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:28:55.081401 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ca16c1da-a5b5-4dfa-9ac4-81a5468b2c24 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:28:55.142008 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-ca16c1da-a5b5-4dfa-9ac4-81a5468b2c24 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:28:55.150269 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-ca16c1da-a5b5-4dfa-9ac4-81a5468b2c24 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.081266 Nov 09 20:28:55.150825 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 952/1875] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:28:55 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:28:56.166288 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-b752434b-14eb-452b-a42e-d3a9ae0a3d97 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:28:56.166894 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-b752434b-14eb-452b-a42e-d3a9ae0a3d97 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:28:56.172733 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b752434b-14eb-452b-a42e-d3a9ae0a3d97 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:28:56.173172 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b752434b-14eb-452b-a42e-d3a9ae0a3d97 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:28:56.173927 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b752434b-14eb-452b-a42e-d3a9ae0a3d97 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:28:56.174355 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b752434b-14eb-452b-a42e-d3a9ae0a3d97 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:28:56.232384 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-b752434b-14eb-452b-a42e-d3a9ae0a3d97 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:28:56.240786 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-b752434b-14eb-452b-a42e-d3a9ae0a3d97 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.078158 Nov 09 20:28:56.241331 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 924/1876] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:28:56 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:28:57.258002 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-18c28ae8-d3de-46c3-8c06-a035e665a6fb tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:28:57.258612 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-18c28ae8-d3de-46c3-8c06-a035e665a6fb tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:28:57.265196 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-18c28ae8-d3de-46c3-8c06-a035e665a6fb tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:28:57.265644 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-18c28ae8-d3de-46c3-8c06-a035e665a6fb tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:28:57.266490 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-18c28ae8-d3de-46c3-8c06-a035e665a6fb tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:28:57.266951 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-18c28ae8-d3de-46c3-8c06-a035e665a6fb tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:28:57.328798 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-18c28ae8-d3de-46c3-8c06-a035e665a6fb tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:28:57.336701 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-18c28ae8-d3de-46c3-8c06-a035e665a6fb tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.082578 Nov 09 20:28:57.337276 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 953/1877] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:28:57 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:28:58.352295 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-603cb514-2108-42fb-9afe-af4a0b5376e7 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:28:58.352922 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-603cb514-2108-42fb-9afe-af4a0b5376e7 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:28:58.359150 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-603cb514-2108-42fb-9afe-af4a0b5376e7 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:28:58.359596 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-603cb514-2108-42fb-9afe-af4a0b5376e7 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:28:58.360361 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-603cb514-2108-42fb-9afe-af4a0b5376e7 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:28:58.360813 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-603cb514-2108-42fb-9afe-af4a0b5376e7 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:28:58.418786 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-603cb514-2108-42fb-9afe-af4a0b5376e7 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:28:58.427190 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-603cb514-2108-42fb-9afe-af4a0b5376e7 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.078506 Nov 09 20:28:58.427738 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 925/1878] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:28:58 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:28:59.443785 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-80e525bf-c920-4823-8977-5e948ae467a7 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:28:59.444374 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-80e525bf-c920-4823-8977-5e948ae467a7 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:28:59.450559 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-80e525bf-c920-4823-8977-5e948ae467a7 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:28:59.451000 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-80e525bf-c920-4823-8977-5e948ae467a7 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:28:59.451764 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-80e525bf-c920-4823-8977-5e948ae467a7 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:28:59.452228 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-80e525bf-c920-4823-8977-5e948ae467a7 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:28:59.512118 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-80e525bf-c920-4823-8977-5e948ae467a7 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:28:59.520661 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-80e525bf-c920-4823-8977-5e948ae467a7 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.081342 Nov 09 20:28:59.521219 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 954/1879] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:28:59 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 20:29:00.538060 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-e8ac9712-8eb2-4ac4-b054-292623ef88b4 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:29:00.538625 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-e8ac9712-8eb2-4ac4-b054-292623ef88b4 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:29:00.544773 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e8ac9712-8eb2-4ac4-b054-292623ef88b4 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:29:00.545216 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e8ac9712-8eb2-4ac4-b054-292623ef88b4 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:29:00.545986 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e8ac9712-8eb2-4ac4-b054-292623ef88b4 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:29:00.546415 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e8ac9712-8eb2-4ac4-b054-292623ef88b4 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:29:00.616185 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-e8ac9712-8eb2-4ac4-b054-292623ef88b4 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:29:00.625281 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-e8ac9712-8eb2-4ac4-b054-292623ef88b4 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.091493 Nov 09 20:29:00.625942 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 926/1880] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:29:00 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:29:01.646512 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-69285ff5-1c86-4111-b11b-9397dc144619 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:29:01.647113 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-69285ff5-1c86-4111-b11b-9397dc144619 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:29:01.653331 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-69285ff5-1c86-4111-b11b-9397dc144619 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:29:01.653768 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-69285ff5-1c86-4111-b11b-9397dc144619 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:29:01.654529 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-69285ff5-1c86-4111-b11b-9397dc144619 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:29:01.654956 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-69285ff5-1c86-4111-b11b-9397dc144619 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:29:01.714146 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-69285ff5-1c86-4111-b11b-9397dc144619 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:29:01.721831 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-69285ff5-1c86-4111-b11b-9397dc144619 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.080006 Nov 09 20:29:01.722437 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 955/1881] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:29:01 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:29:02.739197 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-b2149a3b-3f80-42be-8b63-1ddacd97494a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:29:02.739914 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-b2149a3b-3f80-42be-8b63-1ddacd97494a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:29:02.746453 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b2149a3b-3f80-42be-8b63-1ddacd97494a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:29:02.746908 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b2149a3b-3f80-42be-8b63-1ddacd97494a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:29:02.747684 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b2149a3b-3f80-42be-8b63-1ddacd97494a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:29:02.748113 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b2149a3b-3f80-42be-8b63-1ddacd97494a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:29:02.807125 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-b2149a3b-3f80-42be-8b63-1ddacd97494a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:29:02.814919 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-b2149a3b-3f80-42be-8b63-1ddacd97494a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.080210 Nov 09 20:29:02.815517 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 927/1882] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:29:02 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:29:03.833125 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-42b3d785-be98-4fe6-ba4a-290969a197ba tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:29:03.833762 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-42b3d785-be98-4fe6-ba4a-290969a197ba tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:29:03.840147 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-42b3d785-be98-4fe6-ba4a-290969a197ba tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:29:03.840629 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-42b3d785-be98-4fe6-ba4a-290969a197ba tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:29:03.841416 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-42b3d785-be98-4fe6-ba4a-290969a197ba tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:29:03.841839 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-42b3d785-be98-4fe6-ba4a-290969a197ba tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:29:03.901699 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-42b3d785-be98-4fe6-ba4a-290969a197ba tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:29:03.909253 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-42b3d785-be98-4fe6-ba4a-290969a197ba tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.080389 Nov 09 20:29:03.909809 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 956/1883] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:29:03 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:29:04.926775 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-73f9c9c3-4454-46b9-843c-0cca1259a0eb tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:29:04.927385 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-73f9c9c3-4454-46b9-843c-0cca1259a0eb tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:29:04.933541 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-73f9c9c3-4454-46b9-843c-0cca1259a0eb tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:29:04.933983 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-73f9c9c3-4454-46b9-843c-0cca1259a0eb tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:29:04.934757 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-73f9c9c3-4454-46b9-843c-0cca1259a0eb tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:29:04.935180 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-73f9c9c3-4454-46b9-843c-0cca1259a0eb tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:29:04.995419 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-73f9c9c3-4454-46b9-843c-0cca1259a0eb tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:29:05.003088 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-73f9c9c3-4454-46b9-843c-0cca1259a0eb tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.080806 Nov 09 20:29:05.003672 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 928/1884] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:29:04 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:29:06.020048 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-921ffa83-f55b-40d7-b2f7-760006910e57 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:29:06.020692 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-921ffa83-f55b-40d7-b2f7-760006910e57 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:29:06.026956 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-921ffa83-f55b-40d7-b2f7-760006910e57 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:29:06.027401 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-921ffa83-f55b-40d7-b2f7-760006910e57 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:29:06.028170 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-921ffa83-f55b-40d7-b2f7-760006910e57 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:29:06.028638 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-921ffa83-f55b-40d7-b2f7-760006910e57 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:29:06.088664 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-921ffa83-f55b-40d7-b2f7-760006910e57 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:29:06.096308 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-921ffa83-f55b-40d7-b2f7-760006910e57 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.080208 Nov 09 20:29:06.096887 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 957/1885] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:29:06 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:29:07.112876 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-92229edc-ae85-4f4f-ab0c-4bece30b6b1c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:29:07.113582 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-92229edc-ae85-4f4f-ab0c-4bece30b6b1c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:29:07.119911 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-92229edc-ae85-4f4f-ab0c-4bece30b6b1c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:29:07.120350 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-92229edc-ae85-4f4f-ab0c-4bece30b6b1c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:29:07.121137 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-92229edc-ae85-4f4f-ab0c-4bece30b6b1c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:29:07.121560 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-92229edc-ae85-4f4f-ab0c-4bece30b6b1c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:29:07.182850 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-92229edc-ae85-4f4f-ab0c-4bece30b6b1c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:29:07.190517 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-92229edc-ae85-4f4f-ab0c-4bece30b6b1c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.081366 Nov 09 20:29:07.191705 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 929/1886] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:29:07 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:29:08.207543 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-fdad9dcd-3e98-4747-8deb-00a535ead1c7 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:29:08.208178 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-fdad9dcd-3e98-4747-8deb-00a535ead1c7 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:29:08.214429 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-fdad9dcd-3e98-4747-8deb-00a535ead1c7 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:29:08.214871 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-fdad9dcd-3e98-4747-8deb-00a535ead1c7 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:29:08.215642 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-fdad9dcd-3e98-4747-8deb-00a535ead1c7 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:29:08.216136 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-fdad9dcd-3e98-4747-8deb-00a535ead1c7 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:29:08.276039 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-fdad9dcd-3e98-4747-8deb-00a535ead1c7 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:29:08.283855 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-fdad9dcd-3e98-4747-8deb-00a535ead1c7 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.080716 Nov 09 20:29:08.284448 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 958/1887] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:29:08 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:29:09.302138 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-3998ce43-be54-45d4-a74c-3f61e8e0d57b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:29:09.302769 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-3998ce43-be54-45d4-a74c-3f61e8e0d57b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:29:09.308971 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3998ce43-be54-45d4-a74c-3f61e8e0d57b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:29:09.309411 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3998ce43-be54-45d4-a74c-3f61e8e0d57b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:29:09.310207 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3998ce43-be54-45d4-a74c-3f61e8e0d57b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:29:09.310636 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3998ce43-be54-45d4-a74c-3f61e8e0d57b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:29:09.368660 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-3998ce43-be54-45d4-a74c-3f61e8e0d57b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:29:09.376633 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-3998ce43-be54-45d4-a74c-3f61e8e0d57b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.078710 Nov 09 20:29:09.377200 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 930/1888] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:29:09 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:29:10.393042 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-e56e9896-f0a8-4cc1-9801-640151e417e4 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:29:10.393648 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-e56e9896-f0a8-4cc1-9801-640151e417e4 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:29:10.400106 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e56e9896-f0a8-4cc1-9801-640151e417e4 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:29:10.400585 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e56e9896-f0a8-4cc1-9801-640151e417e4 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:29:10.401361 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e56e9896-f0a8-4cc1-9801-640151e417e4 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:29:10.401794 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e56e9896-f0a8-4cc1-9801-640151e417e4 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:29:10.460486 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-e56e9896-f0a8-4cc1-9801-640151e417e4 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:29:10.468011 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-e56e9896-f0a8-4cc1-9801-640151e417e4 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.078630 Nov 09 20:29:10.468600 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 959/1889] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:29:10 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:29:11.484625 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-3e13a177-6ab9-44d8-98d5-054c48f34c5c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:29:11.485251 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-3e13a177-6ab9-44d8-98d5-054c48f34c5c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:29:11.492288 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3e13a177-6ab9-44d8-98d5-054c48f34c5c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:29:11.492823 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3e13a177-6ab9-44d8-98d5-054c48f34c5c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:29:11.493597 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3e13a177-6ab9-44d8-98d5-054c48f34c5c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:29:11.494030 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3e13a177-6ab9-44d8-98d5-054c48f34c5c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:29:11.552802 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-3e13a177-6ab9-44d8-98d5-054c48f34c5c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:29:11.560514 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-3e13a177-6ab9-44d8-98d5-054c48f34c5c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.079485 Nov 09 20:29:11.561082 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 931/1890] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:29:11 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:29:12.577126 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-8fe8a488-cf50-4763-b044-95fa2927c014 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:29:12.577680 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-8fe8a488-cf50-4763-b044-95fa2927c014 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:29:12.584364 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-8fe8a488-cf50-4763-b044-95fa2927c014 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:29:12.584837 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-8fe8a488-cf50-4763-b044-95fa2927c014 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:29:12.585600 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-8fe8a488-cf50-4763-b044-95fa2927c014 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:29:12.586032 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-8fe8a488-cf50-4763-b044-95fa2927c014 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:29:12.647226 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-8fe8a488-cf50-4763-b044-95fa2927c014 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:29:12.655010 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-8fe8a488-cf50-4763-b044-95fa2927c014 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.081642 Nov 09 20:29:12.655570 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 960/1891] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:29:12 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:29:13.672078 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-10f93bf0-4ee3-40cb-a1ea-7d92f2faf759 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:29:13.672708 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-10f93bf0-4ee3-40cb-a1ea-7d92f2faf759 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:29:13.679895 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-10f93bf0-4ee3-40cb-a1ea-7d92f2faf759 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:29:13.680337 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-10f93bf0-4ee3-40cb-a1ea-7d92f2faf759 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:29:13.681142 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-10f93bf0-4ee3-40cb-a1ea-7d92f2faf759 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:29:13.681569 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-10f93bf0-4ee3-40cb-a1ea-7d92f2faf759 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:29:13.741898 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-10f93bf0-4ee3-40cb-a1ea-7d92f2faf759 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:29:13.749846 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-10f93bf0-4ee3-40cb-a1ea-7d92f2faf759 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.081403 Nov 09 20:29:13.750404 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 932/1892] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:29:13 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:29:14.766573 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-01e08939-55a7-4ee7-a956-7178bc9995ac tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:29:14.767174 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-01e08939-55a7-4ee7-a956-7178bc9995ac tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:29:14.773568 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-01e08939-55a7-4ee7-a956-7178bc9995ac tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:29:14.774016 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-01e08939-55a7-4ee7-a956-7178bc9995ac tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:29:14.774787 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-01e08939-55a7-4ee7-a956-7178bc9995ac tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:29:14.775224 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-01e08939-55a7-4ee7-a956-7178bc9995ac tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:29:14.833400 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-01e08939-55a7-4ee7-a956-7178bc9995ac tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:29:14.840955 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-01e08939-55a7-4ee7-a956-7178bc9995ac tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.078100 Nov 09 20:29:14.841515 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 961/1893] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:29:14 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:29:15.857512 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-01cbe0f8-9187-48ad-986c-895c64fcc544 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:29:15.858117 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-01cbe0f8-9187-48ad-986c-895c64fcc544 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:29:15.864362 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-01cbe0f8-9187-48ad-986c-895c64fcc544 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:29:15.864839 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-01cbe0f8-9187-48ad-986c-895c64fcc544 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:29:15.865607 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-01cbe0f8-9187-48ad-986c-895c64fcc544 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:29:15.866035 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-01cbe0f8-9187-48ad-986c-895c64fcc544 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:29:15.924029 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-01cbe0f8-9187-48ad-986c-895c64fcc544 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:29:15.931847 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-01cbe0f8-9187-48ad-986c-895c64fcc544 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.077999 Nov 09 20:29:15.932423 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 933/1894] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:29:15 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:29:16.949061 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-08db6fe4-a7bc-4cba-8cf6-45207b498b05 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:29:16.949695 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-08db6fe4-a7bc-4cba-8cf6-45207b498b05 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:29:16.955312 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-08db6fe4-a7bc-4cba-8cf6-45207b498b05 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:29:16.955758 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-08db6fe4-a7bc-4cba-8cf6-45207b498b05 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:29:16.956562 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-08db6fe4-a7bc-4cba-8cf6-45207b498b05 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:29:16.956994 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-08db6fe4-a7bc-4cba-8cf6-45207b498b05 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:29:17.016002 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-08db6fe4-a7bc-4cba-8cf6-45207b498b05 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:29:17.024266 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-08db6fe4-a7bc-4cba-8cf6-45207b498b05 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.079086 Nov 09 20:29:17.024856 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 962/1895] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:29:16 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:29:18.040924 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-eff4413a-9a29-4704-998c-d6d4b6a5a112 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:29:18.041546 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-eff4413a-9a29-4704-998c-d6d4b6a5a112 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:29:18.047802 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-eff4413a-9a29-4704-998c-d6d4b6a5a112 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:29:18.048251 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-eff4413a-9a29-4704-998c-d6d4b6a5a112 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:29:18.049057 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-eff4413a-9a29-4704-998c-d6d4b6a5a112 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:29:18.049494 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-eff4413a-9a29-4704-998c-d6d4b6a5a112 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:29:18.110323 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-eff4413a-9a29-4704-998c-d6d4b6a5a112 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:29:18.118507 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-eff4413a-9a29-4704-998c-d6d4b6a5a112 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.081283 Nov 09 20:29:18.119070 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 934/1896] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:29:18 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:29:19.118688 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 09 20:29:19.119313 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: Tue Nov 9 20:29:19 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 09 20:29:19.135838 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-8f9ce641-ee24-4c99-827f-27ef97645617 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:29:19.136881 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-8f9ce641-ee24-4c99-827f-27ef97645617 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:29:19.143219 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-8f9ce641-ee24-4c99-827f-27ef97645617 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:29:19.143665 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-8f9ce641-ee24-4c99-827f-27ef97645617 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:29:19.144520 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-8f9ce641-ee24-4c99-827f-27ef97645617 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:29:19.144948 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-8f9ce641-ee24-4c99-827f-27ef97645617 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:29:19.205874 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-8f9ce641-ee24-4c99-827f-27ef97645617 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:29:19.213799 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-8f9ce641-ee24-4c99-827f-27ef97645617 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.082312 Nov 09 20:29:19.214361 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 963/1897] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:29:19 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 20:29:20.230895 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-6e92f5ea-9f9a-4c11-a6b2-35a62f28124b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:29:20.231494 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-6e92f5ea-9f9a-4c11-a6b2-35a62f28124b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:29:20.238198 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6e92f5ea-9f9a-4c11-a6b2-35a62f28124b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:29:20.238635 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6e92f5ea-9f9a-4c11-a6b2-35a62f28124b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:29:20.239474 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6e92f5ea-9f9a-4c11-a6b2-35a62f28124b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:29:20.239901 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6e92f5ea-9f9a-4c11-a6b2-35a62f28124b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:29:20.302056 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-6e92f5ea-9f9a-4c11-a6b2-35a62f28124b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:29:20.309760 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-6e92f5ea-9f9a-4c11-a6b2-35a62f28124b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.082587 Nov 09 20:29:20.310311 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 935/1898] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:29:20 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:29:21.327217 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-d90fd8dc-5e53-42ab-b15e-9479488bdfa0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:29:21.327826 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-d90fd8dc-5e53-42ab-b15e-9479488bdfa0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:29:21.336861 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d90fd8dc-5e53-42ab-b15e-9479488bdfa0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:29:21.337308 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d90fd8dc-5e53-42ab-b15e-9479488bdfa0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:29:21.338085 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d90fd8dc-5e53-42ab-b15e-9479488bdfa0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:29:21.338518 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d90fd8dc-5e53-42ab-b15e-9479488bdfa0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:29:21.396817 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-d90fd8dc-5e53-42ab-b15e-9479488bdfa0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:29:21.404334 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-d90fd8dc-5e53-42ab-b15e-9479488bdfa0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.080791 Nov 09 20:29:21.404924 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 964/1899] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:29:21 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:29:22.420944 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-b263c966-cf35-42cd-82a5-7278c6c6f0e6 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:29:22.421568 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-b263c966-cf35-42cd-82a5-7278c6c6f0e6 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:29:22.427639 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b263c966-cf35-42cd-82a5-7278c6c6f0e6 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:29:22.428245 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b263c966-cf35-42cd-82a5-7278c6c6f0e6 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:29:22.429034 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b263c966-cf35-42cd-82a5-7278c6c6f0e6 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:29:22.429461 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b263c966-cf35-42cd-82a5-7278c6c6f0e6 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:29:22.487675 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-b263c966-cf35-42cd-82a5-7278c6c6f0e6 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:29:22.495742 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-b263c966-cf35-42cd-82a5-7278c6c6f0e6 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.078560 Nov 09 20:29:22.496358 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 936/1900] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:29:22 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:29:23.512475 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-c5896a8e-aab2-4776-9a92-fc964d073ca6 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:29:23.513051 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-c5896a8e-aab2-4776-9a92-fc964d073ca6 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:29:23.519486 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c5896a8e-aab2-4776-9a92-fc964d073ca6 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:29:23.519928 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c5896a8e-aab2-4776-9a92-fc964d073ca6 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:29:23.520753 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c5896a8e-aab2-4776-9a92-fc964d073ca6 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:29:23.521187 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c5896a8e-aab2-4776-9a92-fc964d073ca6 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:29:23.578781 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-c5896a8e-aab2-4776-9a92-fc964d073ca6 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:29:23.586656 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-c5896a8e-aab2-4776-9a92-fc964d073ca6 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.078049 Nov 09 20:29:23.587446 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 965/1901] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:29:23 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 20:29:24.603342 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-a8d933b3-587f-48b3-be1d-7c6281b56e9d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:29:24.603968 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-a8d933b3-587f-48b3-be1d-7c6281b56e9d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:29:24.610114 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a8d933b3-587f-48b3-be1d-7c6281b56e9d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:29:24.610555 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a8d933b3-587f-48b3-be1d-7c6281b56e9d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:29:24.611312 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a8d933b3-587f-48b3-be1d-7c6281b56e9d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:29:24.611735 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a8d933b3-587f-48b3-be1d-7c6281b56e9d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:29:24.670800 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-a8d933b3-587f-48b3-be1d-7c6281b56e9d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:29:24.679029 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-a8d933b3-587f-48b3-be1d-7c6281b56e9d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.079294 Nov 09 20:29:24.679584 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 937/1902] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:29:24 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 20:29:25.696239 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-840b93c8-df2c-449c-9618-2a12f2f7c2b7 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:29:25.696859 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-840b93c8-df2c-449c-9618-2a12f2f7c2b7 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:29:25.703027 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-840b93c8-df2c-449c-9618-2a12f2f7c2b7 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:29:25.703472 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-840b93c8-df2c-449c-9618-2a12f2f7c2b7 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:29:25.704245 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-840b93c8-df2c-449c-9618-2a12f2f7c2b7 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:29:25.704704 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-840b93c8-df2c-449c-9618-2a12f2f7c2b7 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:29:25.763146 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-840b93c8-df2c-449c-9618-2a12f2f7c2b7 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:29:25.771614 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-840b93c8-df2c-449c-9618-2a12f2f7c2b7 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.079025 Nov 09 20:29:25.772174 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 966/1903] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:29:25 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:29:26.789131 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-cddef7d2-2c57-470d-a18d-eae254916622 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:29:26.789768 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-cddef7d2-2c57-470d-a18d-eae254916622 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:29:26.795654 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cddef7d2-2c57-470d-a18d-eae254916622 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:29:26.796095 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cddef7d2-2c57-470d-a18d-eae254916622 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:29:26.796899 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cddef7d2-2c57-470d-a18d-eae254916622 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:29:26.797320 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cddef7d2-2c57-470d-a18d-eae254916622 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:29:26.858321 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-cddef7d2-2c57-470d-a18d-eae254916622 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:29:26.866137 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-cddef7d2-2c57-470d-a18d-eae254916622 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.081441 Nov 09 20:29:26.866696 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 938/1904] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:29:26 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:29:27.884027 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-090da63a-0056-49e9-b8e1-6b867eb4342c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:29:27.884666 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-090da63a-0056-49e9-b8e1-6b867eb4342c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:29:27.890962 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-090da63a-0056-49e9-b8e1-6b867eb4342c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:29:27.891407 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-090da63a-0056-49e9-b8e1-6b867eb4342c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:29:27.892181 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-090da63a-0056-49e9-b8e1-6b867eb4342c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:29:27.892717 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-090da63a-0056-49e9-b8e1-6b867eb4342c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:29:27.953055 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-090da63a-0056-49e9-b8e1-6b867eb4342c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:29:27.961591 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-090da63a-0056-49e9-b8e1-6b867eb4342c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.081281 Nov 09 20:29:27.962152 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 967/1905] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:29:27 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:29:28.978385 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-e857a426-c6d6-4e07-82ea-5e0865cbc185 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:29:28.979022 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-e857a426-c6d6-4e07-82ea-5e0865cbc185 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:29:28.985232 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e857a426-c6d6-4e07-82ea-5e0865cbc185 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:29:28.985679 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e857a426-c6d6-4e07-82ea-5e0865cbc185 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:29:28.986455 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e857a426-c6d6-4e07-82ea-5e0865cbc185 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:29:28.986891 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e857a426-c6d6-4e07-82ea-5e0865cbc185 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:29:29.046251 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-e857a426-c6d6-4e07-82ea-5e0865cbc185 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:29:29.054395 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-e857a426-c6d6-4e07-82ea-5e0865cbc185 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.079681 Nov 09 20:29:29.054957 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 939/1906] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:29:28 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:29:30.070894 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-552713ad-7fe6-462e-beee-a175d93dc195 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:29:30.071484 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-552713ad-7fe6-462e-beee-a175d93dc195 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:29:30.077753 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-552713ad-7fe6-462e-beee-a175d93dc195 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:29:30.078199 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-552713ad-7fe6-462e-beee-a175d93dc195 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:29:30.078961 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-552713ad-7fe6-462e-beee-a175d93dc195 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:29:30.079392 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-552713ad-7fe6-462e-beee-a175d93dc195 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:29:30.138499 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-552713ad-7fe6-462e-beee-a175d93dc195 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:29:30.146977 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-552713ad-7fe6-462e-beee-a175d93dc195 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.079711 Nov 09 20:29:30.147541 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 968/1907] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:29:30 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:29:31.163370 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-55e7a7aa-63fc-4bf3-8315-42dc30c63e12 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:29:31.163965 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-55e7a7aa-63fc-4bf3-8315-42dc30c63e12 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:29:31.171005 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-55e7a7aa-63fc-4bf3-8315-42dc30c63e12 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:29:31.171451 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-55e7a7aa-63fc-4bf3-8315-42dc30c63e12 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:29:31.172223 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-55e7a7aa-63fc-4bf3-8315-42dc30c63e12 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:29:31.172679 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-55e7a7aa-63fc-4bf3-8315-42dc30c63e12 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:29:31.230713 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-55e7a7aa-63fc-4bf3-8315-42dc30c63e12 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:29:31.239045 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-55e7a7aa-63fc-4bf3-8315-42dc30c63e12 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.079874 Nov 09 20:29:31.239594 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 940/1908] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:29:31 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:29:32.233522 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 09 20:29:32.234069 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: Tue Nov 9 20:29:32 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 09 20:29:32.256691 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-6ffbc6ca-6feb-4693-aca7-b85e835377ec tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:29:32.257320 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-6ffbc6ca-6feb-4693-aca7-b85e835377ec tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:29:32.263549 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6ffbc6ca-6feb-4693-aca7-b85e835377ec tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:29:32.263996 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6ffbc6ca-6feb-4693-aca7-b85e835377ec tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:29:32.264804 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6ffbc6ca-6feb-4693-aca7-b85e835377ec tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:29:32.265237 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6ffbc6ca-6feb-4693-aca7-b85e835377ec tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:29:32.324001 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-6ffbc6ca-6feb-4693-aca7-b85e835377ec tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:29:32.331750 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-6ffbc6ca-6feb-4693-aca7-b85e835377ec tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.079632 Nov 09 20:29:32.332306 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 969/1909] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:29:32 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:29:33.348436 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-739cbb9e-1ec8-49c0-a11e-62d0e5237e4d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:29:33.349046 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-739cbb9e-1ec8-49c0-a11e-62d0e5237e4d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:29:33.355394 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-739cbb9e-1ec8-49c0-a11e-62d0e5237e4d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:29:33.355866 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-739cbb9e-1ec8-49c0-a11e-62d0e5237e4d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:29:33.356662 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-739cbb9e-1ec8-49c0-a11e-62d0e5237e4d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:29:33.357092 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-739cbb9e-1ec8-49c0-a11e-62d0e5237e4d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:29:33.420489 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-739cbb9e-1ec8-49c0-a11e-62d0e5237e4d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:29:33.429123 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-739cbb9e-1ec8-49c0-a11e-62d0e5237e4d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.084640 Nov 09 20:29:33.429679 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 941/1910] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:29:33 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:29:34.445877 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-2ade980f-953d-4738-907e-a278986a7cbc tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:29:34.446485 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-2ade980f-953d-4738-907e-a278986a7cbc tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:29:34.452749 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-2ade980f-953d-4738-907e-a278986a7cbc tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:29:34.453194 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-2ade980f-953d-4738-907e-a278986a7cbc tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:29:34.453961 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-2ade980f-953d-4738-907e-a278986a7cbc tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:29:34.454397 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-2ade980f-953d-4738-907e-a278986a7cbc tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:29:34.513290 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-2ade980f-953d-4738-907e-a278986a7cbc tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:29:34.521615 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-2ade980f-953d-4738-907e-a278986a7cbc tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.079499 Nov 09 20:29:34.522171 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 970/1911] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:29:34 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:29:35.538314 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-28b1f1f5-d816-49e8-aebe-1d3e5cbd5efd tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:29:35.538881 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-28b1f1f5-d816-49e8-aebe-1d3e5cbd5efd tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:29:35.545044 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-28b1f1f5-d816-49e8-aebe-1d3e5cbd5efd tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:29:35.545481 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-28b1f1f5-d816-49e8-aebe-1d3e5cbd5efd tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:29:35.546238 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-28b1f1f5-d816-49e8-aebe-1d3e5cbd5efd tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:29:35.546694 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-28b1f1f5-d816-49e8-aebe-1d3e5cbd5efd tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:29:35.604483 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-28b1f1f5-d816-49e8-aebe-1d3e5cbd5efd tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:29:35.612176 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-28b1f1f5-d816-49e8-aebe-1d3e5cbd5efd tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.078414 Nov 09 20:29:35.613407 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 942/1912] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:29:35 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:29:36.630400 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-76b56a20-2072-43ed-b1c9-a8ea51fbc162 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:29:36.631004 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-76b56a20-2072-43ed-b1c9-a8ea51fbc162 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:29:36.637262 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-76b56a20-2072-43ed-b1c9-a8ea51fbc162 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:29:36.637710 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-76b56a20-2072-43ed-b1c9-a8ea51fbc162 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:29:36.638474 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-76b56a20-2072-43ed-b1c9-a8ea51fbc162 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:29:36.639433 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-76b56a20-2072-43ed-b1c9-a8ea51fbc162 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:29:36.699388 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-76b56a20-2072-43ed-b1c9-a8ea51fbc162 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:29:36.706972 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-76b56a20-2072-43ed-b1c9-a8ea51fbc162 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.081055 Nov 09 20:29:36.707525 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 971/1913] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:29:36 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:29:37.723599 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-5f9ed28b-e5d0-464f-bf8b-0299a151b438 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:29:37.724227 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-5f9ed28b-e5d0-464f-bf8b-0299a151b438 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:29:37.730414 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5f9ed28b-e5d0-464f-bf8b-0299a151b438 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:29:37.730849 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5f9ed28b-e5d0-464f-bf8b-0299a151b438 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:29:37.731608 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5f9ed28b-e5d0-464f-bf8b-0299a151b438 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:29:37.732036 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5f9ed28b-e5d0-464f-bf8b-0299a151b438 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:29:37.790219 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-5f9ed28b-e5d0-464f-bf8b-0299a151b438 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:29:37.797705 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-5f9ed28b-e5d0-464f-bf8b-0299a151b438 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.077763 Nov 09 20:29:37.798249 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 943/1914] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:29:37 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:29:38.814304 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-80334486-f0b4-4aa4-98d2-7d6801cb78dc tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:29:38.814907 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-80334486-f0b4-4aa4-98d2-7d6801cb78dc tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:29:38.821474 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-80334486-f0b4-4aa4-98d2-7d6801cb78dc tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:29:38.821926 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-80334486-f0b4-4aa4-98d2-7d6801cb78dc tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:29:38.822694 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-80334486-f0b4-4aa4-98d2-7d6801cb78dc tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:29:38.823125 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-80334486-f0b4-4aa4-98d2-7d6801cb78dc tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:29:38.883246 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-80334486-f0b4-4aa4-98d2-7d6801cb78dc tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:29:38.890812 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-80334486-f0b4-4aa4-98d2-7d6801cb78dc tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.080204 Nov 09 20:29:38.891363 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 972/1915] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:29:38 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:29:39.907985 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-c8bfd5fc-137f-435f-941f-096ed89c216b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:29:39.908591 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-c8bfd5fc-137f-435f-941f-096ed89c216b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:29:39.915439 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c8bfd5fc-137f-435f-941f-096ed89c216b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:29:39.915880 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c8bfd5fc-137f-435f-941f-096ed89c216b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:29:39.916661 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c8bfd5fc-137f-435f-941f-096ed89c216b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:29:39.917088 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c8bfd5fc-137f-435f-941f-096ed89c216b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:29:39.978468 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-c8bfd5fc-137f-435f-941f-096ed89c216b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:29:39.986010 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-c8bfd5fc-137f-435f-941f-096ed89c216b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.081696 Nov 09 20:29:39.986555 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 944/1916] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:29:39 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:29:41.004428 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-abc9b477-9a17-4744-86c5-317cf97bc8d5 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:29:41.005050 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-abc9b477-9a17-4744-86c5-317cf97bc8d5 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:29:41.011318 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-abc9b477-9a17-4744-86c5-317cf97bc8d5 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:29:41.011765 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-abc9b477-9a17-4744-86c5-317cf97bc8d5 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:29:41.012561 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-abc9b477-9a17-4744-86c5-317cf97bc8d5 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:29:41.012994 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-abc9b477-9a17-4744-86c5-317cf97bc8d5 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:29:41.073477 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-abc9b477-9a17-4744-86c5-317cf97bc8d5 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:29:41.081143 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-abc9b477-9a17-4744-86c5-317cf97bc8d5 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.081377 Nov 09 20:29:41.082113 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 973/1917] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:29:40 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:29:42.097601 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-c56babdb-c58c-41ba-b201-231af03dfa14 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:29:42.098230 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-c56babdb-c58c-41ba-b201-231af03dfa14 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:29:42.104630 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c56babdb-c58c-41ba-b201-231af03dfa14 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:29:42.105074 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c56babdb-c58c-41ba-b201-231af03dfa14 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:29:42.105840 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c56babdb-c58c-41ba-b201-231af03dfa14 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:29:42.106265 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c56babdb-c58c-41ba-b201-231af03dfa14 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:29:42.164773 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-c56babdb-c58c-41ba-b201-231af03dfa14 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:29:42.172275 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-c56babdb-c58c-41ba-b201-231af03dfa14 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.078317 Nov 09 20:29:42.172854 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 945/1918] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:29:42 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:29:43.189399 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-424bcc03-3ddf-40c9-b740-6e7c15cab7f5 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:29:43.190009 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-424bcc03-3ddf-40c9-b740-6e7c15cab7f5 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:29:43.196147 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-424bcc03-3ddf-40c9-b740-6e7c15cab7f5 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:29:43.196618 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-424bcc03-3ddf-40c9-b740-6e7c15cab7f5 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:29:43.197380 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-424bcc03-3ddf-40c9-b740-6e7c15cab7f5 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:29:43.197805 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-424bcc03-3ddf-40c9-b740-6e7c15cab7f5 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:29:43.256028 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-424bcc03-3ddf-40c9-b740-6e7c15cab7f5 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:29:43.263814 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-424bcc03-3ddf-40c9-b740-6e7c15cab7f5 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.078045 Nov 09 20:29:43.264369 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 974/1919] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:29:43 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 20:29:44.280827 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-1ef07559-abc2-47e5-a188-a8be3a3188cd tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:29:44.281426 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-1ef07559-abc2-47e5-a188-a8be3a3188cd tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:29:44.288648 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1ef07559-abc2-47e5-a188-a8be3a3188cd tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:29:44.289087 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1ef07559-abc2-47e5-a188-a8be3a3188cd tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:29:44.289860 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1ef07559-abc2-47e5-a188-a8be3a3188cd tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:29:44.290286 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1ef07559-abc2-47e5-a188-a8be3a3188cd tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:29:44.348375 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-1ef07559-abc2-47e5-a188-a8be3a3188cd tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:29:44.355932 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-1ef07559-abc2-47e5-a188-a8be3a3188cd tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.078708 Nov 09 20:29:44.356495 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 946/1920] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:29:44 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:29:45.373086 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-2c582f4a-ed06-42a5-9e03-46474fd46e8c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:29:45.373719 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-2c582f4a-ed06-42a5-9e03-46474fd46e8c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:29:45.379734 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-2c582f4a-ed06-42a5-9e03-46474fd46e8c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:29:45.380180 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-2c582f4a-ed06-42a5-9e03-46474fd46e8c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:29:45.380987 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-2c582f4a-ed06-42a5-9e03-46474fd46e8c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:29:45.381422 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-2c582f4a-ed06-42a5-9e03-46474fd46e8c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:29:45.439188 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-2c582f4a-ed06-42a5-9e03-46474fd46e8c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:29:45.446660 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-2c582f4a-ed06-42a5-9e03-46474fd46e8c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.077854 Nov 09 20:29:45.447215 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 975/1921] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:29:45 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:29:46.463438 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-e2de2069-5b3a-4ad3-b0ac-816b20fe1745 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:29:46.464034 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-e2de2069-5b3a-4ad3-b0ac-816b20fe1745 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:29:46.470348 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e2de2069-5b3a-4ad3-b0ac-816b20fe1745 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:29:46.470728 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e2de2069-5b3a-4ad3-b0ac-816b20fe1745 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:29:46.471486 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e2de2069-5b3a-4ad3-b0ac-816b20fe1745 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:29:46.471939 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e2de2069-5b3a-4ad3-b0ac-816b20fe1745 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:29:46.533333 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-e2de2069-5b3a-4ad3-b0ac-816b20fe1745 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:29:46.541406 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-e2de2069-5b3a-4ad3-b0ac-816b20fe1745 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.081577 Nov 09 20:29:46.541967 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 947/1922] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:29:46 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:29:47.558511 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-4c84170e-9bcc-4fbb-86f1-13a7f62aebbb tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:29:47.559046 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-4c84170e-9bcc-4fbb-86f1-13a7f62aebbb tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:29:47.565241 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-4c84170e-9bcc-4fbb-86f1-13a7f62aebbb tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:29:47.566182 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-4c84170e-9bcc-4fbb-86f1-13a7f62aebbb tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:29:47.566956 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-4c84170e-9bcc-4fbb-86f1-13a7f62aebbb tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:29:47.567387 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-4c84170e-9bcc-4fbb-86f1-13a7f62aebbb tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:29:47.626033 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-4c84170e-9bcc-4fbb-86f1-13a7f62aebbb tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:29:47.634396 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-4c84170e-9bcc-4fbb-86f1-13a7f62aebbb tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.079679 Nov 09 20:29:47.634956 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 976/1923] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:29:47 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:29:48.650882 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-909b58d8-c332-4512-be53-4cc1efbc2c0a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:29:48.651524 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-909b58d8-c332-4512-be53-4cc1efbc2c0a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:29:48.657747 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-909b58d8-c332-4512-be53-4cc1efbc2c0a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:29:48.658196 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-909b58d8-c332-4512-be53-4cc1efbc2c0a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:29:48.658965 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-909b58d8-c332-4512-be53-4cc1efbc2c0a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:29:48.660130 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-909b58d8-c332-4512-be53-4cc1efbc2c0a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:29:48.719164 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-909b58d8-c332-4512-be53-4cc1efbc2c0a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:29:48.727780 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-909b58d8-c332-4512-be53-4cc1efbc2c0a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.080545 Nov 09 20:29:48.728334 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 948/1924] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:29:48 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:29:49.744162 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-07295056-47dd-4e95-8a34-ed4c2616c40d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:29:49.744794 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-07295056-47dd-4e95-8a34-ed4c2616c40d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:29:49.751399 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-07295056-47dd-4e95-8a34-ed4c2616c40d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:29:49.751840 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-07295056-47dd-4e95-8a34-ed4c2616c40d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:29:49.752643 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-07295056-47dd-4e95-8a34-ed4c2616c40d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:29:49.753114 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-07295056-47dd-4e95-8a34-ed4c2616c40d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:29:49.811384 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-07295056-47dd-4e95-8a34-ed4c2616c40d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:29:49.818872 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-07295056-47dd-4e95-8a34-ed4c2616c40d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.078378 Nov 09 20:29:49.819425 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 977/1925] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:29:49 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 20:29:50.834775 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-77792f8b-0bf5-4cff-9336-330b283b2c0c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:29:50.835377 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-77792f8b-0bf5-4cff-9336-330b283b2c0c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:29:50.841794 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-77792f8b-0bf5-4cff-9336-330b283b2c0c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:29:50.842241 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-77792f8b-0bf5-4cff-9336-330b283b2c0c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:29:50.843014 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-77792f8b-0bf5-4cff-9336-330b283b2c0c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:29:50.843445 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-77792f8b-0bf5-4cff-9336-330b283b2c0c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:29:50.903269 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-77792f8b-0bf5-4cff-9336-330b283b2c0c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:29:50.911134 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-77792f8b-0bf5-4cff-9336-330b283b2c0c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.080018 Nov 09 20:29:50.911684 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 949/1926] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:29:50 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:29:51.927426 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-1640c8f7-7f72-49b2-8fc2-beef343f7f24 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:29:51.928027 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-1640c8f7-7f72-49b2-8fc2-beef343f7f24 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:29:51.934368 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-1640c8f7-7f72-49b2-8fc2-beef343f7f24 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:29:51.934834 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-1640c8f7-7f72-49b2-8fc2-beef343f7f24 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:29:51.935601 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-1640c8f7-7f72-49b2-8fc2-beef343f7f24 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:29:51.936026 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-1640c8f7-7f72-49b2-8fc2-beef343f7f24 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:29:51.994256 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-1640c8f7-7f72-49b2-8fc2-beef343f7f24 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:29:52.001981 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-1640c8f7-7f72-49b2-8fc2-beef343f7f24 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.078247 Nov 09 20:29:52.002533 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 978/1927] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:29:51 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:29:53.019658 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-a7d41e91-9f99-4364-b669-263673cfee02 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:29:53.020252 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-a7d41e91-9f99-4364-b669-263673cfee02 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:29:53.026471 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a7d41e91-9f99-4364-b669-263673cfee02 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:29:53.026910 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a7d41e91-9f99-4364-b669-263673cfee02 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:29:53.027669 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a7d41e91-9f99-4364-b669-263673cfee02 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:29:53.028107 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a7d41e91-9f99-4364-b669-263673cfee02 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:29:53.089578 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-a7d41e91-9f99-4364-b669-263673cfee02 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:29:53.097838 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-a7d41e91-9f99-4364-b669-263673cfee02 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.082505 Nov 09 20:29:53.098386 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 950/1928] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:29:53 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:29:54.114820 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-44ae896b-0872-4d73-b507-76d35c18b209 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:29:54.115416 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-44ae896b-0872-4d73-b507-76d35c18b209 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:29:54.122045 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-44ae896b-0872-4d73-b507-76d35c18b209 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:29:54.122495 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-44ae896b-0872-4d73-b507-76d35c18b209 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:29:54.123305 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-44ae896b-0872-4d73-b507-76d35c18b209 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:29:54.123741 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-44ae896b-0872-4d73-b507-76d35c18b209 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:29:54.182996 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-44ae896b-0872-4d73-b507-76d35c18b209 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:29:54.190735 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-44ae896b-0872-4d73-b507-76d35c18b209 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.080188 Nov 09 20:29:54.191287 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 979/1929] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:29:54 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:29:55.207661 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-2e25a5a5-3860-4190-9f68-893582c9d711 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:29:55.208283 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-2e25a5a5-3860-4190-9f68-893582c9d711 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:29:55.214492 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2e25a5a5-3860-4190-9f68-893582c9d711 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:29:55.214940 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2e25a5a5-3860-4190-9f68-893582c9d711 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:29:55.215714 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2e25a5a5-3860-4190-9f68-893582c9d711 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:29:55.216147 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2e25a5a5-3860-4190-9f68-893582c9d711 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:29:55.274743 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-2e25a5a5-3860-4190-9f68-893582c9d711 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:29:55.282581 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-2e25a5a5-3860-4190-9f68-893582c9d711 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.079210 Nov 09 20:29:55.283139 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 951/1930] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:29:55 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:29:56.299291 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-6af3a172-abbe-4246-917c-989d4885dbeb tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:29:56.300359 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-6af3a172-abbe-4246-917c-989d4885dbeb tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:29:56.306598 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6af3a172-abbe-4246-917c-989d4885dbeb tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:29:56.307042 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6af3a172-abbe-4246-917c-989d4885dbeb tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:29:56.307811 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6af3a172-abbe-4246-917c-989d4885dbeb tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:29:56.308243 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6af3a172-abbe-4246-917c-989d4885dbeb tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:29:56.368575 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-6af3a172-abbe-4246-917c-989d4885dbeb tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:29:56.376520 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-6af3a172-abbe-4246-917c-989d4885dbeb tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.080830 Nov 09 20:29:56.377081 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 980/1931] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:29:56 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 20:29:57.394627 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-177ab90a-fe1a-4be9-b44c-44b9f1519a7c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:29:57.395248 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-177ab90a-fe1a-4be9-b44c-44b9f1519a7c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:29:57.401104 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-177ab90a-fe1a-4be9-b44c-44b9f1519a7c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:29:57.401545 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-177ab90a-fe1a-4be9-b44c-44b9f1519a7c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:29:57.402302 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-177ab90a-fe1a-4be9-b44c-44b9f1519a7c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:29:57.402724 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-177ab90a-fe1a-4be9-b44c-44b9f1519a7c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:29:57.460276 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-177ab90a-fe1a-4be9-b44c-44b9f1519a7c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:29:57.468046 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-177ab90a-fe1a-4be9-b44c-44b9f1519a7c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.077801 Nov 09 20:29:57.468636 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 952/1932] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:29:57 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:29:58.484975 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-c69a07ec-d371-4d71-9d81-51397f456d9d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:29:58.485511 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-c69a07ec-d371-4d71-9d81-51397f456d9d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:29:58.492274 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c69a07ec-d371-4d71-9d81-51397f456d9d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:29:58.492866 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c69a07ec-d371-4d71-9d81-51397f456d9d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:29:58.493633 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c69a07ec-d371-4d71-9d81-51397f456d9d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:29:58.494059 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c69a07ec-d371-4d71-9d81-51397f456d9d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:29:58.551762 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-c69a07ec-d371-4d71-9d81-51397f456d9d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:29:58.559256 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-c69a07ec-d371-4d71-9d81-51397f456d9d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.077990 Nov 09 20:29:58.559807 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 981/1933] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:29:58 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:29:59.576983 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-964408d9-b94a-4b21-a83c-5e7100d1d297 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:29:59.577543 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-964408d9-b94a-4b21-a83c-5e7100d1d297 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:29:59.584392 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-964408d9-b94a-4b21-a83c-5e7100d1d297 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:29:59.584853 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-964408d9-b94a-4b21-a83c-5e7100d1d297 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:29:59.585617 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-964408d9-b94a-4b21-a83c-5e7100d1d297 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:29:59.586046 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-964408d9-b94a-4b21-a83c-5e7100d1d297 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:29:59.649240 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-964408d9-b94a-4b21-a83c-5e7100d1d297 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:29:59.656949 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-964408d9-b94a-4b21-a83c-5e7100d1d297 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.083721 Nov 09 20:29:59.657504 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 953/1934] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:29:59 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:30:00.673988 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-296fb9f7-fd0e-4c54-86a9-19bd949ed3d6 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:30:00.674640 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-296fb9f7-fd0e-4c54-86a9-19bd949ed3d6 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:30:00.681787 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-296fb9f7-fd0e-4c54-86a9-19bd949ed3d6 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:30:00.682242 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-296fb9f7-fd0e-4c54-86a9-19bd949ed3d6 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:30:00.683021 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-296fb9f7-fd0e-4c54-86a9-19bd949ed3d6 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:30:00.683455 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-296fb9f7-fd0e-4c54-86a9-19bd949ed3d6 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:30:00.742244 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-296fb9f7-fd0e-4c54-86a9-19bd949ed3d6 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:30:00.750322 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-296fb9f7-fd0e-4c54-86a9-19bd949ed3d6 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.080008 Nov 09 20:30:00.750887 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 982/1935] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:30:00 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:30:01.767093 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-8d48e471-e2f3-4917-b2eb-63a1cfe59ec8 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:30:01.767686 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-8d48e471-e2f3-4917-b2eb-63a1cfe59ec8 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:30:01.773959 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8d48e471-e2f3-4917-b2eb-63a1cfe59ec8 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:30:01.774407 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8d48e471-e2f3-4917-b2eb-63a1cfe59ec8 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:30:01.775178 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8d48e471-e2f3-4917-b2eb-63a1cfe59ec8 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:30:01.775612 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8d48e471-e2f3-4917-b2eb-63a1cfe59ec8 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:30:01.833775 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-8d48e471-e2f3-4917-b2eb-63a1cfe59ec8 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:30:01.841222 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-8d48e471-e2f3-4917-b2eb-63a1cfe59ec8 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.077844 Nov 09 20:30:01.841774 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 954/1936] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:30:01 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:30:02.858542 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-d6c55b7f-86c6-48e0-bcd0-80f98382afbb tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:30:02.859124 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-d6c55b7f-86c6-48e0-bcd0-80f98382afbb tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:30:02.866513 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d6c55b7f-86c6-48e0-bcd0-80f98382afbb tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:30:02.866957 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d6c55b7f-86c6-48e0-bcd0-80f98382afbb tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:30:02.867726 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d6c55b7f-86c6-48e0-bcd0-80f98382afbb tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:30:02.868224 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d6c55b7f-86c6-48e0-bcd0-80f98382afbb tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:30:02.928080 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-d6c55b7f-86c6-48e0-bcd0-80f98382afbb tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:30:02.935698 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-d6c55b7f-86c6-48e0-bcd0-80f98382afbb tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.080853 Nov 09 20:30:02.936253 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 983/1937] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:30:02 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:30:03.952248 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-714c3a52-d038-4ed0-b374-12888b41f747 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:30:03.952886 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-714c3a52-d038-4ed0-b374-12888b41f747 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:30:03.959257 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-714c3a52-d038-4ed0-b374-12888b41f747 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:30:03.959710 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-714c3a52-d038-4ed0-b374-12888b41f747 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:30:03.960524 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-714c3a52-d038-4ed0-b374-12888b41f747 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:30:03.960967 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-714c3a52-d038-4ed0-b374-12888b41f747 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:30:04.020594 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-714c3a52-d038-4ed0-b374-12888b41f747 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:30:04.028196 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-714c3a52-d038-4ed0-b374-12888b41f747 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.079666 Nov 09 20:30:04.028795 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 955/1938] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:30:03 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:30:05.045280 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-e1186bfd-3c3f-45e5-b061-4c2c633f9716 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:30:05.045963 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-e1186bfd-3c3f-45e5-b061-4c2c633f9716 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:30:05.053042 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e1186bfd-3c3f-45e5-b061-4c2c633f9716 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:30:05.053486 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e1186bfd-3c3f-45e5-b061-4c2c633f9716 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:30:05.054254 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e1186bfd-3c3f-45e5-b061-4c2c633f9716 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:30:05.054719 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e1186bfd-3c3f-45e5-b061-4c2c633f9716 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:30:05.112338 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-e1186bfd-3c3f-45e5-b061-4c2c633f9716 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:30:05.120999 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-e1186bfd-3c3f-45e5-b061-4c2c633f9716 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.079522 Nov 09 20:30:05.121555 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 984/1939] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:30:05 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:30:06.138410 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-7c44727a-789d-4931-9730-c18020102533 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:30:06.139006 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-7c44727a-789d-4931-9730-c18020102533 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:30:06.145961 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7c44727a-789d-4931-9730-c18020102533 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:30:06.146410 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7c44727a-789d-4931-9730-c18020102533 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:30:06.147189 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7c44727a-789d-4931-9730-c18020102533 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:30:06.147617 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7c44727a-789d-4931-9730-c18020102533 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:30:06.210400 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-7c44727a-789d-4931-9730-c18020102533 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:30:06.218022 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-7c44727a-789d-4931-9730-c18020102533 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.083287 Nov 09 20:30:06.218575 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 956/1940] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:30:06 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:30:07.234049 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-6c165975-70fc-4744-8059-9df5fdbbb0fa tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:30:07.234631 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-6c165975-70fc-4744-8059-9df5fdbbb0fa tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:30:07.243655 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6c165975-70fc-4744-8059-9df5fdbbb0fa tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:30:07.244102 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6c165975-70fc-4744-8059-9df5fdbbb0fa tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:30:07.244914 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6c165975-70fc-4744-8059-9df5fdbbb0fa tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:30:07.245601 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6c165975-70fc-4744-8059-9df5fdbbb0fa tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:30:07.547559 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-6c165975-70fc-4744-8059-9df5fdbbb0fa tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:30:07.556240 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-6c165975-70fc-4744-8059-9df5fdbbb0fa tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.325815 Nov 09 20:30:07.556835 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 985/1941] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:30:07 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:30:08.573084 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-a652b722-dda7-4785-8a7d-05a70972e85b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:30:08.573611 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-a652b722-dda7-4785-8a7d-05a70972e85b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:30:08.579839 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a652b722-dda7-4785-8a7d-05a70972e85b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:30:08.580281 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a652b722-dda7-4785-8a7d-05a70972e85b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:30:08.581083 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a652b722-dda7-4785-8a7d-05a70972e85b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:30:08.581510 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a652b722-dda7-4785-8a7d-05a70972e85b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:30:08.640101 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-a652b722-dda7-4785-8a7d-05a70972e85b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:30:08.647713 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-a652b722-dda7-4785-8a7d-05a70972e85b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.078375 Nov 09 20:30:08.648296 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 957/1942] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:30:08 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 20:30:09.663331 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-099214c2-517f-4d7d-9fdf-538122473529 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:30:09.663961 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-099214c2-517f-4d7d-9fdf-538122473529 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:30:09.670179 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-099214c2-517f-4d7d-9fdf-538122473529 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:30:09.670617 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-099214c2-517f-4d7d-9fdf-538122473529 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:30:09.671382 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-099214c2-517f-4d7d-9fdf-538122473529 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:30:09.671805 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-099214c2-517f-4d7d-9fdf-538122473529 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:30:09.730006 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-099214c2-517f-4d7d-9fdf-538122473529 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:30:09.738223 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-099214c2-517f-4d7d-9fdf-538122473529 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.078070 Nov 09 20:30:09.738999 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 986/1943] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:30:09 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:30:10.754817 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-5cc82bb6-501e-45bd-b863-47ccecc90269 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:30:10.755426 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-5cc82bb6-501e-45bd-b863-47ccecc90269 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:30:10.761671 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5cc82bb6-501e-45bd-b863-47ccecc90269 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:30:10.762110 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5cc82bb6-501e-45bd-b863-47ccecc90269 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:30:10.762874 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5cc82bb6-501e-45bd-b863-47ccecc90269 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:30:10.763300 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5cc82bb6-501e-45bd-b863-47ccecc90269 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:30:10.820889 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-5cc82bb6-501e-45bd-b863-47ccecc90269 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:30:10.828351 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-5cc82bb6-501e-45bd-b863-47ccecc90269 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.077228 Nov 09 20:30:10.828934 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 958/1944] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:30:10 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:30:11.844932 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-bc4d6915-8636-4dc2-9477-b61abe9b2aaf tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:30:11.845513 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-bc4d6915-8636-4dc2-9477-b61abe9b2aaf tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:30:11.852373 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-bc4d6915-8636-4dc2-9477-b61abe9b2aaf tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:30:11.852850 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-bc4d6915-8636-4dc2-9477-b61abe9b2aaf tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:30:11.853611 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-bc4d6915-8636-4dc2-9477-b61abe9b2aaf tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:30:11.854036 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-bc4d6915-8636-4dc2-9477-b61abe9b2aaf tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:30:11.916531 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-bc4d6915-8636-4dc2-9477-b61abe9b2aaf tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:30:11.924038 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-bc4d6915-8636-4dc2-9477-b61abe9b2aaf tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.082767 Nov 09 20:30:11.924628 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 987/1945] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:30:11 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:30:12.941292 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-1bc4001f-3a37-4d6b-a07c-50139b273163 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:30:12.941886 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-1bc4001f-3a37-4d6b-a07c-50139b273163 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:30:12.947865 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1bc4001f-3a37-4d6b-a07c-50139b273163 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:30:12.948306 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1bc4001f-3a37-4d6b-a07c-50139b273163 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:30:12.949156 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1bc4001f-3a37-4d6b-a07c-50139b273163 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:30:12.949588 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1bc4001f-3a37-4d6b-a07c-50139b273163 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:30:13.011665 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-1bc4001f-3a37-4d6b-a07c-50139b273163 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:30:13.019816 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-1bc4001f-3a37-4d6b-a07c-50139b273163 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.082696 Nov 09 20:30:13.020388 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 959/1946] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:30:12 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:30:14.036287 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-eb002546-769e-4842-87e4-de13ba1f7cff tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:30:14.036940 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-eb002546-769e-4842-87e4-de13ba1f7cff tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:30:14.043135 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-eb002546-769e-4842-87e4-de13ba1f7cff tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:30:14.043574 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-eb002546-769e-4842-87e4-de13ba1f7cff tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:30:14.044330 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-eb002546-769e-4842-87e4-de13ba1f7cff tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:30:14.044784 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-eb002546-769e-4842-87e4-de13ba1f7cff tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:30:14.103173 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-eb002546-769e-4842-87e4-de13ba1f7cff tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:30:14.110712 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-eb002546-769e-4842-87e4-de13ba1f7cff tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.078179 Nov 09 20:30:14.111261 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 988/1947] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:30:14 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:30:15.129284 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-eef6a444-1da4-4292-b9d9-8c56857bb901 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:30:15.129929 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-eef6a444-1da4-4292-b9d9-8c56857bb901 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:30:15.136421 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-eef6a444-1da4-4292-b9d9-8c56857bb901 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:30:15.136879 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-eef6a444-1da4-4292-b9d9-8c56857bb901 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:30:15.137650 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-eef6a444-1da4-4292-b9d9-8c56857bb901 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:30:15.138095 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-eef6a444-1da4-4292-b9d9-8c56857bb901 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:30:15.199273 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-eef6a444-1da4-4292-b9d9-8c56857bb901 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:30:15.208323 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-eef6a444-1da4-4292-b9d9-8c56857bb901 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.083345 Nov 09 20:30:15.208959 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 960/1948] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:30:15 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:30:16.225458 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-52f0435b-57fe-48c2-bb98-a590c918e379 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:30:16.226059 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-52f0435b-57fe-48c2-bb98-a590c918e379 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:30:16.232617 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-52f0435b-57fe-48c2-bb98-a590c918e379 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:30:16.233109 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-52f0435b-57fe-48c2-bb98-a590c918e379 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:30:16.233818 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-52f0435b-57fe-48c2-bb98-a590c918e379 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:30:16.234245 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-52f0435b-57fe-48c2-bb98-a590c918e379 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:30:16.292431 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-52f0435b-57fe-48c2-bb98-a590c918e379 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:30:16.300554 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-52f0435b-57fe-48c2-bb98-a590c918e379 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.078559 Nov 09 20:30:16.301225 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 989/1949] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:30:16 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:30:17.317196 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-6eed30c6-0a72-430a-9c15-5b07beaaf720 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:30:17.317801 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-6eed30c6-0a72-430a-9c15-5b07beaaf720 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:30:17.323965 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6eed30c6-0a72-430a-9c15-5b07beaaf720 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:30:17.324428 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6eed30c6-0a72-430a-9c15-5b07beaaf720 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:30:17.325216 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6eed30c6-0a72-430a-9c15-5b07beaaf720 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:30:17.325643 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6eed30c6-0a72-430a-9c15-5b07beaaf720 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:30:17.386838 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-6eed30c6-0a72-430a-9c15-5b07beaaf720 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:30:17.395011 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-6eed30c6-0a72-430a-9c15-5b07beaaf720 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.081717 Nov 09 20:30:17.395559 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 961/1950] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:30:17 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:30:18.411469 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-92a2a9be-e5f2-45b8-aca8-d7cdb7ded263 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:30:18.412103 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-92a2a9be-e5f2-45b8-aca8-d7cdb7ded263 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:30:18.418439 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-92a2a9be-e5f2-45b8-aca8-d7cdb7ded263 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:30:18.418891 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-92a2a9be-e5f2-45b8-aca8-d7cdb7ded263 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:30:18.419668 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-92a2a9be-e5f2-45b8-aca8-d7cdb7ded263 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:30:18.420118 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-92a2a9be-e5f2-45b8-aca8-d7cdb7ded263 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:30:18.482695 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-92a2a9be-e5f2-45b8-aca8-d7cdb7ded263 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:30:18.490643 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-92a2a9be-e5f2-45b8-aca8-d7cdb7ded263 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.083427 Nov 09 20:30:18.491212 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 990/1951] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:30:18 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:30:19.506995 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-225e42f3-fcbf-4e2d-98aa-942d7071d109 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:30:19.507586 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-225e42f3-fcbf-4e2d-98aa-942d7071d109 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:30:19.513784 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-225e42f3-fcbf-4e2d-98aa-942d7071d109 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:30:19.514223 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-225e42f3-fcbf-4e2d-98aa-942d7071d109 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:30:19.514982 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-225e42f3-fcbf-4e2d-98aa-942d7071d109 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:30:19.515404 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-225e42f3-fcbf-4e2d-98aa-942d7071d109 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:30:19.574624 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-225e42f3-fcbf-4e2d-98aa-942d7071d109 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:30:19.582933 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-225e42f3-fcbf-4e2d-98aa-942d7071d109 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.079783 Nov 09 20:30:19.583491 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 962/1952] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:30:19 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:30:20.599379 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-846acc03-2edc-43ae-9ab4-e49e3972c667 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:30:20.599981 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-846acc03-2edc-43ae-9ab4-e49e3972c667 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:30:20.606168 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-846acc03-2edc-43ae-9ab4-e49e3972c667 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:30:20.606671 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-846acc03-2edc-43ae-9ab4-e49e3972c667 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:30:20.607439 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-846acc03-2edc-43ae-9ab4-e49e3972c667 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:30:20.607863 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-846acc03-2edc-43ae-9ab4-e49e3972c667 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:30:20.669810 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-846acc03-2edc-43ae-9ab4-e49e3972c667 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:30:20.678483 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-846acc03-2edc-43ae-9ab4-e49e3972c667 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.083306 Nov 09 20:30:20.679040 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 991/1953] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:30:20 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:30:21.696313 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-36c4078f-557c-4b8b-91b5-bc3935ae8afa tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:30:21.696970 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-36c4078f-557c-4b8b-91b5-bc3935ae8afa tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:30:21.703110 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-36c4078f-557c-4b8b-91b5-bc3935ae8afa tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:30:21.703549 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-36c4078f-557c-4b8b-91b5-bc3935ae8afa tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:30:21.704307 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-36c4078f-557c-4b8b-91b5-bc3935ae8afa tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:30:21.704777 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-36c4078f-557c-4b8b-91b5-bc3935ae8afa tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:30:21.763204 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-36c4078f-557c-4b8b-91b5-bc3935ae8afa tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:30:21.771480 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-36c4078f-557c-4b8b-91b5-bc3935ae8afa tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.078859 Nov 09 20:30:21.772040 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 963/1954] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:30:21 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:30:22.787957 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-6263a327-fb14-4e6a-a14a-90bf4b1f2a7c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:30:22.788623 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-6263a327-fb14-4e6a-a14a-90bf4b1f2a7c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:30:22.794862 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6263a327-fb14-4e6a-a14a-90bf4b1f2a7c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:30:22.795310 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6263a327-fb14-4e6a-a14a-90bf4b1f2a7c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:30:22.796088 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6263a327-fb14-4e6a-a14a-90bf4b1f2a7c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:30:22.796569 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6263a327-fb14-4e6a-a14a-90bf4b1f2a7c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:30:22.856136 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-6263a327-fb14-4e6a-a14a-90bf4b1f2a7c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:30:22.864544 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-6263a327-fb14-4e6a-a14a-90bf4b1f2a7c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.080222 Nov 09 20:30:22.865107 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 992/1955] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:30:22 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:30:23.881824 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-c1ea066d-f2dc-4c51-a3f1-0c9eaf15c8ff tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:30:23.882445 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-c1ea066d-f2dc-4c51-a3f1-0c9eaf15c8ff tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:30:23.888629 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c1ea066d-f2dc-4c51-a3f1-0c9eaf15c8ff tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:30:23.889071 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c1ea066d-f2dc-4c51-a3f1-0c9eaf15c8ff tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:30:23.889832 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c1ea066d-f2dc-4c51-a3f1-0c9eaf15c8ff tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:30:23.890256 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c1ea066d-f2dc-4c51-a3f1-0c9eaf15c8ff tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:30:23.948238 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-c1ea066d-f2dc-4c51-a3f1-0c9eaf15c8ff tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:30:23.955811 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-c1ea066d-f2dc-4c51-a3f1-0c9eaf15c8ff tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.077677 Nov 09 20:30:23.956920 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 964/1956] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:30:23 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:30:24.973294 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-c92aae55-2174-4653-8a01-2cd558fdcab1 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:30:24.973891 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-c92aae55-2174-4653-8a01-2cd558fdcab1 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:30:24.980174 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c92aae55-2174-4653-8a01-2cd558fdcab1 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:30:24.980638 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c92aae55-2174-4653-8a01-2cd558fdcab1 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:30:24.981407 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c92aae55-2174-4653-8a01-2cd558fdcab1 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:30:24.981834 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c92aae55-2174-4653-8a01-2cd558fdcab1 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:30:25.044128 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-c92aae55-2174-4653-8a01-2cd558fdcab1 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:30:25.052850 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-c92aae55-2174-4653-8a01-2cd558fdcab1 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.083791 Nov 09 20:30:25.053415 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 993/1957] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:30:24 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:30:26.070699 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-2f4c184e-1f68-4bad-84ee-9d6a0beaf042 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:30:26.071310 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-2f4c184e-1f68-4bad-84ee-9d6a0beaf042 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:30:26.077647 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2f4c184e-1f68-4bad-84ee-9d6a0beaf042 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:30:26.078095 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2f4c184e-1f68-4bad-84ee-9d6a0beaf042 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:30:26.078867 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2f4c184e-1f68-4bad-84ee-9d6a0beaf042 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:30:26.079300 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2f4c184e-1f68-4bad-84ee-9d6a0beaf042 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:30:26.142771 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-2f4c184e-1f68-4bad-84ee-9d6a0beaf042 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:30:26.151033 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-2f4c184e-1f68-4bad-84ee-9d6a0beaf042 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.085432 Nov 09 20:30:26.151605 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 965/1958] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:30:26 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:30:27.168355 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-277c6c73-37b5-416b-8181-2e5701b7cf4c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:30:27.169098 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-277c6c73-37b5-416b-8181-2e5701b7cf4c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:30:27.175434 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-277c6c73-37b5-416b-8181-2e5701b7cf4c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:30:27.175863 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-277c6c73-37b5-416b-8181-2e5701b7cf4c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:30:27.176672 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-277c6c73-37b5-416b-8181-2e5701b7cf4c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:30:27.177112 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-277c6c73-37b5-416b-8181-2e5701b7cf4c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:30:27.237195 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-277c6c73-37b5-416b-8181-2e5701b7cf4c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:30:27.244883 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-277c6c73-37b5-416b-8181-2e5701b7cf4c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.080178 Nov 09 20:30:27.245691 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 994/1959] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:30:27 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:30:28.261344 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-c9a3c43f-c224-42b0-b40d-ace6e2fd0287 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:30:28.261947 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-c9a3c43f-c224-42b0-b40d-ace6e2fd0287 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:30:28.268393 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c9a3c43f-c224-42b0-b40d-ace6e2fd0287 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:30:28.269422 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c9a3c43f-c224-42b0-b40d-ace6e2fd0287 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:30:28.270257 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c9a3c43f-c224-42b0-b40d-ace6e2fd0287 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:30:28.270685 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c9a3c43f-c224-42b0-b40d-ace6e2fd0287 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:30:28.329810 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-c9a3c43f-c224-42b0-b40d-ace6e2fd0287 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:30:28.338108 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-c9a3c43f-c224-42b0-b40d-ace6e2fd0287 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.080596 Nov 09 20:30:28.338673 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 966/1960] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:30:28 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:30:29.354855 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-a06d529e-793e-4a69-b501-d9180474cb11 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:30:29.355476 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-a06d529e-793e-4a69-b501-d9180474cb11 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:30:29.361674 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a06d529e-793e-4a69-b501-d9180474cb11 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:30:29.362118 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a06d529e-793e-4a69-b501-d9180474cb11 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:30:29.363671 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a06d529e-793e-4a69-b501-d9180474cb11 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:30:29.364102 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a06d529e-793e-4a69-b501-d9180474cb11 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:30:29.421745 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-a06d529e-793e-4a69-b501-d9180474cb11 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:30:29.429987 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-a06d529e-793e-4a69-b501-d9180474cb11 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.078802 Nov 09 20:30:29.430541 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 995/1961] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:30:29 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:30:30.447115 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-c1c5ba3a-3d8b-41ae-b298-52c446bc5abf tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:30:30.447714 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-c1c5ba3a-3d8b-41ae-b298-52c446bc5abf tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:30:30.453874 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c1c5ba3a-3d8b-41ae-b298-52c446bc5abf tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:30:30.454314 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c1c5ba3a-3d8b-41ae-b298-52c446bc5abf tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:30:30.455077 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c1c5ba3a-3d8b-41ae-b298-52c446bc5abf tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:30:30.455501 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c1c5ba3a-3d8b-41ae-b298-52c446bc5abf tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:30:30.514609 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-c1c5ba3a-3d8b-41ae-b298-52c446bc5abf tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:30:30.522413 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-c1c5ba3a-3d8b-41ae-b298-52c446bc5abf tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.079030 Nov 09 20:30:30.522980 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 967/1962] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:30:30 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:30:31.539069 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-db7b270f-c130-43f4-8c0e-94c33d423607 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:30:31.539601 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-db7b270f-c130-43f4-8c0e-94c33d423607 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:30:31.545840 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-db7b270f-c130-43f4-8c0e-94c33d423607 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:30:31.546279 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-db7b270f-c130-43f4-8c0e-94c33d423607 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:30:31.547042 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-db7b270f-c130-43f4-8c0e-94c33d423607 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:30:31.547468 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-db7b270f-c130-43f4-8c0e-94c33d423607 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:30:31.610654 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-db7b270f-c130-43f4-8c0e-94c33d423607 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:30:31.619503 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-db7b270f-c130-43f4-8c0e-94c33d423607 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.084244 Nov 09 20:30:31.620066 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 996/1963] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:30:31 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:30:32.636392 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-069d29a4-f9fe-42e9-b3f4-adde0b4962b3 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:30:32.637019 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-069d29a4-f9fe-42e9-b3f4-adde0b4962b3 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:30:32.643193 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-069d29a4-f9fe-42e9-b3f4-adde0b4962b3 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:30:32.644311 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-069d29a4-f9fe-42e9-b3f4-adde0b4962b3 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:30:32.645102 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-069d29a4-f9fe-42e9-b3f4-adde0b4962b3 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:30:32.645531 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-069d29a4-f9fe-42e9-b3f4-adde0b4962b3 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:30:32.705593 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-069d29a4-f9fe-42e9-b3f4-adde0b4962b3 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:30:32.714183 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-069d29a4-f9fe-42e9-b3f4-adde0b4962b3 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.081458 Nov 09 20:30:32.714768 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 968/1964] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:30:32 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:30:33.730915 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-0b2cdb73-a149-4251-bd36-3448d58a3d69 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:30:33.731524 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-0b2cdb73-a149-4251-bd36-3448d58a3d69 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:30:33.739405 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-0b2cdb73-a149-4251-bd36-3448d58a3d69 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:30:33.739934 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-0b2cdb73-a149-4251-bd36-3448d58a3d69 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:30:33.740760 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-0b2cdb73-a149-4251-bd36-3448d58a3d69 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:30:33.741194 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-0b2cdb73-a149-4251-bd36-3448d58a3d69 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:30:33.802835 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-0b2cdb73-a149-4251-bd36-3448d58a3d69 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:30:33.811402 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-0b2cdb73-a149-4251-bd36-3448d58a3d69 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.084080 Nov 09 20:30:33.811958 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 997/1965] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:30:33 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:30:34.828637 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-ed2ddc66-4bf1-4777-8628-c265fc65a304 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:30:34.829237 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-ed2ddc66-4bf1-4777-8628-c265fc65a304 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:30:34.835941 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ed2ddc66-4bf1-4777-8628-c265fc65a304 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:30:34.836416 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ed2ddc66-4bf1-4777-8628-c265fc65a304 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:30:34.837267 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ed2ddc66-4bf1-4777-8628-c265fc65a304 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:30:34.837702 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ed2ddc66-4bf1-4777-8628-c265fc65a304 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:30:34.901179 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-ed2ddc66-4bf1-4777-8628-c265fc65a304 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:30:34.909956 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-ed2ddc66-4bf1-4777-8628-c265fc65a304 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.084439 Nov 09 20:30:34.910527 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 969/1966] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:30:34 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:30:35.928217 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-e8f37843-8d30-4de9-8e61-c80f7a8ba737 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:30:35.928930 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-e8f37843-8d30-4de9-8e61-c80f7a8ba737 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:30:35.935390 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e8f37843-8d30-4de9-8e61-c80f7a8ba737 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:30:35.935876 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e8f37843-8d30-4de9-8e61-c80f7a8ba737 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:30:35.936754 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e8f37843-8d30-4de9-8e61-c80f7a8ba737 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:30:35.937192 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e8f37843-8d30-4de9-8e61-c80f7a8ba737 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:30:35.998653 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-e8f37843-8d30-4de9-8e61-c80f7a8ba737 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:30:36.007504 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-e8f37843-8d30-4de9-8e61-c80f7a8ba737 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.084626 Nov 09 20:30:36.008081 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 998/1967] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:30:35 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:30:37.025055 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-87741c33-a8c1-423f-bc89-20cda47f6e1e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:30:37.025809 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-87741c33-a8c1-423f-bc89-20cda47f6e1e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:30:37.032110 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-87741c33-a8c1-423f-bc89-20cda47f6e1e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:30:37.032612 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-87741c33-a8c1-423f-bc89-20cda47f6e1e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:30:37.033382 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-87741c33-a8c1-423f-bc89-20cda47f6e1e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:30:37.033810 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-87741c33-a8c1-423f-bc89-20cda47f6e1e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:30:37.094496 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-87741c33-a8c1-423f-bc89-20cda47f6e1e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:30:37.102641 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-87741c33-a8c1-423f-bc89-20cda47f6e1e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.081273 Nov 09 20:30:37.103200 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 970/1968] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:30:37 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:30:38.120512 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-cc60cc80-4fa9-4db4-885a-557bd63f59e6 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:30:38.121369 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-cc60cc80-4fa9-4db4-885a-557bd63f59e6 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:30:38.127590 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-cc60cc80-4fa9-4db4-885a-557bd63f59e6 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:30:38.128646 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-cc60cc80-4fa9-4db4-885a-557bd63f59e6 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:30:38.129427 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-cc60cc80-4fa9-4db4-885a-557bd63f59e6 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:30:38.129853 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-cc60cc80-4fa9-4db4-885a-557bd63f59e6 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:30:38.194996 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-cc60cc80-4fa9-4db4-885a-557bd63f59e6 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:30:38.203283 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-cc60cc80-4fa9-4db4-885a-557bd63f59e6 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.087026 Nov 09 20:30:38.203856 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 999/1969] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:30:38 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:30:39.220250 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-2da114cd-9ffa-4ded-b00c-0b78976afe0d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:30:39.220973 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-2da114cd-9ffa-4ded-b00c-0b78976afe0d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:30:39.227165 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2da114cd-9ffa-4ded-b00c-0b78976afe0d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:30:39.227607 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2da114cd-9ffa-4ded-b00c-0b78976afe0d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:30:39.228380 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2da114cd-9ffa-4ded-b00c-0b78976afe0d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:30:39.228874 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2da114cd-9ffa-4ded-b00c-0b78976afe0d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:30:39.290135 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-2da114cd-9ffa-4ded-b00c-0b78976afe0d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:30:39.298158 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-2da114cd-9ffa-4ded-b00c-0b78976afe0d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.081611 Nov 09 20:30:39.298727 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 971/1970] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:30:39 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:30:40.314125 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-b8c4f6df-f634-4925-ac99-5b2a37f36655 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:30:40.314731 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-b8c4f6df-f634-4925-ac99-5b2a37f36655 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:30:40.321060 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b8c4f6df-f634-4925-ac99-5b2a37f36655 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:30:40.321518 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b8c4f6df-f634-4925-ac99-5b2a37f36655 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:30:40.322298 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b8c4f6df-f634-4925-ac99-5b2a37f36655 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:30:40.322737 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b8c4f6df-f634-4925-ac99-5b2a37f36655 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:30:40.388816 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-b8c4f6df-f634-4925-ac99-5b2a37f36655 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:30:40.395229 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-b8c4f6df-f634-4925-ac99-5b2a37f36655 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.084696 Nov 09 20:30:40.395798 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1000/1971] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:30:40 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:30:41.410837 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-4989b22b-14f1-451e-a967-02a0c0f3db31 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:30:41.411429 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-4989b22b-14f1-451e-a967-02a0c0f3db31 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:30:41.417568 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4989b22b-14f1-451e-a967-02a0c0f3db31 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:30:41.418004 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4989b22b-14f1-451e-a967-02a0c0f3db31 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:30:41.418759 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4989b22b-14f1-451e-a967-02a0c0f3db31 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:30:41.419184 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4989b22b-14f1-451e-a967-02a0c0f3db31 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:30:41.477829 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-4989b22b-14f1-451e-a967-02a0c0f3db31 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:30:41.485380 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-4989b22b-14f1-451e-a967-02a0c0f3db31 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.078263 Nov 09 20:30:41.485941 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 972/1972] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:30:41 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:30:42.502674 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-f681391b-a097-4dfd-98c5-7f1f66478b50 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:30:42.503463 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-f681391b-a097-4dfd-98c5-7f1f66478b50 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:30:42.509700 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f681391b-a097-4dfd-98c5-7f1f66478b50 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:30:42.510149 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f681391b-a097-4dfd-98c5-7f1f66478b50 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:30:42.510927 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f681391b-a097-4dfd-98c5-7f1f66478b50 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:30:42.511363 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f681391b-a097-4dfd-98c5-7f1f66478b50 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:30:42.569850 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-f681391b-a097-4dfd-98c5-7f1f66478b50 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:30:42.577399 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-f681391b-a097-4dfd-98c5-7f1f66478b50 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.078424 Nov 09 20:30:42.577999 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1001/1973] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:30:42 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:30:43.594628 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-0df5f494-1769-4cff-a965-00e82c750ac1 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:30:43.595238 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-0df5f494-1769-4cff-a965-00e82c750ac1 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:30:43.602426 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0df5f494-1769-4cff-a965-00e82c750ac1 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:30:43.602907 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0df5f494-1769-4cff-a965-00e82c750ac1 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:30:43.603688 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0df5f494-1769-4cff-a965-00e82c750ac1 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:30:43.604126 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0df5f494-1769-4cff-a965-00e82c750ac1 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:30:43.666488 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-0df5f494-1769-4cff-a965-00e82c750ac1 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:30:43.674510 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-0df5f494-1769-4cff-a965-00e82c750ac1 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.083480 Nov 09 20:30:43.675092 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 973/1974] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:30:43 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:30:44.690825 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-178c52cb-ba1a-42d0-835e-09463261e427 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:30:44.691440 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-178c52cb-ba1a-42d0-835e-09463261e427 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:30:44.697659 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-178c52cb-ba1a-42d0-835e-09463261e427 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:30:44.698120 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-178c52cb-ba1a-42d0-835e-09463261e427 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:30:44.698888 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-178c52cb-ba1a-42d0-835e-09463261e427 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:30:44.699375 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-178c52cb-ba1a-42d0-835e-09463261e427 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:30:44.762281 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-178c52cb-ba1a-42d0-835e-09463261e427 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:30:44.770586 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-178c52cb-ba1a-42d0-835e-09463261e427 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.083352 Nov 09 20:30:44.771303 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1002/1975] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:30:44 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:30:44.816060 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-1b1b60ce-a0fb-4c1f-a351-2a8f2c4edb8b tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:30:44.816561 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-1b1b60ce-a0fb-4c1f-a351-2a8f2c4edb8b tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: 90c53d4c-080d-4d25-a3eb-50c92e83f38c] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:30:44.823358 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1b1b60ce-a0fb-4c1f-a351-2a8f2c4edb8b tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:30:44.823358 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1b1b60ce-a0fb-4c1f-a351-2a8f2c4edb8b tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:30:44.823922 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1b1b60ce-a0fb-4c1f-a351-2a8f2c4edb8b tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:30:44.824360 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1b1b60ce-a0fb-4c1f-a351-2a8f2c4edb8b tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:30:44.838862 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.wsgi [None req-1b1b60ce-a0fb-4c1f-a351-2a8f2c4edb8b tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] HTTP exception thrown: Instance 90c53d4c-080d-4d25-a3eb-50c92e83f38c could not be found. Nov 09 20:30:44.839453 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-1b1b60ce-a0fb-4c1f-a351-2a8f2c4edb8b tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Returning 404 to user: Instance 90c53d4c-080d-4d25-a3eb-50c92e83f38c could not be found. {{(pid=116103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 09 20:30:44.840281 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-1b1b60ce-a0fb-4c1f-a351-2a8f2c4edb8b tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "DELETE /compute/v2.1/servers/90c53d4c-080d-4d25-a3eb-50c92e83f38c" status: 404 len: 111 microversion: 2.1 time: 0.028205 Nov 09 20:30:44.841015 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 974/1976] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Nov 9 20:30:44 2021] DELETE /compute/v2.1/servers/90c53d4c-080d-4d25-a3eb-50c92e83f38c => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 09 20:30:44.849358 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-c30d26fa-454b-4eb6-87a5-fa628875dfeb tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:30:44.849997 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-c30d26fa-454b-4eb6-87a5-fa628875dfeb tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: 90c53d4c-080d-4d25-a3eb-50c92e83f38c] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:30:44.855670 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c30d26fa-454b-4eb6-87a5-fa628875dfeb tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:30:44.856115 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c30d26fa-454b-4eb6-87a5-fa628875dfeb tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:30:44.856920 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c30d26fa-454b-4eb6-87a5-fa628875dfeb tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:30:44.857411 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c30d26fa-454b-4eb6-87a5-fa628875dfeb tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:30:44.870246 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.wsgi [None req-c30d26fa-454b-4eb6-87a5-fa628875dfeb tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] HTTP exception thrown: Instance 90c53d4c-080d-4d25-a3eb-50c92e83f38c could not be found. Nov 09 20:30:44.871147 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-c30d26fa-454b-4eb6-87a5-fa628875dfeb tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Returning 404 to user: Instance 90c53d4c-080d-4d25-a3eb-50c92e83f38c could not be found. {{(pid=116102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 09 20:30:44.872006 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-c30d26fa-454b-4eb6-87a5-fa628875dfeb tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/90c53d4c-080d-4d25-a3eb-50c92e83f38c" status: 404 len: 111 microversion: 2.1 time: 0.027074 Nov 09 20:30:44.872562 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1003/1977] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:30:44 2021] GET /compute/v2.1/servers/90c53d4c-080d-4d25-a3eb-50c92e83f38c => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 09 20:30:45.787776 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-2c89ce1d-f2c5-4c03-9b2a-a00de791bb54 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:30:45.788382 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-2c89ce1d-f2c5-4c03-9b2a-a00de791bb54 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:30:45.794362 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2c89ce1d-f2c5-4c03-9b2a-a00de791bb54 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:30:45.794811 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2c89ce1d-f2c5-4c03-9b2a-a00de791bb54 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:30:45.795573 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2c89ce1d-f2c5-4c03-9b2a-a00de791bb54 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:30:45.796051 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2c89ce1d-f2c5-4c03-9b2a-a00de791bb54 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:30:45.856939 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-2c89ce1d-f2c5-4c03-9b2a-a00de791bb54 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:30:45.864834 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-2c89ce1d-f2c5-4c03-9b2a-a00de791bb54 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.081412 Nov 09 20:30:45.865392 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 975/1978] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:30:45 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:30:46.882185 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-5e5f5438-dc30-47e2-9f3c-0883f20593c6 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:30:46.882786 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-5e5f5438-dc30-47e2-9f3c-0883f20593c6 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:30:46.888718 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-5e5f5438-dc30-47e2-9f3c-0883f20593c6 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:30:46.889170 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-5e5f5438-dc30-47e2-9f3c-0883f20593c6 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:30:46.889938 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-5e5f5438-dc30-47e2-9f3c-0883f20593c6 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:30:46.890369 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-5e5f5438-dc30-47e2-9f3c-0883f20593c6 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:30:46.948447 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-5e5f5438-dc30-47e2-9f3c-0883f20593c6 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:30:46.956854 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-5e5f5438-dc30-47e2-9f3c-0883f20593c6 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.078069 Nov 09 20:30:46.957415 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1004/1979] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:30:46 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:30:47.974478 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-f4bfefa9-b54b-4aab-9c5b-0189b0f7ecdd tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:30:47.975089 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-f4bfefa9-b54b-4aab-9c5b-0189b0f7ecdd tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:30:47.981552 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f4bfefa9-b54b-4aab-9c5b-0189b0f7ecdd tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:30:47.982002 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f4bfefa9-b54b-4aab-9c5b-0189b0f7ecdd tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:30:47.982774 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f4bfefa9-b54b-4aab-9c5b-0189b0f7ecdd tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:30:47.983207 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f4bfefa9-b54b-4aab-9c5b-0189b0f7ecdd tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:30:48.043424 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-f4bfefa9-b54b-4aab-9c5b-0189b0f7ecdd tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:30:48.051126 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-f4bfefa9-b54b-4aab-9c5b-0189b0f7ecdd tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.081336 Nov 09 20:30:48.051682 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 976/1980] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:30:47 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:30:49.067753 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-46078b2e-8103-4a2d-833b-058798564514 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:30:49.068355 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-46078b2e-8103-4a2d-833b-058798564514 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:30:49.074548 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-46078b2e-8103-4a2d-833b-058798564514 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:30:49.074989 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-46078b2e-8103-4a2d-833b-058798564514 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:30:49.075748 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-46078b2e-8103-4a2d-833b-058798564514 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:30:49.076175 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-46078b2e-8103-4a2d-833b-058798564514 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:30:49.135505 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-46078b2e-8103-4a2d-833b-058798564514 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:30:49.143138 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-46078b2e-8103-4a2d-833b-058798564514 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.079213 Nov 09 20:30:49.143692 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1005/1981] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:30:49 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:30:50.159637 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-c67622ed-e6fd-4d04-87f4-8f15c74bdbfa tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:30:50.160228 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-c67622ed-e6fd-4d04-87f4-8f15c74bdbfa tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:30:50.166518 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c67622ed-e6fd-4d04-87f4-8f15c74bdbfa tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:30:50.166957 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c67622ed-e6fd-4d04-87f4-8f15c74bdbfa tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:30:50.167714 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c67622ed-e6fd-4d04-87f4-8f15c74bdbfa tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:30:50.168137 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c67622ed-e6fd-4d04-87f4-8f15c74bdbfa tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:30:50.226435 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-c67622ed-e6fd-4d04-87f4-8f15c74bdbfa tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:30:50.234138 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-c67622ed-e6fd-4d04-87f4-8f15c74bdbfa tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.078163 Nov 09 20:30:50.234699 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 977/1982] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:30:50 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:30:51.251511 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-d8c9af10-4fb4-42e2-b692-41340258453f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:30:51.252074 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-d8c9af10-4fb4-42e2-b692-41340258453f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:30:51.259294 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d8c9af10-4fb4-42e2-b692-41340258453f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:30:51.259745 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d8c9af10-4fb4-42e2-b692-41340258453f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:30:51.260546 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d8c9af10-4fb4-42e2-b692-41340258453f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:30:51.260976 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d8c9af10-4fb4-42e2-b692-41340258453f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:30:51.323474 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-d8c9af10-4fb4-42e2-b692-41340258453f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:30:51.331070 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-d8c9af10-4fb4-42e2-b692-41340258453f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.083314 Nov 09 20:30:51.331626 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1006/1983] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:30:51 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:30:52.348931 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-9c28ded0-098a-43d8-b30f-081e4a922493 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:30:52.349523 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-9c28ded0-098a-43d8-b30f-081e4a922493 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:30:52.355626 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9c28ded0-098a-43d8-b30f-081e4a922493 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:30:52.356064 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9c28ded0-098a-43d8-b30f-081e4a922493 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:30:52.356859 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9c28ded0-098a-43d8-b30f-081e4a922493 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:30:52.357284 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9c28ded0-098a-43d8-b30f-081e4a922493 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:30:52.415960 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-9c28ded0-098a-43d8-b30f-081e4a922493 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:30:52.423566 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-9c28ded0-098a-43d8-b30f-081e4a922493 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.078871 Nov 09 20:30:52.424122 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 978/1984] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:30:52 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:30:53.441075 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-28e9950d-17e7-448f-8f7c-e89714679900 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:30:53.442159 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-28e9950d-17e7-448f-8f7c-e89714679900 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:30:53.448520 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-28e9950d-17e7-448f-8f7c-e89714679900 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:30:53.448974 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-28e9950d-17e7-448f-8f7c-e89714679900 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:30:53.449773 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-28e9950d-17e7-448f-8f7c-e89714679900 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:30:53.450209 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-28e9950d-17e7-448f-8f7c-e89714679900 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:30:53.508695 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-28e9950d-17e7-448f-8f7c-e89714679900 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:30:53.516530 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-28e9950d-17e7-448f-8f7c-e89714679900 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.079170 Nov 09 20:30:53.517090 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1007/1985] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:30:53 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:30:54.533353 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-1450440c-983f-4ada-b74e-b7f0d8eaf0e8 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:30:54.533928 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-1450440c-983f-4ada-b74e-b7f0d8eaf0e8 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:30:54.540027 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1450440c-983f-4ada-b74e-b7f0d8eaf0e8 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:30:54.540505 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1450440c-983f-4ada-b74e-b7f0d8eaf0e8 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:30:54.541262 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1450440c-983f-4ada-b74e-b7f0d8eaf0e8 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:30:54.541685 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1450440c-983f-4ada-b74e-b7f0d8eaf0e8 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:30:54.600035 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-1450440c-983f-4ada-b74e-b7f0d8eaf0e8 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:30:54.607672 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-1450440c-983f-4ada-b74e-b7f0d8eaf0e8 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.078277 Nov 09 20:30:54.608227 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 979/1986] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:30:54 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:30:55.624425 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-a2f209f2-c151-4127-bb41-9e968a0495e7 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:30:55.625040 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-a2f209f2-c151-4127-bb41-9e968a0495e7 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:30:55.631657 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a2f209f2-c151-4127-bb41-9e968a0495e7 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:30:55.632101 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a2f209f2-c151-4127-bb41-9e968a0495e7 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:30:55.632900 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a2f209f2-c151-4127-bb41-9e968a0495e7 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:30:55.633336 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a2f209f2-c151-4127-bb41-9e968a0495e7 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:30:55.693640 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-a2f209f2-c151-4127-bb41-9e968a0495e7 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:30:55.701318 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-a2f209f2-c151-4127-bb41-9e968a0495e7 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.080857 Nov 09 20:30:55.701878 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1008/1987] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:30:55 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:30:56.719054 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-a5ce7a35-3c04-48a2-97d1-7f167ea4793c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:30:56.719644 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-a5ce7a35-3c04-48a2-97d1-7f167ea4793c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:30:56.726088 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a5ce7a35-3c04-48a2-97d1-7f167ea4793c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:30:56.726531 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a5ce7a35-3c04-48a2-97d1-7f167ea4793c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:30:56.727290 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a5ce7a35-3c04-48a2-97d1-7f167ea4793c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:30:56.727716 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a5ce7a35-3c04-48a2-97d1-7f167ea4793c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:30:56.785684 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-a5ce7a35-3c04-48a2-97d1-7f167ea4793c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:30:56.793937 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-a5ce7a35-3c04-48a2-97d1-7f167ea4793c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.078814 Nov 09 20:30:56.794489 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 980/1988] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:30:56 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:30:57.810934 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-0c15da02-0380-4ebb-95f4-a4abf768cc91 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:30:57.811575 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-0c15da02-0380-4ebb-95f4-a4abf768cc91 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:30:57.818795 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-0c15da02-0380-4ebb-95f4-a4abf768cc91 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:30:57.819286 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-0c15da02-0380-4ebb-95f4-a4abf768cc91 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:30:57.820059 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-0c15da02-0380-4ebb-95f4-a4abf768cc91 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:30:57.820519 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-0c15da02-0380-4ebb-95f4-a4abf768cc91 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:30:57.892120 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-0c15da02-0380-4ebb-95f4-a4abf768cc91 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:30:57.900600 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-0c15da02-0380-4ebb-95f4-a4abf768cc91 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.093279 Nov 09 20:30:57.901176 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1009/1989] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:30:57 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:30:58.917932 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-b23ffad6-6e39-47e9-b543-955de3fec302 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:30:58.918578 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-b23ffad6-6e39-47e9-b543-955de3fec302 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:30:58.924988 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b23ffad6-6e39-47e9-b543-955de3fec302 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:30:58.925429 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b23ffad6-6e39-47e9-b543-955de3fec302 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:30:58.926194 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b23ffad6-6e39-47e9-b543-955de3fec302 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:30:58.926622 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b23ffad6-6e39-47e9-b543-955de3fec302 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:30:58.985403 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-b23ffad6-6e39-47e9-b543-955de3fec302 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:30:58.992911 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-b23ffad6-6e39-47e9-b543-955de3fec302 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.078614 Nov 09 20:30:58.993464 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 981/1990] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:30:58 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:31:00.010313 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-943efcb6-0db2-489d-962c-c85e15814a00 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:31:00.010913 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-943efcb6-0db2-489d-962c-c85e15814a00 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:31:00.017195 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-943efcb6-0db2-489d-962c-c85e15814a00 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:31:00.017640 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-943efcb6-0db2-489d-962c-c85e15814a00 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:31:00.018400 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-943efcb6-0db2-489d-962c-c85e15814a00 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:31:00.018847 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-943efcb6-0db2-489d-962c-c85e15814a00 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:31:00.077003 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-943efcb6-0db2-489d-962c-c85e15814a00 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:31:00.084697 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-943efcb6-0db2-489d-962c-c85e15814a00 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.078016 Nov 09 20:31:00.085267 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1010/1991] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:31:00 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:31:01.101245 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-bef2f3b8-e070-4260-9e8d-e0a4e9fdf0ec tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:31:01.101836 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-bef2f3b8-e070-4260-9e8d-e0a4e9fdf0ec tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:31:01.108074 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bef2f3b8-e070-4260-9e8d-e0a4e9fdf0ec tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:31:01.108546 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bef2f3b8-e070-4260-9e8d-e0a4e9fdf0ec tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:31:01.109310 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bef2f3b8-e070-4260-9e8d-e0a4e9fdf0ec tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:31:01.109737 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bef2f3b8-e070-4260-9e8d-e0a4e9fdf0ec tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:31:01.170639 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-bef2f3b8-e070-4260-9e8d-e0a4e9fdf0ec tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:31:01.178797 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-bef2f3b8-e070-4260-9e8d-e0a4e9fdf0ec tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.081236 Nov 09 20:31:01.179354 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 982/1992] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:31:01 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 20:31:02.194823 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-2ca75ef5-a6d8-4c2c-a4a2-5c223e6cb904 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:31:02.195442 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-2ca75ef5-a6d8-4c2c-a4a2-5c223e6cb904 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:31:02.201824 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-2ca75ef5-a6d8-4c2c-a4a2-5c223e6cb904 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:31:02.202272 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-2ca75ef5-a6d8-4c2c-a4a2-5c223e6cb904 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:31:02.203044 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-2ca75ef5-a6d8-4c2c-a4a2-5c223e6cb904 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:31:02.203482 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-2ca75ef5-a6d8-4c2c-a4a2-5c223e6cb904 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:31:02.262762 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-2ca75ef5-a6d8-4c2c-a4a2-5c223e6cb904 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:31:02.270978 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-2ca75ef5-a6d8-4c2c-a4a2-5c223e6cb904 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.079304 Nov 09 20:31:02.271725 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1011/1993] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:31:02 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:31:03.288199 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-7b6a882d-c9d8-4196-9c98-41a829ca4501 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:31:03.288842 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-7b6a882d-c9d8-4196-9c98-41a829ca4501 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:31:03.295088 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7b6a882d-c9d8-4196-9c98-41a829ca4501 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:31:03.295538 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7b6a882d-c9d8-4196-9c98-41a829ca4501 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:31:03.296315 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7b6a882d-c9d8-4196-9c98-41a829ca4501 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:31:03.296775 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7b6a882d-c9d8-4196-9c98-41a829ca4501 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:31:03.355167 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-7b6a882d-c9d8-4196-9c98-41a829ca4501 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:31:03.362800 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-7b6a882d-c9d8-4196-9c98-41a829ca4501 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.078808 Nov 09 20:31:03.363354 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 983/1994] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:31:03 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:31:04.380709 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-79a669f0-a03c-44f6-9dfd-77af3b0b7774 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:31:04.381319 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-79a669f0-a03c-44f6-9dfd-77af3b0b7774 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:31:04.387518 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-79a669f0-a03c-44f6-9dfd-77af3b0b7774 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:31:04.387970 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-79a669f0-a03c-44f6-9dfd-77af3b0b7774 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:31:04.388784 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-79a669f0-a03c-44f6-9dfd-77af3b0b7774 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:31:04.389224 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-79a669f0-a03c-44f6-9dfd-77af3b0b7774 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:31:04.452203 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-79a669f0-a03c-44f6-9dfd-77af3b0b7774 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:31:04.460561 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-79a669f0-a03c-44f6-9dfd-77af3b0b7774 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.083983 Nov 09 20:31:04.461124 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1012/1995] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:31:04 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:31:05.477897 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-3e7cb2d7-9c49-458d-b724-0a6aa9028a0b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:31:05.478540 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-3e7cb2d7-9c49-458d-b724-0a6aa9028a0b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:31:05.484815 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3e7cb2d7-9c49-458d-b724-0a6aa9028a0b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:31:05.485255 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3e7cb2d7-9c49-458d-b724-0a6aa9028a0b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:31:05.486018 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3e7cb2d7-9c49-458d-b724-0a6aa9028a0b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:31:05.486442 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3e7cb2d7-9c49-458d-b724-0a6aa9028a0b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:31:05.545661 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-3e7cb2d7-9c49-458d-b724-0a6aa9028a0b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:31:05.553198 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-3e7cb2d7-9c49-458d-b724-0a6aa9028a0b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.079709 Nov 09 20:31:05.553755 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 984/1996] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:31:05 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:31:05.631052 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 09 20:31:05.631653 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: Tue Nov 9 20:31:05 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 09 20:31:06.569760 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-62c275e6-a740-4dda-8ce5-c67bff443271 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:31:06.570279 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-62c275e6-a740-4dda-8ce5-c67bff443271 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:31:06.576809 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-62c275e6-a740-4dda-8ce5-c67bff443271 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:31:06.577256 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-62c275e6-a740-4dda-8ce5-c67bff443271 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:31:06.578019 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-62c275e6-a740-4dda-8ce5-c67bff443271 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:31:06.578440 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-62c275e6-a740-4dda-8ce5-c67bff443271 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:31:06.637098 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-62c275e6-a740-4dda-8ce5-c67bff443271 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:31:06.645046 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-62c275e6-a740-4dda-8ce5-c67bff443271 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.079044 Nov 09 20:31:06.645682 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1013/1997] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:31:06 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:31:07.661791 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-b9fe275f-9bd4-4053-9d2d-af6c062e203f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:31:07.662399 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-b9fe275f-9bd4-4053-9d2d-af6c062e203f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:31:07.668680 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b9fe275f-9bd4-4053-9d2d-af6c062e203f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:31:07.669134 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b9fe275f-9bd4-4053-9d2d-af6c062e203f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:31:07.669910 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b9fe275f-9bd4-4053-9d2d-af6c062e203f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:31:07.670342 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b9fe275f-9bd4-4053-9d2d-af6c062e203f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:31:07.729603 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-b9fe275f-9bd4-4053-9d2d-af6c062e203f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:31:07.737318 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-b9fe275f-9bd4-4053-9d2d-af6c062e203f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.079385 Nov 09 20:31:07.737879 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 985/1998] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:31:07 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:31:08.754922 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-311dce97-5587-466e-9628-f4dcdfab5fcf tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:31:08.755707 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-311dce97-5587-466e-9628-f4dcdfab5fcf tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:31:08.761718 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-311dce97-5587-466e-9628-f4dcdfab5fcf tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:31:08.762166 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-311dce97-5587-466e-9628-f4dcdfab5fcf tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:31:08.762943 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-311dce97-5587-466e-9628-f4dcdfab5fcf tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:31:08.763378 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-311dce97-5587-466e-9628-f4dcdfab5fcf tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:31:08.824019 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-311dce97-5587-466e-9628-f4dcdfab5fcf tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:31:08.831622 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-311dce97-5587-466e-9628-f4dcdfab5fcf tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.080482 Nov 09 20:31:08.832177 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1014/1999] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:31:08 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:31:09.848382 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-b1b9d743-3ed8-49b7-bfc1-d7c5bdf21282 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:31:09.849413 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-b1b9d743-3ed8-49b7-bfc1-d7c5bdf21282 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:31:09.855702 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b1b9d743-3ed8-49b7-bfc1-d7c5bdf21282 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:31:09.856157 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b1b9d743-3ed8-49b7-bfc1-d7c5bdf21282 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:31:09.856951 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b1b9d743-3ed8-49b7-bfc1-d7c5bdf21282 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:31:09.857385 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b1b9d743-3ed8-49b7-bfc1-d7c5bdf21282 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:31:09.916667 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-b1b9d743-3ed8-49b7-bfc1-d7c5bdf21282 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:31:09.924286 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-b1b9d743-3ed8-49b7-bfc1-d7c5bdf21282 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.079585 Nov 09 20:31:09.924887 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 986/2000] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:31:09 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:31:10.941531 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-4aacdf76-3aa9-44f3-9cc3-77889fcb88c3 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:31:10.942182 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-4aacdf76-3aa9-44f3-9cc3-77889fcb88c3 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:31:10.948556 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-4aacdf76-3aa9-44f3-9cc3-77889fcb88c3 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:31:10.949004 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-4aacdf76-3aa9-44f3-9cc3-77889fcb88c3 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:31:10.949839 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-4aacdf76-3aa9-44f3-9cc3-77889fcb88c3 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:31:10.950276 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-4aacdf76-3aa9-44f3-9cc3-77889fcb88c3 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:31:11.012287 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-4aacdf76-3aa9-44f3-9cc3-77889fcb88c3 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:31:11.019881 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-4aacdf76-3aa9-44f3-9cc3-77889fcb88c3 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.081962 Nov 09 20:31:11.021197 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1015/2001] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:31:10 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:31:12.038293 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-c49e1479-2ed5-4d4d-93c2-994a9a7fad8a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:31:12.038906 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-c49e1479-2ed5-4d4d-93c2-994a9a7fad8a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:31:12.045082 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c49e1479-2ed5-4d4d-93c2-994a9a7fad8a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:31:12.045527 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c49e1479-2ed5-4d4d-93c2-994a9a7fad8a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:31:12.046294 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c49e1479-2ed5-4d4d-93c2-994a9a7fad8a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:31:12.046724 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c49e1479-2ed5-4d4d-93c2-994a9a7fad8a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:31:12.107121 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-c49e1479-2ed5-4d4d-93c2-994a9a7fad8a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:31:12.114729 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-c49e1479-2ed5-4d4d-93c2-994a9a7fad8a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.081140 Nov 09 20:31:12.115284 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 987/2002] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:31:12 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:31:13.131856 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-00e93f63-0e03-4314-8719-11d4a8004a08 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:31:13.133095 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-00e93f63-0e03-4314-8719-11d4a8004a08 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:31:13.139503 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-00e93f63-0e03-4314-8719-11d4a8004a08 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:31:13.139981 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-00e93f63-0e03-4314-8719-11d4a8004a08 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:31:13.140808 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-00e93f63-0e03-4314-8719-11d4a8004a08 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:31:13.141241 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-00e93f63-0e03-4314-8719-11d4a8004a08 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:31:13.200425 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-00e93f63-0e03-4314-8719-11d4a8004a08 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:31:13.208141 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-00e93f63-0e03-4314-8719-11d4a8004a08 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.079963 Nov 09 20:31:13.208745 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1016/2003] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:31:13 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:31:14.224588 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-07686d23-d217-4fc1-b37a-a5598567239c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:31:14.225193 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-07686d23-d217-4fc1-b37a-a5598567239c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:31:14.232054 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-07686d23-d217-4fc1-b37a-a5598567239c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:31:14.232537 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-07686d23-d217-4fc1-b37a-a5598567239c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:31:14.233300 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-07686d23-d217-4fc1-b37a-a5598567239c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:31:14.233728 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-07686d23-d217-4fc1-b37a-a5598567239c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:31:14.292853 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-07686d23-d217-4fc1-b37a-a5598567239c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:31:14.300638 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-07686d23-d217-4fc1-b37a-a5598567239c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.079636 Nov 09 20:31:14.301187 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 988/2004] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:31:14 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 20:31:15.318245 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-b2ab7889-4051-435d-84c0-bf28d7a261da tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:31:15.318842 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-b2ab7889-4051-435d-84c0-bf28d7a261da tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:31:15.324893 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b2ab7889-4051-435d-84c0-bf28d7a261da tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:31:15.325331 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b2ab7889-4051-435d-84c0-bf28d7a261da tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:31:15.326091 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b2ab7889-4051-435d-84c0-bf28d7a261da tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:31:15.326519 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b2ab7889-4051-435d-84c0-bf28d7a261da tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:31:15.384892 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-b2ab7889-4051-435d-84c0-bf28d7a261da tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:31:15.392375 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-b2ab7889-4051-435d-84c0-bf28d7a261da tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.078013 Nov 09 20:31:15.392950 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1017/2005] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:31:15 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:31:16.409728 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-96db1264-ff59-4f0a-baca-2b44a47259a2 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:31:16.410333 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-96db1264-ff59-4f0a-baca-2b44a47259a2 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:31:16.417586 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-96db1264-ff59-4f0a-baca-2b44a47259a2 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:31:16.417977 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-96db1264-ff59-4f0a-baca-2b44a47259a2 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:31:16.418747 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-96db1264-ff59-4f0a-baca-2b44a47259a2 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:31:16.419181 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-96db1264-ff59-4f0a-baca-2b44a47259a2 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:31:16.479495 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-96db1264-ff59-4f0a-baca-2b44a47259a2 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:31:16.487134 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-96db1264-ff59-4f0a-baca-2b44a47259a2 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.081049 Nov 09 20:31:16.487694 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 989/2006] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:31:16 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:31:17.243235 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 09 20:31:17.243498 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: Tue Nov 9 20:31:17 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 09 20:31:17.504910 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-c6ae7dbb-5852-4382-837e-df2bc4af8249 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:31:17.505485 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-c6ae7dbb-5852-4382-837e-df2bc4af8249 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:31:17.512415 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c6ae7dbb-5852-4382-837e-df2bc4af8249 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:31:17.512871 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c6ae7dbb-5852-4382-837e-df2bc4af8249 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:31:17.513686 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c6ae7dbb-5852-4382-837e-df2bc4af8249 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:31:17.514124 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c6ae7dbb-5852-4382-837e-df2bc4af8249 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:31:17.576829 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-c6ae7dbb-5852-4382-837e-df2bc4af8249 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:31:17.584493 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-c6ae7dbb-5852-4382-837e-df2bc4af8249 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.083292 Nov 09 20:31:17.585045 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1018/2007] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:31:17 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:31:18.602069 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-a3cfbe85-24ec-40bf-b4ea-c975e399e977 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:31:18.602679 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-a3cfbe85-24ec-40bf-b4ea-c975e399e977 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:31:18.608977 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a3cfbe85-24ec-40bf-b4ea-c975e399e977 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:31:18.609423 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a3cfbe85-24ec-40bf-b4ea-c975e399e977 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:31:18.610188 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a3cfbe85-24ec-40bf-b4ea-c975e399e977 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:31:18.610618 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a3cfbe85-24ec-40bf-b4ea-c975e399e977 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:31:18.670828 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-a3cfbe85-24ec-40bf-b4ea-c975e399e977 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:31:18.678486 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-a3cfbe85-24ec-40bf-b4ea-c975e399e977 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.081035 Nov 09 20:31:18.680210 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 990/2008] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:31:18 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:31:19.696805 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-d557222f-3c8a-4614-9831-ff95a2cf485b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:31:19.697437 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-d557222f-3c8a-4614-9831-ff95a2cf485b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:31:19.703660 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d557222f-3c8a-4614-9831-ff95a2cf485b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:31:19.704108 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d557222f-3c8a-4614-9831-ff95a2cf485b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:31:19.704905 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d557222f-3c8a-4614-9831-ff95a2cf485b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:31:19.705332 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d557222f-3c8a-4614-9831-ff95a2cf485b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:31:19.766101 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-d557222f-3c8a-4614-9831-ff95a2cf485b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:31:19.774223 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-d557222f-3c8a-4614-9831-ff95a2cf485b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.081145 Nov 09 20:31:19.774778 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1019/2009] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:31:19 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:31:20.790864 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-e1bd23e6-48a4-452c-bbe6-438bc993a1ca tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:31:20.791496 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-e1bd23e6-48a4-452c-bbe6-438bc993a1ca tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:31:20.797743 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e1bd23e6-48a4-452c-bbe6-438bc993a1ca tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:31:20.798193 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e1bd23e6-48a4-452c-bbe6-438bc993a1ca tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:31:20.798959 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e1bd23e6-48a4-452c-bbe6-438bc993a1ca tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:31:20.799390 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e1bd23e6-48a4-452c-bbe6-438bc993a1ca tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:31:20.858193 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-e1bd23e6-48a4-452c-bbe6-438bc993a1ca tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:31:20.865869 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-e1bd23e6-48a4-452c-bbe6-438bc993a1ca tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.078709 Nov 09 20:31:20.866712 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 991/2010] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:31:20 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:31:21.882800 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-664e1c02-7eb5-4b52-a4db-476c57fac3d1 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:31:21.883442 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-664e1c02-7eb5-4b52-a4db-476c57fac3d1 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:31:21.889611 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-664e1c02-7eb5-4b52-a4db-476c57fac3d1 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:31:21.890052 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-664e1c02-7eb5-4b52-a4db-476c57fac3d1 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:31:21.890811 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-664e1c02-7eb5-4b52-a4db-476c57fac3d1 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:31:21.891236 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-664e1c02-7eb5-4b52-a4db-476c57fac3d1 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:31:21.949978 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-664e1c02-7eb5-4b52-a4db-476c57fac3d1 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:31:21.957621 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-664e1c02-7eb5-4b52-a4db-476c57fac3d1 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.078486 Nov 09 20:31:21.958185 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1020/2011] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:31:21 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:31:22.974511 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-9ec77bef-9aec-4a54-a15e-c87b0816bd08 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:31:22.975108 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-9ec77bef-9aec-4a54-a15e-c87b0816bd08 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:31:22.982256 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9ec77bef-9aec-4a54-a15e-c87b0816bd08 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:31:22.982698 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9ec77bef-9aec-4a54-a15e-c87b0816bd08 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:31:22.983468 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9ec77bef-9aec-4a54-a15e-c87b0816bd08 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:31:22.983899 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9ec77bef-9aec-4a54-a15e-c87b0816bd08 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:31:23.042745 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-9ec77bef-9aec-4a54-a15e-c87b0816bd08 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:31:23.050287 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-9ec77bef-9aec-4a54-a15e-c87b0816bd08 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.079460 Nov 09 20:31:23.050829 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 992/2012] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:31:22 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:31:24.067489 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-e822ebfd-cfdf-428f-b0aa-6a54ab128070 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:31:24.068096 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-e822ebfd-cfdf-428f-b0aa-6a54ab128070 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:31:24.074454 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e822ebfd-cfdf-428f-b0aa-6a54ab128070 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:31:24.074898 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e822ebfd-cfdf-428f-b0aa-6a54ab128070 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:31:24.075670 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e822ebfd-cfdf-428f-b0aa-6a54ab128070 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:31:24.076103 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e822ebfd-cfdf-428f-b0aa-6a54ab128070 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:31:24.139925 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-e822ebfd-cfdf-428f-b0aa-6a54ab128070 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:31:24.147506 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-e822ebfd-cfdf-428f-b0aa-6a54ab128070 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.083712 Nov 09 20:31:24.148916 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1021/2013] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:31:24 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:31:25.165215 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-11fa7dc6-ad28-4a72-879b-670c3027ca59 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:31:25.165821 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-11fa7dc6-ad28-4a72-879b-670c3027ca59 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:31:25.172032 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-11fa7dc6-ad28-4a72-879b-670c3027ca59 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:31:25.172570 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-11fa7dc6-ad28-4a72-879b-670c3027ca59 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:31:25.173335 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-11fa7dc6-ad28-4a72-879b-670c3027ca59 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:31:25.173759 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-11fa7dc6-ad28-4a72-879b-670c3027ca59 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:31:25.232553 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-11fa7dc6-ad28-4a72-879b-670c3027ca59 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:31:25.240138 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-11fa7dc6-ad28-4a72-879b-670c3027ca59 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.079111 Nov 09 20:31:25.240715 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 993/2014] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:31:25 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:31:26.237691 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 09 20:31:26.238240 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: Tue Nov 9 20:31:26 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 09 20:31:26.258394 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-fa385a5f-a52f-47e6-bacc-4aa56520f616 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:31:26.258992 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-fa385a5f-a52f-47e6-bacc-4aa56520f616 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:31:26.265336 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-fa385a5f-a52f-47e6-bacc-4aa56520f616 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:31:26.265776 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-fa385a5f-a52f-47e6-bacc-4aa56520f616 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:31:26.266539 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-fa385a5f-a52f-47e6-bacc-4aa56520f616 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:31:26.266967 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-fa385a5f-a52f-47e6-bacc-4aa56520f616 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:31:26.326937 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-fa385a5f-a52f-47e6-bacc-4aa56520f616 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:31:26.334519 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-fa385a5f-a52f-47e6-bacc-4aa56520f616 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.080557 Nov 09 20:31:26.335063 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1022/2015] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:31:26 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:31:27.351657 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-595cb0e1-fdb7-467f-a395-8cd1f926769b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:31:27.352269 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-595cb0e1-fdb7-467f-a395-8cd1f926769b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:31:27.358198 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-595cb0e1-fdb7-467f-a395-8cd1f926769b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:31:27.358651 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-595cb0e1-fdb7-467f-a395-8cd1f926769b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:31:27.359459 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-595cb0e1-fdb7-467f-a395-8cd1f926769b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:31:27.359892 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-595cb0e1-fdb7-467f-a395-8cd1f926769b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:31:27.418218 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-595cb0e1-fdb7-467f-a395-8cd1f926769b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:31:27.425828 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-595cb0e1-fdb7-467f-a395-8cd1f926769b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.078652 Nov 09 20:31:27.426399 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 994/2016] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:31:27 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:31:27.580911 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 09 20:31:27.581108 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: Tue Nov 9 20:31:27 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 09 20:31:28.442206 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-311f431d-c494-4b4e-aee2-f528536625ed tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:31:28.442807 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-311f431d-c494-4b4e-aee2-f528536625ed tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:31:28.449738 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-311f431d-c494-4b4e-aee2-f528536625ed tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:31:28.450177 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-311f431d-c494-4b4e-aee2-f528536625ed tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:31:28.450940 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-311f431d-c494-4b4e-aee2-f528536625ed tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:31:28.451366 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-311f431d-c494-4b4e-aee2-f528536625ed tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:31:28.509397 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-311f431d-c494-4b4e-aee2-f528536625ed tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:31:28.516979 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-311f431d-c494-4b4e-aee2-f528536625ed tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.078403 Nov 09 20:31:28.517525 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1023/2017] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:31:28 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:31:29.534187 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-4291c485-ff53-49e7-b583-28b9e22c16bd tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:31:29.534828 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-4291c485-ff53-49e7-b583-28b9e22c16bd tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:31:29.542070 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4291c485-ff53-49e7-b583-28b9e22c16bd tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:31:29.542437 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4291c485-ff53-49e7-b583-28b9e22c16bd tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:31:29.543245 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4291c485-ff53-49e7-b583-28b9e22c16bd tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:31:29.543679 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4291c485-ff53-49e7-b583-28b9e22c16bd tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:31:29.603793 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-4291c485-ff53-49e7-b583-28b9e22c16bd tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:31:29.611485 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-4291c485-ff53-49e7-b583-28b9e22c16bd tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.080980 Nov 09 20:31:29.612039 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 995/2018] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:31:29 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:31:30.628049 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-31d3289d-92f5-4a88-a5c2-02d7b829de62 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:31:30.628713 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-31d3289d-92f5-4a88-a5c2-02d7b829de62 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:31:30.635112 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-31d3289d-92f5-4a88-a5c2-02d7b829de62 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:31:30.635559 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-31d3289d-92f5-4a88-a5c2-02d7b829de62 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:31:30.636330 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-31d3289d-92f5-4a88-a5c2-02d7b829de62 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:31:30.636792 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-31d3289d-92f5-4a88-a5c2-02d7b829de62 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:31:30.699968 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-31d3289d-92f5-4a88-a5c2-02d7b829de62 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:31:30.707750 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-31d3289d-92f5-4a88-a5c2-02d7b829de62 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.083367 Nov 09 20:31:30.708308 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1024/2019] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:31:30 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:31:31.724289 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-3f0a98e8-bdc6-4df5-be97-cbb54ab6c43c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:31:31.724918 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-3f0a98e8-bdc6-4df5-be97-cbb54ab6c43c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:31:31.731587 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3f0a98e8-bdc6-4df5-be97-cbb54ab6c43c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:31:31.732035 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3f0a98e8-bdc6-4df5-be97-cbb54ab6c43c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:31:31.732843 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3f0a98e8-bdc6-4df5-be97-cbb54ab6c43c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:31:31.733275 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3f0a98e8-bdc6-4df5-be97-cbb54ab6c43c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:31:31.794321 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-3f0a98e8-bdc6-4df5-be97-cbb54ab6c43c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:31:31.802020 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-3f0a98e8-bdc6-4df5-be97-cbb54ab6c43c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.081415 Nov 09 20:31:31.802580 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 996/2020] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:31:31 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:31:32.819416 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-d6911a0d-08e6-4b5e-afea-d62b779f26d8 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:31:32.820670 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-d6911a0d-08e6-4b5e-afea-d62b779f26d8 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:31:32.826946 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d6911a0d-08e6-4b5e-afea-d62b779f26d8 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:31:32.827387 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d6911a0d-08e6-4b5e-afea-d62b779f26d8 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:31:32.828156 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d6911a0d-08e6-4b5e-afea-d62b779f26d8 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:31:32.828614 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d6911a0d-08e6-4b5e-afea-d62b779f26d8 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:31:32.889316 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-d6911a0d-08e6-4b5e-afea-d62b779f26d8 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:31:32.896727 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-d6911a0d-08e6-4b5e-afea-d62b779f26d8 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.080920 Nov 09 20:31:32.897279 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1025/2021] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:31:32 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:31:33.914499 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-a642a553-666a-4fe2-808f-f13e9fe29602 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:31:33.915111 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-a642a553-666a-4fe2-808f-f13e9fe29602 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:31:33.921273 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a642a553-666a-4fe2-808f-f13e9fe29602 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:31:33.921714 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a642a553-666a-4fe2-808f-f13e9fe29602 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:31:33.922472 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a642a553-666a-4fe2-808f-f13e9fe29602 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:31:33.922897 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a642a553-666a-4fe2-808f-f13e9fe29602 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:31:33.981928 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-a642a553-666a-4fe2-808f-f13e9fe29602 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:31:33.989633 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-a642a553-666a-4fe2-808f-f13e9fe29602 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.079525 Nov 09 20:31:33.990188 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 997/2022] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:31:33 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:31:35.006472 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-984f4b96-462b-4801-8021-93b649d116b3 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:31:35.007196 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-984f4b96-462b-4801-8021-93b649d116b3 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:31:35.013431 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-984f4b96-462b-4801-8021-93b649d116b3 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:31:35.013872 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-984f4b96-462b-4801-8021-93b649d116b3 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:31:35.014633 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-984f4b96-462b-4801-8021-93b649d116b3 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:31:35.015058 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-984f4b96-462b-4801-8021-93b649d116b3 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:31:35.074121 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-984f4b96-462b-4801-8021-93b649d116b3 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:31:35.081760 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-984f4b96-462b-4801-8021-93b649d116b3 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.078964 Nov 09 20:31:35.082326 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1026/2023] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:31:35 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:31:36.098295 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-3d2ecdf0-36bf-4e6f-a707-b228cd0dc825 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:31:36.098896 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-3d2ecdf0-36bf-4e6f-a707-b228cd0dc825 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:31:36.105183 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3d2ecdf0-36bf-4e6f-a707-b228cd0dc825 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:31:36.105637 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3d2ecdf0-36bf-4e6f-a707-b228cd0dc825 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:31:36.106406 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3d2ecdf0-36bf-4e6f-a707-b228cd0dc825 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:31:36.106847 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3d2ecdf0-36bf-4e6f-a707-b228cd0dc825 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:31:36.165494 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-3d2ecdf0-36bf-4e6f-a707-b228cd0dc825 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:31:36.173159 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-3d2ecdf0-36bf-4e6f-a707-b228cd0dc825 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.078551 Nov 09 20:31:36.173715 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 998/2024] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:31:36 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:31:37.190785 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-530857ca-1803-4671-9f6e-0cb35e137fff tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:31:37.191497 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-530857ca-1803-4671-9f6e-0cb35e137fff tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:31:37.198136 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-530857ca-1803-4671-9f6e-0cb35e137fff tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:31:37.198577 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-530857ca-1803-4671-9f6e-0cb35e137fff tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:31:37.199339 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-530857ca-1803-4671-9f6e-0cb35e137fff tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:31:37.199765 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-530857ca-1803-4671-9f6e-0cb35e137fff tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:31:37.264371 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-530857ca-1803-4671-9f6e-0cb35e137fff tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:31:37.272070 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-530857ca-1803-4671-9f6e-0cb35e137fff tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.085188 Nov 09 20:31:37.272695 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1027/2025] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:31:37 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:31:38.290693 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-31731c85-65cd-4578-8d32-fa078a247973 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:31:38.291300 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-31731c85-65cd-4578-8d32-fa078a247973 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:31:38.297580 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-31731c85-65cd-4578-8d32-fa078a247973 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:31:38.298023 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-31731c85-65cd-4578-8d32-fa078a247973 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:31:38.298789 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-31731c85-65cd-4578-8d32-fa078a247973 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:31:38.299225 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-31731c85-65cd-4578-8d32-fa078a247973 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:31:38.358487 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-31731c85-65cd-4578-8d32-fa078a247973 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:31:38.366127 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-31731c85-65cd-4578-8d32-fa078a247973 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.080036 Nov 09 20:31:38.366808 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 999/2026] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:31:38 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:31:39.383467 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-888d1d4e-8bd4-4c43-847b-c10a034ba42d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:31:39.384065 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-888d1d4e-8bd4-4c43-847b-c10a034ba42d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:31:39.390234 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-888d1d4e-8bd4-4c43-847b-c10a034ba42d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:31:39.390672 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-888d1d4e-8bd4-4c43-847b-c10a034ba42d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:31:39.391428 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-888d1d4e-8bd4-4c43-847b-c10a034ba42d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:31:39.391852 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-888d1d4e-8bd4-4c43-847b-c10a034ba42d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:31:39.449577 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-888d1d4e-8bd4-4c43-847b-c10a034ba42d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:31:39.457241 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-888d1d4e-8bd4-4c43-847b-c10a034ba42d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.078108 Nov 09 20:31:39.457793 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1028/2027] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:31:39 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:31:40.473923 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-6e664ab7-1420-434a-accd-7502c41256e4 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:31:40.474531 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-6e664ab7-1420-434a-accd-7502c41256e4 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:31:40.481043 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6e664ab7-1420-434a-accd-7502c41256e4 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:31:40.481493 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6e664ab7-1420-434a-accd-7502c41256e4 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:31:40.482270 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6e664ab7-1420-434a-accd-7502c41256e4 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:31:40.482705 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6e664ab7-1420-434a-accd-7502c41256e4 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:31:40.541280 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-6e664ab7-1420-434a-accd-7502c41256e4 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:31:40.548939 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-6e664ab7-1420-434a-accd-7502c41256e4 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.078649 Nov 09 20:31:40.549495 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1000/2028] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:31:40 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:31:41.566340 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-649c699c-3de9-4505-acf1-c6e5f772ed00 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:31:41.566873 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-649c699c-3de9-4505-acf1-c6e5f772ed00 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:31:41.573545 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-649c699c-3de9-4505-acf1-c6e5f772ed00 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:31:41.573988 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-649c699c-3de9-4505-acf1-c6e5f772ed00 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:31:41.574756 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-649c699c-3de9-4505-acf1-c6e5f772ed00 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:31:41.575187 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-649c699c-3de9-4505-acf1-c6e5f772ed00 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:31:41.635673 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-649c699c-3de9-4505-acf1-c6e5f772ed00 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:31:41.643297 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-649c699c-3de9-4505-acf1-c6e5f772ed00 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.080704 Nov 09 20:31:41.643856 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1029/2029] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:31:41 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:31:42.660103 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-07207c92-aded-48a4-aeaa-516897b6a946 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:31:42.660735 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-07207c92-aded-48a4-aeaa-516897b6a946 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:31:42.667534 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-07207c92-aded-48a4-aeaa-516897b6a946 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:31:42.668007 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-07207c92-aded-48a4-aeaa-516897b6a946 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:31:42.668810 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-07207c92-aded-48a4-aeaa-516897b6a946 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:31:42.669243 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-07207c92-aded-48a4-aeaa-516897b6a946 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:31:42.727840 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-07207c92-aded-48a4-aeaa-516897b6a946 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:31:42.735427 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-07207c92-aded-48a4-aeaa-516897b6a946 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.079016 Nov 09 20:31:42.735986 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1001/2030] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:31:42 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:31:43.752196 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-2f78a6d9-5eee-4238-b6e8-f227f9c9739e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:31:43.752820 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-2f78a6d9-5eee-4238-b6e8-f227f9c9739e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:31:43.759813 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-2f78a6d9-5eee-4238-b6e8-f227f9c9739e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:31:43.760263 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-2f78a6d9-5eee-4238-b6e8-f227f9c9739e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:31:43.761070 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-2f78a6d9-5eee-4238-b6e8-f227f9c9739e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:31:43.761507 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-2f78a6d9-5eee-4238-b6e8-f227f9c9739e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:31:43.823607 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-2f78a6d9-5eee-4238-b6e8-f227f9c9739e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:31:43.831362 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-2f78a6d9-5eee-4238-b6e8-f227f9c9739e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.082861 Nov 09 20:31:43.831915 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1030/2031] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:31:43 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 20:31:44.847931 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-3d58b2cb-4081-4721-b0a4-a3a8b2a3de9c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:31:44.848570 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-3d58b2cb-4081-4721-b0a4-a3a8b2a3de9c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:31:44.854961 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3d58b2cb-4081-4721-b0a4-a3a8b2a3de9c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:31:44.855406 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3d58b2cb-4081-4721-b0a4-a3a8b2a3de9c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:31:44.856349 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3d58b2cb-4081-4721-b0a4-a3a8b2a3de9c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:31:44.856809 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3d58b2cb-4081-4721-b0a4-a3a8b2a3de9c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:31:44.917683 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-3d58b2cb-4081-4721-b0a4-a3a8b2a3de9c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:31:44.926073 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-3d58b2cb-4081-4721-b0a4-a3a8b2a3de9c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.081719 Nov 09 20:31:44.926639 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1002/2032] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:31:44 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:31:45.942681 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-c075f6db-5308-4756-8a5d-fba4ca9c1307 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:31:45.943274 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-c075f6db-5308-4756-8a5d-fba4ca9c1307 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:31:45.949635 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c075f6db-5308-4756-8a5d-fba4ca9c1307 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:31:45.950081 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c075f6db-5308-4756-8a5d-fba4ca9c1307 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:31:45.950860 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c075f6db-5308-4756-8a5d-fba4ca9c1307 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:31:45.951274 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c075f6db-5308-4756-8a5d-fba4ca9c1307 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:31:46.010615 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-c075f6db-5308-4756-8a5d-fba4ca9c1307 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:31:46.018137 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-c075f6db-5308-4756-8a5d-fba4ca9c1307 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.079060 Nov 09 20:31:46.018688 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1031/2033] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:31:45 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:31:47.035288 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-ccb8b6a6-1375-4fdb-8a3f-2cb6e615f07a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:31:47.035878 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-ccb8b6a6-1375-4fdb-8a3f-2cb6e615f07a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:31:47.042740 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ccb8b6a6-1375-4fdb-8a3f-2cb6e615f07a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:31:47.043181 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ccb8b6a6-1375-4fdb-8a3f-2cb6e615f07a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:31:47.043939 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ccb8b6a6-1375-4fdb-8a3f-2cb6e615f07a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:31:47.044366 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ccb8b6a6-1375-4fdb-8a3f-2cb6e615f07a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:31:47.103057 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-ccb8b6a6-1375-4fdb-8a3f-2cb6e615f07a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:31:47.110751 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-ccb8b6a6-1375-4fdb-8a3f-2cb6e615f07a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.079024 Nov 09 20:31:47.111311 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1003/2034] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:31:47 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:31:48.131393 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-434866ca-bc4f-43fb-a348-204d1200467e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:31:48.132115 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-434866ca-bc4f-43fb-a348-204d1200467e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:31:48.138614 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-434866ca-bc4f-43fb-a348-204d1200467e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:31:48.139061 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-434866ca-bc4f-43fb-a348-204d1200467e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:31:48.139844 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-434866ca-bc4f-43fb-a348-204d1200467e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:31:48.140274 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-434866ca-bc4f-43fb-a348-204d1200467e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:31:48.199097 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-434866ca-bc4f-43fb-a348-204d1200467e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:31:48.206705 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-434866ca-bc4f-43fb-a348-204d1200467e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.082870 Nov 09 20:31:48.207259 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1032/2035] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:31:48 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:31:49.224032 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-0bd91e02-0835-45ff-acbc-7cde4e0374e0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:31:49.224671 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-0bd91e02-0835-45ff-acbc-7cde4e0374e0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:31:49.231719 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0bd91e02-0835-45ff-acbc-7cde4e0374e0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:31:49.232168 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0bd91e02-0835-45ff-acbc-7cde4e0374e0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:31:49.233007 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0bd91e02-0835-45ff-acbc-7cde4e0374e0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:31:49.233437 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0bd91e02-0835-45ff-acbc-7cde4e0374e0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:31:49.293672 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-0bd91e02-0835-45ff-acbc-7cde4e0374e0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:31:49.301295 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-0bd91e02-0835-45ff-acbc-7cde4e0374e0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.080960 Nov 09 20:31:49.301844 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1004/2036] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:31:49 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:31:50.318212 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-be55c283-2b08-4f32-9f4e-f964baa162a2 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:31:50.318780 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-be55c283-2b08-4f32-9f4e-f964baa162a2 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:31:50.325612 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-be55c283-2b08-4f32-9f4e-f964baa162a2 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:31:50.326059 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-be55c283-2b08-4f32-9f4e-f964baa162a2 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:31:50.326819 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-be55c283-2b08-4f32-9f4e-f964baa162a2 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:31:50.327245 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-be55c283-2b08-4f32-9f4e-f964baa162a2 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:31:50.390531 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-be55c283-2b08-4f32-9f4e-f964baa162a2 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:31:50.398260 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-be55c283-2b08-4f32-9f4e-f964baa162a2 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.083757 Nov 09 20:31:50.398966 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1033/2037] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:31:50 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:31:51.415142 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-24bb5c0d-fd6a-42af-a995-448bf3804fa8 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:31:51.415747 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-24bb5c0d-fd6a-42af-a995-448bf3804fa8 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:31:51.422226 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-24bb5c0d-fd6a-42af-a995-448bf3804fa8 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:31:51.422672 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-24bb5c0d-fd6a-42af-a995-448bf3804fa8 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:31:51.423432 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-24bb5c0d-fd6a-42af-a995-448bf3804fa8 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:31:51.423856 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-24bb5c0d-fd6a-42af-a995-448bf3804fa8 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:31:51.482062 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-24bb5c0d-fd6a-42af-a995-448bf3804fa8 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:31:51.489650 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-24bb5c0d-fd6a-42af-a995-448bf3804fa8 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.078396 Nov 09 20:31:51.490200 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1005/2038] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:31:51 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:31:52.506642 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-91b189d5-398e-47d0-8c3b-ad6ae036a75a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:31:52.507237 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-91b189d5-398e-47d0-8c3b-ad6ae036a75a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:31:52.514030 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-91b189d5-398e-47d0-8c3b-ad6ae036a75a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:31:52.514473 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-91b189d5-398e-47d0-8c3b-ad6ae036a75a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:31:52.515236 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-91b189d5-398e-47d0-8c3b-ad6ae036a75a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:31:52.515660 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-91b189d5-398e-47d0-8c3b-ad6ae036a75a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:31:52.577431 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-91b189d5-398e-47d0-8c3b-ad6ae036a75a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:31:52.585107 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-91b189d5-398e-47d0-8c3b-ad6ae036a75a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.082106 Nov 09 20:31:52.585671 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1034/2039] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:31:52 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:31:53.602472 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-efd0103f-bcae-49ef-9061-9c739f5d6faf tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:31:53.603065 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-efd0103f-bcae-49ef-9061-9c739f5d6faf tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:31:53.609308 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-efd0103f-bcae-49ef-9061-9c739f5d6faf tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:31:53.610013 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-efd0103f-bcae-49ef-9061-9c739f5d6faf tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:31:53.610823 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-efd0103f-bcae-49ef-9061-9c739f5d6faf tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:31:53.611254 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-efd0103f-bcae-49ef-9061-9c739f5d6faf tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:31:53.671752 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-efd0103f-bcae-49ef-9061-9c739f5d6faf tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:31:53.679529 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-efd0103f-bcae-49ef-9061-9c739f5d6faf tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.081388 Nov 09 20:31:53.680139 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1006/2040] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:31:53 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:31:54.696350 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-faf2db22-6b4d-49c5-81b6-5d99ea45eab4 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:31:54.696986 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-faf2db22-6b4d-49c5-81b6-5d99ea45eab4 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:31:54.703196 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-faf2db22-6b4d-49c5-81b6-5d99ea45eab4 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:31:54.703639 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-faf2db22-6b4d-49c5-81b6-5d99ea45eab4 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:31:54.704433 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-faf2db22-6b4d-49c5-81b6-5d99ea45eab4 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:31:54.704866 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-faf2db22-6b4d-49c5-81b6-5d99ea45eab4 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:31:54.763097 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-faf2db22-6b4d-49c5-81b6-5d99ea45eab4 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:31:54.770694 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-faf2db22-6b4d-49c5-81b6-5d99ea45eab4 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.078233 Nov 09 20:31:54.771252 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1035/2041] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:31:54 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:31:55.788224 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-2833bee7-2c00-48ab-ac85-e818905ba70d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:31:55.788864 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-2833bee7-2c00-48ab-ac85-e818905ba70d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:31:55.795527 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2833bee7-2c00-48ab-ac85-e818905ba70d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:31:55.795984 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2833bee7-2c00-48ab-ac85-e818905ba70d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:31:55.796770 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2833bee7-2c00-48ab-ac85-e818905ba70d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:31:55.797202 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2833bee7-2c00-48ab-ac85-e818905ba70d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:31:55.857429 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-2833bee7-2c00-48ab-ac85-e818905ba70d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:31:55.865015 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-2833bee7-2c00-48ab-ac85-e818905ba70d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.080419 Nov 09 20:31:55.865564 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1007/2042] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:31:55 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:31:56.884065 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-e2898151-5522-42a7-98bd-bf9cfa8702fb tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:31:56.884664 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-e2898151-5522-42a7-98bd-bf9cfa8702fb tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:31:56.890804 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e2898151-5522-42a7-98bd-bf9cfa8702fb tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:31:56.891252 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e2898151-5522-42a7-98bd-bf9cfa8702fb tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:31:56.892023 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e2898151-5522-42a7-98bd-bf9cfa8702fb tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:31:56.892482 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e2898151-5522-42a7-98bd-bf9cfa8702fb tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:31:56.954428 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-e2898151-5522-42a7-98bd-bf9cfa8702fb tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:31:56.963024 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-e2898151-5522-42a7-98bd-bf9cfa8702fb tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.083456 Nov 09 20:31:56.963582 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1036/2043] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:31:56 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:31:57.979621 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-7dabca28-9279-4d6c-832b-ba6e7d67fd2e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:31:57.980242 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-7dabca28-9279-4d6c-832b-ba6e7d67fd2e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:31:57.986114 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7dabca28-9279-4d6c-832b-ba6e7d67fd2e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:31:57.986555 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7dabca28-9279-4d6c-832b-ba6e7d67fd2e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:31:57.987316 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7dabca28-9279-4d6c-832b-ba6e7d67fd2e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:31:57.987739 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7dabca28-9279-4d6c-832b-ba6e7d67fd2e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:31:58.181621 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-7dabca28-9279-4d6c-832b-ba6e7d67fd2e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:31:58.189397 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-7dabca28-9279-4d6c-832b-ba6e7d67fd2e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.214249 Nov 09 20:31:58.189952 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1008/2044] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:31:57 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:31:59.206539 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-133e3162-8652-4ce8-ba05-b72ba9902f84 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:31:59.207166 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-133e3162-8652-4ce8-ba05-b72ba9902f84 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:31:59.213412 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-133e3162-8652-4ce8-ba05-b72ba9902f84 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:31:59.213860 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-133e3162-8652-4ce8-ba05-b72ba9902f84 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:31:59.214634 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-133e3162-8652-4ce8-ba05-b72ba9902f84 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:31:59.215071 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-133e3162-8652-4ce8-ba05-b72ba9902f84 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:31:59.274466 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-133e3162-8652-4ce8-ba05-b72ba9902f84 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:31:59.282431 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-133e3162-8652-4ce8-ba05-b72ba9902f84 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.079630 Nov 09 20:31:59.282993 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1037/2045] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:31:59 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:32:00.298789 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-fc1e8441-c32f-4a54-9797-3a6afb7a681a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:32:00.299401 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-fc1e8441-c32f-4a54-9797-3a6afb7a681a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:32:00.305766 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fc1e8441-c32f-4a54-9797-3a6afb7a681a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:32:00.306219 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fc1e8441-c32f-4a54-9797-3a6afb7a681a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:32:00.306993 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fc1e8441-c32f-4a54-9797-3a6afb7a681a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:32:00.307431 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fc1e8441-c32f-4a54-9797-3a6afb7a681a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:32:00.367996 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-fc1e8441-c32f-4a54-9797-3a6afb7a681a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:32:00.376019 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-fc1e8441-c32f-4a54-9797-3a6afb7a681a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.080877 Nov 09 20:32:00.376613 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1009/2046] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:32:00 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:32:01.393391 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-d49c3ba7-bbf5-4f4f-9930-7dda2ad0c148 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:32:01.393919 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-d49c3ba7-bbf5-4f4f-9930-7dda2ad0c148 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:32:01.400432 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d49c3ba7-bbf5-4f4f-9930-7dda2ad0c148 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:32:01.400876 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d49c3ba7-bbf5-4f4f-9930-7dda2ad0c148 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:32:01.401632 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d49c3ba7-bbf5-4f4f-9930-7dda2ad0c148 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:32:01.402060 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d49c3ba7-bbf5-4f4f-9930-7dda2ad0c148 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:32:01.460471 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-d49c3ba7-bbf5-4f4f-9930-7dda2ad0c148 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:32:01.467955 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-d49c3ba7-bbf5-4f4f-9930-7dda2ad0c148 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.078307 Nov 09 20:32:01.468539 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1038/2047] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:32:01 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:32:02.484887 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-fdf89c51-64ed-4fb9-9e02-a43621886485 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:32:02.485489 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-fdf89c51-64ed-4fb9-9e02-a43621886485 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:32:02.491688 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fdf89c51-64ed-4fb9-9e02-a43621886485 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:32:02.492133 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fdf89c51-64ed-4fb9-9e02-a43621886485 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:32:02.493857 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fdf89c51-64ed-4fb9-9e02-a43621886485 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:32:02.494293 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fdf89c51-64ed-4fb9-9e02-a43621886485 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:32:02.551550 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-fdf89c51-64ed-4fb9-9e02-a43621886485 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:32:02.559577 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-fdf89c51-64ed-4fb9-9e02-a43621886485 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.078386 Nov 09 20:32:02.560137 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1010/2048] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:32:02 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:32:03.576799 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-c7e6cdb7-e19f-4091-895f-2dcbdca0f271 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:32:03.577330 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-c7e6cdb7-e19f-4091-895f-2dcbdca0f271 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:32:03.583395 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c7e6cdb7-e19f-4091-895f-2dcbdca0f271 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:32:03.583836 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c7e6cdb7-e19f-4091-895f-2dcbdca0f271 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:32:03.584614 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c7e6cdb7-e19f-4091-895f-2dcbdca0f271 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:32:03.585130 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c7e6cdb7-e19f-4091-895f-2dcbdca0f271 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:32:03.647553 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-c7e6cdb7-e19f-4091-895f-2dcbdca0f271 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:32:03.655929 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-c7e6cdb7-e19f-4091-895f-2dcbdca0f271 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.082849 Nov 09 20:32:03.656501 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1039/2049] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:32:03 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:32:04.672951 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-68531892-6a0d-4e2a-8ce8-09c79140264f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:32:04.673567 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-68531892-6a0d-4e2a-8ce8-09c79140264f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:32:04.680536 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-68531892-6a0d-4e2a-8ce8-09c79140264f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:32:04.681038 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-68531892-6a0d-4e2a-8ce8-09c79140264f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:32:04.681813 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-68531892-6a0d-4e2a-8ce8-09c79140264f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:32:04.682251 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-68531892-6a0d-4e2a-8ce8-09c79140264f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:32:04.740721 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-68531892-6a0d-4e2a-8ce8-09c79140264f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:32:04.749221 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-68531892-6a0d-4e2a-8ce8-09c79140264f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.080008 Nov 09 20:32:04.749788 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1011/2050] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:32:04 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:32:05.766586 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-5bef8228-15e3-4fc7-b75a-3bff4bf7828e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:32:05.767182 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-5bef8228-15e3-4fc7-b75a-3bff4bf7828e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:32:05.774146 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-5bef8228-15e3-4fc7-b75a-3bff4bf7828e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:32:05.774909 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-5bef8228-15e3-4fc7-b75a-3bff4bf7828e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:32:05.775701 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-5bef8228-15e3-4fc7-b75a-3bff4bf7828e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:32:05.776142 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-5bef8228-15e3-4fc7-b75a-3bff4bf7828e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:32:05.835834 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-5bef8228-15e3-4fc7-b75a-3bff4bf7828e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:32:05.844800 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-5bef8228-15e3-4fc7-b75a-3bff4bf7828e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.081854 Nov 09 20:32:05.845372 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1040/2051] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:32:05 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:32:06.861483 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-f2606691-428c-4729-bb1e-48bdc57e209c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:32:06.862114 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-f2606691-428c-4729-bb1e-48bdc57e209c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:32:06.869033 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f2606691-428c-4729-bb1e-48bdc57e209c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:32:06.869483 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f2606691-428c-4729-bb1e-48bdc57e209c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:32:06.870252 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f2606691-428c-4729-bb1e-48bdc57e209c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:32:06.870687 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f2606691-428c-4729-bb1e-48bdc57e209c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:32:06.930003 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-f2606691-428c-4729-bb1e-48bdc57e209c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:32:06.937660 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-f2606691-428c-4729-bb1e-48bdc57e209c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.079874 Nov 09 20:32:06.938222 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1012/2052] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:32:06 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:32:07.954262 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-3d17a194-302e-4fc1-899e-8ffce6687008 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:32:07.954939 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-3d17a194-302e-4fc1-899e-8ffce6687008 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:32:07.961208 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-3d17a194-302e-4fc1-899e-8ffce6687008 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:32:07.961685 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-3d17a194-302e-4fc1-899e-8ffce6687008 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:32:07.962457 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-3d17a194-302e-4fc1-899e-8ffce6687008 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:32:07.962882 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-3d17a194-302e-4fc1-899e-8ffce6687008 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:32:08.022838 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-3d17a194-302e-4fc1-899e-8ffce6687008 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:32:08.030559 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-3d17a194-302e-4fc1-899e-8ffce6687008 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.080018 Nov 09 20:32:08.031124 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1041/2053] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:32:07 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:32:09.047633 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-f842df44-aa6d-4d09-ac60-6240d260cdc7 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:32:09.048238 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-f842df44-aa6d-4d09-ac60-6240d260cdc7 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:32:09.054418 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f842df44-aa6d-4d09-ac60-6240d260cdc7 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:32:09.054955 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f842df44-aa6d-4d09-ac60-6240d260cdc7 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:32:09.055883 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f842df44-aa6d-4d09-ac60-6240d260cdc7 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:32:09.056311 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f842df44-aa6d-4d09-ac60-6240d260cdc7 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:32:09.114106 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-f842df44-aa6d-4d09-ac60-6240d260cdc7 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:32:09.122254 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-f842df44-aa6d-4d09-ac60-6240d260cdc7 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.078042 Nov 09 20:32:09.122814 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1013/2054] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:32:09 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:32:10.138756 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-979b8330-5f29-455e-b2b0-1fdff5c88f8d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:32:10.139350 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-979b8330-5f29-455e-b2b0-1fdff5c88f8d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:32:10.145457 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-979b8330-5f29-455e-b2b0-1fdff5c88f8d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:32:10.145898 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-979b8330-5f29-455e-b2b0-1fdff5c88f8d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:32:10.146651 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-979b8330-5f29-455e-b2b0-1fdff5c88f8d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:32:10.147074 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-979b8330-5f29-455e-b2b0-1fdff5c88f8d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:32:10.208718 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-979b8330-5f29-455e-b2b0-1fdff5c88f8d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:32:10.216590 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-979b8330-5f29-455e-b2b0-1fdff5c88f8d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.081324 Nov 09 20:32:10.217144 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1042/2055] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:32:10 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:32:11.232500 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-de8dd118-c843-4bdf-8307-930a4e39761e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:32:11.233113 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-de8dd118-c843-4bdf-8307-930a4e39761e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:32:11.239364 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-de8dd118-c843-4bdf-8307-930a4e39761e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:32:11.239813 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-de8dd118-c843-4bdf-8307-930a4e39761e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:32:11.240626 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-de8dd118-c843-4bdf-8307-930a4e39761e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:32:11.241067 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-de8dd118-c843-4bdf-8307-930a4e39761e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:32:11.300207 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-de8dd118-c843-4bdf-8307-930a4e39761e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:32:11.308415 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-de8dd118-c843-4bdf-8307-930a4e39761e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.079531 Nov 09 20:32:11.308985 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1014/2056] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:32:11 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:32:12.324778 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-b27fde16-3b16-4923-a0ce-cf6a862d5844 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:32:12.325379 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-b27fde16-3b16-4923-a0ce-cf6a862d5844 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:32:12.331553 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b27fde16-3b16-4923-a0ce-cf6a862d5844 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:32:12.331993 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b27fde16-3b16-4923-a0ce-cf6a862d5844 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:32:12.332777 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b27fde16-3b16-4923-a0ce-cf6a862d5844 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:32:12.333206 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b27fde16-3b16-4923-a0ce-cf6a862d5844 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:32:12.391523 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-b27fde16-3b16-4923-a0ce-cf6a862d5844 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:32:12.398963 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-b27fde16-3b16-4923-a0ce-cf6a862d5844 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.078428 Nov 09 20:32:12.400155 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1043/2057] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:32:12 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:32:13.417122 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-62940e52-c96f-4b45-9856-cd7e59a47ccd tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:32:13.417724 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-62940e52-c96f-4b45-9856-cd7e59a47ccd tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:32:13.423979 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-62940e52-c96f-4b45-9856-cd7e59a47ccd tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:32:13.424449 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-62940e52-c96f-4b45-9856-cd7e59a47ccd tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:32:13.425221 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-62940e52-c96f-4b45-9856-cd7e59a47ccd tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:32:13.425650 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-62940e52-c96f-4b45-9856-cd7e59a47ccd tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:32:13.484976 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-62940e52-c96f-4b45-9856-cd7e59a47ccd tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:32:13.492598 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-62940e52-c96f-4b45-9856-cd7e59a47ccd tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.080192 Nov 09 20:32:13.493377 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1015/2058] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:32:13 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:32:14.509835 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-6c126e9d-2a8c-4a83-985a-d758ddcb24f3 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:32:14.510471 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-6c126e9d-2a8c-4a83-985a-d758ddcb24f3 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:32:14.516706 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6c126e9d-2a8c-4a83-985a-d758ddcb24f3 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:32:14.517158 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6c126e9d-2a8c-4a83-985a-d758ddcb24f3 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:32:14.517931 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6c126e9d-2a8c-4a83-985a-d758ddcb24f3 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:32:14.518368 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6c126e9d-2a8c-4a83-985a-d758ddcb24f3 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:32:14.576818 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-6c126e9d-2a8c-4a83-985a-d758ddcb24f3 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:32:14.584646 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-6c126e9d-2a8c-4a83-985a-d758ddcb24f3 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.078995 Nov 09 20:32:14.585212 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1044/2059] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:32:14 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:32:15.601991 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-b21d24b8-20f9-4f56-b0d4-ff2de551df15 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:32:15.603385 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-b21d24b8-20f9-4f56-b0d4-ff2de551df15 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:32:15.609775 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b21d24b8-20f9-4f56-b0d4-ff2de551df15 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:32:15.610218 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b21d24b8-20f9-4f56-b0d4-ff2de551df15 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:32:15.610988 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b21d24b8-20f9-4f56-b0d4-ff2de551df15 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:32:15.611414 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b21d24b8-20f9-4f56-b0d4-ff2de551df15 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:32:15.672420 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-b21d24b8-20f9-4f56-b0d4-ff2de551df15 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:32:15.680050 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-b21d24b8-20f9-4f56-b0d4-ff2de551df15 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.081760 Nov 09 20:32:15.681215 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1016/2060] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:32:15 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:32:16.698013 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-0d0cae4f-04bb-40ae-81ea-2f36bb2fa5d8 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:32:16.698611 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-0d0cae4f-04bb-40ae-81ea-2f36bb2fa5d8 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:32:16.704491 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-0d0cae4f-04bb-40ae-81ea-2f36bb2fa5d8 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:32:16.704938 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-0d0cae4f-04bb-40ae-81ea-2f36bb2fa5d8 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:32:16.705697 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-0d0cae4f-04bb-40ae-81ea-2f36bb2fa5d8 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:32:16.706125 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-0d0cae4f-04bb-40ae-81ea-2f36bb2fa5d8 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:32:16.816541 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-0d0cae4f-04bb-40ae-81ea-2f36bb2fa5d8 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:32:16.824871 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-0d0cae4f-04bb-40ae-81ea-2f36bb2fa5d8 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.131248 Nov 09 20:32:16.825431 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1045/2061] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:32:16 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:32:17.841694 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-4a222fa2-cfb6-4619-8b3c-4bb4265e08b4 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:32:17.842298 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-4a222fa2-cfb6-4619-8b3c-4bb4265e08b4 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:32:17.848492 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4a222fa2-cfb6-4619-8b3c-4bb4265e08b4 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:32:17.848944 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4a222fa2-cfb6-4619-8b3c-4bb4265e08b4 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:32:17.849711 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4a222fa2-cfb6-4619-8b3c-4bb4265e08b4 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:32:17.850141 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4a222fa2-cfb6-4619-8b3c-4bb4265e08b4 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:32:17.908680 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-4a222fa2-cfb6-4619-8b3c-4bb4265e08b4 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:32:17.916267 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-4a222fa2-cfb6-4619-8b3c-4bb4265e08b4 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.078235 Nov 09 20:32:17.916859 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1017/2062] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:32:17 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:32:18.933015 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-b7dcbb05-339f-434e-8578-2121cb3010dc tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:32:18.933705 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-b7dcbb05-339f-434e-8578-2121cb3010dc tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:32:18.939769 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b7dcbb05-339f-434e-8578-2121cb3010dc tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:32:18.940215 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b7dcbb05-339f-434e-8578-2121cb3010dc tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:32:18.941012 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b7dcbb05-339f-434e-8578-2121cb3010dc tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:32:18.941439 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b7dcbb05-339f-434e-8578-2121cb3010dc tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:32:19.000795 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-b7dcbb05-339f-434e-8578-2121cb3010dc tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:32:19.008390 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-b7dcbb05-339f-434e-8578-2121cb3010dc tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.079229 Nov 09 20:32:19.009055 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1046/2063] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:32:18 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:32:20.025701 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-392979e8-940c-44c4-b0b7-cc0fef99f48a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:32:20.026308 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-392979e8-940c-44c4-b0b7-cc0fef99f48a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:32:20.032522 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-392979e8-940c-44c4-b0b7-cc0fef99f48a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:32:20.032971 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-392979e8-940c-44c4-b0b7-cc0fef99f48a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:32:20.033748 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-392979e8-940c-44c4-b0b7-cc0fef99f48a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:32:20.034179 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-392979e8-940c-44c4-b0b7-cc0fef99f48a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:32:20.093017 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-392979e8-940c-44c4-b0b7-cc0fef99f48a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:32:20.100676 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-392979e8-940c-44c4-b0b7-cc0fef99f48a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.079252 Nov 09 20:32:20.101241 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1018/2064] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:32:20 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:32:21.117349 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-991c57e7-68ba-4ecb-9592-3c8395db7fd1 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:32:21.117944 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-991c57e7-68ba-4ecb-9592-3c8395db7fd1 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:32:21.124468 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-991c57e7-68ba-4ecb-9592-3c8395db7fd1 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:32:21.124923 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-991c57e7-68ba-4ecb-9592-3c8395db7fd1 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:32:21.125698 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-991c57e7-68ba-4ecb-9592-3c8395db7fd1 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:32:21.126133 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-991c57e7-68ba-4ecb-9592-3c8395db7fd1 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:32:21.184301 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-991c57e7-68ba-4ecb-9592-3c8395db7fd1 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:32:21.191817 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-991c57e7-68ba-4ecb-9592-3c8395db7fd1 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.078190 Nov 09 20:32:21.192423 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1047/2065] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:32:21 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:32:22.208703 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-5716364e-a333-4acc-a0e2-9adcbeac983a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:32:22.209313 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-5716364e-a333-4acc-a0e2-9adcbeac983a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:32:22.215640 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5716364e-a333-4acc-a0e2-9adcbeac983a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:32:22.216085 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5716364e-a333-4acc-a0e2-9adcbeac983a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:32:22.216879 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5716364e-a333-4acc-a0e2-9adcbeac983a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:32:22.217307 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5716364e-a333-4acc-a0e2-9adcbeac983a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:32:22.276208 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-5716364e-a333-4acc-a0e2-9adcbeac983a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:32:22.284045 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-5716364e-a333-4acc-a0e2-9adcbeac983a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.078995 Nov 09 20:32:22.284641 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1019/2066] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:32:22 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:32:23.301047 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-fb57fd9d-b2d1-4d91-80f6-7bcf74479bd2 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:32:23.301646 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-fb57fd9d-b2d1-4d91-80f6-7bcf74479bd2 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:32:23.308336 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-fb57fd9d-b2d1-4d91-80f6-7bcf74479bd2 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:32:23.308797 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-fb57fd9d-b2d1-4d91-80f6-7bcf74479bd2 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:32:23.309552 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-fb57fd9d-b2d1-4d91-80f6-7bcf74479bd2 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:32:23.309972 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-fb57fd9d-b2d1-4d91-80f6-7bcf74479bd2 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:32:23.373414 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-fb57fd9d-b2d1-4d91-80f6-7bcf74479bd2 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:32:23.380997 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-fb57fd9d-b2d1-4d91-80f6-7bcf74479bd2 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.083672 Nov 09 20:32:23.381552 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1048/2067] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:32:23 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:32:24.398024 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-881ae62d-762e-419e-a827-0c2d712dcec8 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:32:24.398630 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-881ae62d-762e-419e-a827-0c2d712dcec8 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:32:24.405166 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-881ae62d-762e-419e-a827-0c2d712dcec8 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:32:24.405608 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-881ae62d-762e-419e-a827-0c2d712dcec8 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:32:24.406378 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-881ae62d-762e-419e-a827-0c2d712dcec8 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:32:24.406807 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-881ae62d-762e-419e-a827-0c2d712dcec8 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:32:24.465665 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-881ae62d-762e-419e-a827-0c2d712dcec8 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:32:24.473202 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-881ae62d-762e-419e-a827-0c2d712dcec8 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.078902 Nov 09 20:32:24.473761 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1020/2068] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:32:24 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:32:25.490083 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-ee6f8be0-cd4e-4b54-9e11-205ae926574a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:32:25.490679 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-ee6f8be0-cd4e-4b54-9e11-205ae926574a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:32:25.497668 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ee6f8be0-cd4e-4b54-9e11-205ae926574a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:32:25.498108 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ee6f8be0-cd4e-4b54-9e11-205ae926574a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:32:25.498862 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ee6f8be0-cd4e-4b54-9e11-205ae926574a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:32:25.499284 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ee6f8be0-cd4e-4b54-9e11-205ae926574a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:32:25.557082 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-ee6f8be0-cd4e-4b54-9e11-205ae926574a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:32:25.564785 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-ee6f8be0-cd4e-4b54-9e11-205ae926574a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.078278 Nov 09 20:32:25.565350 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1049/2069] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:32:25 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:32:26.581993 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-f31e7065-9245-4d8c-a913-cf86d7b4cf00 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:32:26.582596 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-f31e7065-9245-4d8c-a913-cf86d7b4cf00 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:32:26.589335 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f31e7065-9245-4d8c-a913-cf86d7b4cf00 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:32:26.589782 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f31e7065-9245-4d8c-a913-cf86d7b4cf00 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:32:26.590546 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f31e7065-9245-4d8c-a913-cf86d7b4cf00 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:32:26.590977 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f31e7065-9245-4d8c-a913-cf86d7b4cf00 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:32:26.650915 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-f31e7065-9245-4d8c-a913-cf86d7b4cf00 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:32:26.658607 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-f31e7065-9245-4d8c-a913-cf86d7b4cf00 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.080407 Nov 09 20:32:26.659163 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1021/2070] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:32:26 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:32:27.676187 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-0e006787-eed7-4864-b572-ae9a1e54c97e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:32:27.676820 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-0e006787-eed7-4864-b572-ae9a1e54c97e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:32:27.683813 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-0e006787-eed7-4864-b572-ae9a1e54c97e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:32:27.684261 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-0e006787-eed7-4864-b572-ae9a1e54c97e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:32:27.685081 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-0e006787-eed7-4864-b572-ae9a1e54c97e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:32:27.685514 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-0e006787-eed7-4864-b572-ae9a1e54c97e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:32:27.744428 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-0e006787-eed7-4864-b572-ae9a1e54c97e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:32:27.752304 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-0e006787-eed7-4864-b572-ae9a1e54c97e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.079827 Nov 09 20:32:27.752894 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1050/2071] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:32:27 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:32:28.768958 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-c0cb6af5-c737-4740-81a7-e46cff5a9cff tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:32:28.769541 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-c0cb6af5-c737-4740-81a7-e46cff5a9cff tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:32:28.775971 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c0cb6af5-c737-4740-81a7-e46cff5a9cff tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:32:28.776419 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c0cb6af5-c737-4740-81a7-e46cff5a9cff tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:32:28.777191 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c0cb6af5-c737-4740-81a7-e46cff5a9cff tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:32:28.777616 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c0cb6af5-c737-4740-81a7-e46cff5a9cff tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:32:28.835613 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-c0cb6af5-c737-4740-81a7-e46cff5a9cff tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:32:28.843270 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-c0cb6af5-c737-4740-81a7-e46cff5a9cff tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.077966 Nov 09 20:32:28.843821 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1022/2072] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:32:28 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:32:29.860499 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-1dd95de0-9616-4c2b-aea2-c8295e8ec527 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:32:29.861110 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-1dd95de0-9616-4c2b-aea2-c8295e8ec527 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:32:29.867299 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-1dd95de0-9616-4c2b-aea2-c8295e8ec527 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:32:29.867745 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-1dd95de0-9616-4c2b-aea2-c8295e8ec527 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:32:29.868582 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-1dd95de0-9616-4c2b-aea2-c8295e8ec527 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:32:29.869015 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-1dd95de0-9616-4c2b-aea2-c8295e8ec527 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:32:29.930797 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-1dd95de0-9616-4c2b-aea2-c8295e8ec527 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:32:29.938505 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-1dd95de0-9616-4c2b-aea2-c8295e8ec527 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.081695 Nov 09 20:32:29.939077 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1051/2073] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:32:29 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:32:30.955688 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-9a369ce9-87c2-43a1-a39d-4a5845ace1b8 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:32:30.956365 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-9a369ce9-87c2-43a1-a39d-4a5845ace1b8 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:32:30.963284 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9a369ce9-87c2-43a1-a39d-4a5845ace1b8 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:32:30.963723 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9a369ce9-87c2-43a1-a39d-4a5845ace1b8 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:32:30.964583 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9a369ce9-87c2-43a1-a39d-4a5845ace1b8 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:32:30.965010 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9a369ce9-87c2-43a1-a39d-4a5845ace1b8 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:32:31.023870 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-9a369ce9-87c2-43a1-a39d-4a5845ace1b8 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:32:31.031848 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-9a369ce9-87c2-43a1-a39d-4a5845ace1b8 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.079822 Nov 09 20:32:31.032422 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1023/2074] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:32:30 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:32:32.049141 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-d34e68e2-58c3-4581-a593-459ef99713c0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:32:32.049766 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-d34e68e2-58c3-4581-a593-459ef99713c0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:32:32.056674 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d34e68e2-58c3-4581-a593-459ef99713c0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:32:32.057141 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d34e68e2-58c3-4581-a593-459ef99713c0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:32:32.057912 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d34e68e2-58c3-4581-a593-459ef99713c0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:32:32.058348 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d34e68e2-58c3-4581-a593-459ef99713c0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:32:32.120143 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-d34e68e2-58c3-4581-a593-459ef99713c0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:32:32.128082 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-d34e68e2-58c3-4581-a593-459ef99713c0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.082600 Nov 09 20:32:32.128665 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1052/2075] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:32:32 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:32:33.144857 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-960b4e9d-dc12-48d0-993f-fea74c8df7c0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:32:33.145471 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-960b4e9d-dc12-48d0-993f-fea74c8df7c0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:32:33.152515 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-960b4e9d-dc12-48d0-993f-fea74c8df7c0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:32:33.152959 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-960b4e9d-dc12-48d0-993f-fea74c8df7c0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:32:33.153724 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-960b4e9d-dc12-48d0-993f-fea74c8df7c0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:32:33.154152 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-960b4e9d-dc12-48d0-993f-fea74c8df7c0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:32:33.214205 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-960b4e9d-dc12-48d0-993f-fea74c8df7c0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:32:33.221804 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-960b4e9d-dc12-48d0-993f-fea74c8df7c0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.080633 Nov 09 20:32:33.222372 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1024/2076] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:32:33 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:32:34.238620 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-34a9828c-b0f0-44f3-9661-aa4635b293ab tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:32:34.239215 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-34a9828c-b0f0-44f3-9661-aa4635b293ab tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:32:34.246445 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-34a9828c-b0f0-44f3-9661-aa4635b293ab tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:32:34.246890 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-34a9828c-b0f0-44f3-9661-aa4635b293ab tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:32:34.247922 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-34a9828c-b0f0-44f3-9661-aa4635b293ab tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:32:34.248353 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-34a9828c-b0f0-44f3-9661-aa4635b293ab tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:32:34.308739 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-34a9828c-b0f0-44f3-9661-aa4635b293ab tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:32:34.316493 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-34a9828c-b0f0-44f3-9661-aa4635b293ab tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.081563 Nov 09 20:32:34.317047 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1053/2077] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:32:34 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:32:35.333061 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-9d7627d6-f13d-4e05-83a1-cac6b945c5d8 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:32:35.333643 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-9d7627d6-f13d-4e05-83a1-cac6b945c5d8 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:32:35.340045 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9d7627d6-f13d-4e05-83a1-cac6b945c5d8 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:32:35.340520 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9d7627d6-f13d-4e05-83a1-cac6b945c5d8 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:32:35.341280 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9d7627d6-f13d-4e05-83a1-cac6b945c5d8 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:32:35.341703 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9d7627d6-f13d-4e05-83a1-cac6b945c5d8 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:32:35.399894 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-9d7627d6-f13d-4e05-83a1-cac6b945c5d8 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:32:35.407491 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-9d7627d6-f13d-4e05-83a1-cac6b945c5d8 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.078055 Nov 09 20:32:35.408044 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1025/2078] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:32:35 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:32:36.424277 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-27c36ba7-9b9d-459c-847f-ddf19fb6fd53 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:32:36.424951 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-27c36ba7-9b9d-459c-847f-ddf19fb6fd53 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:32:36.431198 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-27c36ba7-9b9d-459c-847f-ddf19fb6fd53 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:32:36.431643 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-27c36ba7-9b9d-459c-847f-ddf19fb6fd53 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:32:36.432808 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-27c36ba7-9b9d-459c-847f-ddf19fb6fd53 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:32:36.433249 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-27c36ba7-9b9d-459c-847f-ddf19fb6fd53 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:32:36.496521 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-27c36ba7-9b9d-459c-847f-ddf19fb6fd53 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:32:36.504582 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-27c36ba7-9b9d-459c-847f-ddf19fb6fd53 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.083952 Nov 09 20:32:36.505154 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1054/2079] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:32:36 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:32:37.521861 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-c8f4ea60-8e08-4e09-872f-1d1ecb18eb81 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:32:37.522577 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-c8f4ea60-8e08-4e09-872f-1d1ecb18eb81 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:32:37.528953 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c8f4ea60-8e08-4e09-872f-1d1ecb18eb81 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:32:37.529403 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c8f4ea60-8e08-4e09-872f-1d1ecb18eb81 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:32:37.530301 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c8f4ea60-8e08-4e09-872f-1d1ecb18eb81 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:32:37.530737 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c8f4ea60-8e08-4e09-872f-1d1ecb18eb81 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:32:37.589571 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-c8f4ea60-8e08-4e09-872f-1d1ecb18eb81 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:32:37.597255 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-c8f4ea60-8e08-4e09-872f-1d1ecb18eb81 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.079194 Nov 09 20:32:37.597811 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1026/2080] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:32:37 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:32:38.614135 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-37c6eaaa-6d83-4482-88df-eb4dc5ff4df8 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:32:38.614725 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-37c6eaaa-6d83-4482-88df-eb4dc5ff4df8 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:32:38.621201 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-37c6eaaa-6d83-4482-88df-eb4dc5ff4df8 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:32:38.621646 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-37c6eaaa-6d83-4482-88df-eb4dc5ff4df8 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:32:38.622669 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-37c6eaaa-6d83-4482-88df-eb4dc5ff4df8 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:32:38.623096 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-37c6eaaa-6d83-4482-88df-eb4dc5ff4df8 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:32:38.681526 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-37c6eaaa-6d83-4482-88df-eb4dc5ff4df8 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:32:38.689314 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-37c6eaaa-6d83-4482-88df-eb4dc5ff4df8 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.078799 Nov 09 20:32:38.689875 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1055/2081] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:32:38 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:32:39.141372 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 09 20:32:39.141575 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: Tue Nov 9 20:32:39 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 09 20:32:39.706210 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-1aa7e4c5-7087-4500-b40b-6448bbf544cf tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:32:39.706805 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-1aa7e4c5-7087-4500-b40b-6448bbf544cf tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:32:39.713829 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1aa7e4c5-7087-4500-b40b-6448bbf544cf tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:32:39.714309 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1aa7e4c5-7087-4500-b40b-6448bbf544cf tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:32:39.715088 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1aa7e4c5-7087-4500-b40b-6448bbf544cf tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:32:39.715523 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1aa7e4c5-7087-4500-b40b-6448bbf544cf tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:32:39.774331 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-1aa7e4c5-7087-4500-b40b-6448bbf544cf tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:32:39.782662 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-1aa7e4c5-7087-4500-b40b-6448bbf544cf tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.080092 Nov 09 20:32:39.783227 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1027/2082] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:32:39 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:32:40.799824 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-09579b5e-8570-4b9c-979b-777d499ce1b0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:32:40.800438 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-09579b5e-8570-4b9c-979b-777d499ce1b0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:32:40.806586 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-09579b5e-8570-4b9c-979b-777d499ce1b0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:32:40.808131 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-09579b5e-8570-4b9c-979b-777d499ce1b0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:32:40.808934 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-09579b5e-8570-4b9c-979b-777d499ce1b0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:32:40.809365 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-09579b5e-8570-4b9c-979b-777d499ce1b0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:32:40.868471 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-09579b5e-8570-4b9c-979b-777d499ce1b0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:32:40.877648 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-09579b5e-8570-4b9c-979b-777d499ce1b0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.081582 Nov 09 20:32:40.878202 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1056/2083] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:32:40 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:32:41.894552 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-eebfe66a-fa96-458e-97f0-d4a148e713ec tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:32:41.895162 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-eebfe66a-fa96-458e-97f0-d4a148e713ec tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:32:41.902233 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-eebfe66a-fa96-458e-97f0-d4a148e713ec tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:32:41.902682 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-eebfe66a-fa96-458e-97f0-d4a148e713ec tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:32:41.903459 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-eebfe66a-fa96-458e-97f0-d4a148e713ec tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:32:41.903892 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-eebfe66a-fa96-458e-97f0-d4a148e713ec tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:32:41.961886 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-eebfe66a-fa96-458e-97f0-d4a148e713ec tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:32:41.969889 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-eebfe66a-fa96-458e-97f0-d4a148e713ec tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.079014 Nov 09 20:32:41.970451 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1028/2084] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:32:41 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:32:42.985650 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-d5ac30b2-2567-4823-9dba-831d341000c0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:32:42.986262 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-d5ac30b2-2567-4823-9dba-831d341000c0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:32:42.992309 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d5ac30b2-2567-4823-9dba-831d341000c0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:32:42.992786 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d5ac30b2-2567-4823-9dba-831d341000c0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:32:42.993541 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d5ac30b2-2567-4823-9dba-831d341000c0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:32:42.993967 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d5ac30b2-2567-4823-9dba-831d341000c0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:32:43.055853 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-d5ac30b2-2567-4823-9dba-831d341000c0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:32:43.063672 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-d5ac30b2-2567-4823-9dba-831d341000c0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.081665 Nov 09 20:32:43.064220 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1057/2085] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:32:42 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:32:44.080602 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-009888fb-b814-4882-aba3-ca958a38a555 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:32:44.081209 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-009888fb-b814-4882-aba3-ca958a38a555 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:32:44.087450 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-009888fb-b814-4882-aba3-ca958a38a555 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:32:44.087904 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-009888fb-b814-4882-aba3-ca958a38a555 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:32:44.088973 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-009888fb-b814-4882-aba3-ca958a38a555 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:32:44.089407 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-009888fb-b814-4882-aba3-ca958a38a555 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:32:44.150007 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-009888fb-b814-4882-aba3-ca958a38a555 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:32:44.158336 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-009888fb-b814-4882-aba3-ca958a38a555 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.081348 Nov 09 20:32:44.158906 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1029/2086] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:32:44 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:32:45.174852 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-46190153-7bbd-43dd-9f33-be7b006deaf6 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:32:45.175446 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-46190153-7bbd-43dd-9f33-be7b006deaf6 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:32:45.182031 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-46190153-7bbd-43dd-9f33-be7b006deaf6 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:32:45.182677 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-46190153-7bbd-43dd-9f33-be7b006deaf6 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:32:45.183438 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-46190153-7bbd-43dd-9f33-be7b006deaf6 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:32:45.183866 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-46190153-7bbd-43dd-9f33-be7b006deaf6 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:32:45.241541 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-46190153-7bbd-43dd-9f33-be7b006deaf6 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:32:45.250207 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-46190153-7bbd-43dd-9f33-be7b006deaf6 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.079091 Nov 09 20:32:45.250772 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1058/2087] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:32:45 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:32:46.266928 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-fa82bf73-ab3b-464d-a0e5-f9557295c484 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:32:46.267525 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-fa82bf73-ab3b-464d-a0e5-f9557295c484 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:32:46.273688 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fa82bf73-ab3b-464d-a0e5-f9557295c484 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:32:46.274127 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fa82bf73-ab3b-464d-a0e5-f9557295c484 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:32:46.274884 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fa82bf73-ab3b-464d-a0e5-f9557295c484 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:32:46.276115 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fa82bf73-ab3b-464d-a0e5-f9557295c484 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:32:46.334740 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-fa82bf73-ab3b-464d-a0e5-f9557295c484 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:32:46.343114 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-fa82bf73-ab3b-464d-a0e5-f9557295c484 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.079805 Nov 09 20:32:46.343674 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1030/2088] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:32:46 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:32:47.360608 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-a4140bdc-a231-4ab2-959c-2651595fd071 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:32:47.361217 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-a4140bdc-a231-4ab2-959c-2651595fd071 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:32:47.367128 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a4140bdc-a231-4ab2-959c-2651595fd071 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:32:47.367569 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a4140bdc-a231-4ab2-959c-2651595fd071 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:32:47.368324 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a4140bdc-a231-4ab2-959c-2651595fd071 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:32:47.368777 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a4140bdc-a231-4ab2-959c-2651595fd071 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:32:47.427062 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-a4140bdc-a231-4ab2-959c-2651595fd071 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:32:47.436948 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-a4140bdc-a231-4ab2-959c-2651595fd071 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.079981 Nov 09 20:32:47.437768 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1059/2089] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:32:47 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:32:48.454060 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-bf8fffae-bfca-4d3c-8bf0-dce0171934b4 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:32:48.454659 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-bf8fffae-bfca-4d3c-8bf0-dce0171934b4 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:32:48.460897 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bf8fffae-bfca-4d3c-8bf0-dce0171934b4 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:32:48.461344 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bf8fffae-bfca-4d3c-8bf0-dce0171934b4 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:32:48.462142 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bf8fffae-bfca-4d3c-8bf0-dce0171934b4 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:32:48.462574 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bf8fffae-bfca-4d3c-8bf0-dce0171934b4 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:32:48.521424 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-bf8fffae-bfca-4d3c-8bf0-dce0171934b4 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:32:48.529958 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-bf8fffae-bfca-4d3c-8bf0-dce0171934b4 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.079541 Nov 09 20:32:48.530520 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1031/2090] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:32:48 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:32:49.546887 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-634ffc8c-4166-434d-b55c-421ccb3ac881 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:32:49.547410 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-634ffc8c-4166-434d-b55c-421ccb3ac881 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:32:49.553625 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-634ffc8c-4166-434d-b55c-421ccb3ac881 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:32:49.554071 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-634ffc8c-4166-434d-b55c-421ccb3ac881 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:32:49.554832 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-634ffc8c-4166-434d-b55c-421ccb3ac881 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:32:49.555260 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-634ffc8c-4166-434d-b55c-421ccb3ac881 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:32:49.617069 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-634ffc8c-4166-434d-b55c-421ccb3ac881 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:32:49.625080 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-634ffc8c-4166-434d-b55c-421ccb3ac881 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.081950 Nov 09 20:32:49.625638 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1060/2091] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:32:49 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:32:50.641576 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-12f9f223-8d0c-4b9d-941e-2b0b264829d8 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:32:50.642216 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-12f9f223-8d0c-4b9d-941e-2b0b264829d8 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:32:50.648471 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-12f9f223-8d0c-4b9d-941e-2b0b264829d8 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:32:50.648920 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-12f9f223-8d0c-4b9d-941e-2b0b264829d8 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:32:50.649693 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-12f9f223-8d0c-4b9d-941e-2b0b264829d8 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:32:50.650124 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-12f9f223-8d0c-4b9d-941e-2b0b264829d8 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:32:50.711351 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-12f9f223-8d0c-4b9d-941e-2b0b264829d8 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:32:50.719107 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-12f9f223-8d0c-4b9d-941e-2b0b264829d8 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.081189 Nov 09 20:32:50.719666 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1032/2092] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:32:50 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:32:51.736417 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-37fa0b75-c245-45bd-a00e-6e236dfcdc6f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:32:51.737021 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-37fa0b75-c245-45bd-a00e-6e236dfcdc6f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:32:51.743176 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-37fa0b75-c245-45bd-a00e-6e236dfcdc6f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:32:51.743614 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-37fa0b75-c245-45bd-a00e-6e236dfcdc6f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:32:51.744373 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-37fa0b75-c245-45bd-a00e-6e236dfcdc6f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:32:51.744834 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-37fa0b75-c245-45bd-a00e-6e236dfcdc6f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:32:51.807583 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-37fa0b75-c245-45bd-a00e-6e236dfcdc6f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:32:51.816151 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-37fa0b75-c245-45bd-a00e-6e236dfcdc6f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.083398 Nov 09 20:32:51.816930 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1061/2093] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:32:51 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:32:52.251457 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 09 20:32:52.252012 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: Tue Nov 9 20:32:52 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 09 20:32:52.962632 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-2345d07e-c755-47f0-b14b-94c0367db872 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:32:52.963232 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-2345d07e-c755-47f0-b14b-94c0367db872 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:32:52.969594 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2345d07e-c755-47f0-b14b-94c0367db872 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:32:52.970035 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2345d07e-c755-47f0-b14b-94c0367db872 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:32:52.970790 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2345d07e-c755-47f0-b14b-94c0367db872 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:32:52.971214 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2345d07e-c755-47f0-b14b-94c0367db872 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:32:53.031883 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-2345d07e-c755-47f0-b14b-94c0367db872 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:32:53.039522 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-2345d07e-c755-47f0-b14b-94c0367db872 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.209285 Nov 09 20:32:53.040394 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1033/2094] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:32:52 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:32:54.056213 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-056352dd-c8bd-4e73-8a62-032dfed2885a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:32:54.056868 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-056352dd-c8bd-4e73-8a62-032dfed2885a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:32:54.063109 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-056352dd-c8bd-4e73-8a62-032dfed2885a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:32:54.063553 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-056352dd-c8bd-4e73-8a62-032dfed2885a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:32:54.064317 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-056352dd-c8bd-4e73-8a62-032dfed2885a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:32:54.064776 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-056352dd-c8bd-4e73-8a62-032dfed2885a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:32:54.123597 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-056352dd-c8bd-4e73-8a62-032dfed2885a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:32:54.131214 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-056352dd-c8bd-4e73-8a62-032dfed2885a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.078605 Nov 09 20:32:54.131772 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1062/2095] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:32:54 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:32:55.147862 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-aab122bd-2933-480f-9ed9-ea3feadcbc22 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:32:55.148498 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-aab122bd-2933-480f-9ed9-ea3feadcbc22 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:32:55.154889 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-aab122bd-2933-480f-9ed9-ea3feadcbc22 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:32:55.155334 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-aab122bd-2933-480f-9ed9-ea3feadcbc22 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:32:55.156096 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-aab122bd-2933-480f-9ed9-ea3feadcbc22 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:32:55.156555 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-aab122bd-2933-480f-9ed9-ea3feadcbc22 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:32:55.215065 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-aab122bd-2933-480f-9ed9-ea3feadcbc22 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:32:55.222617 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-aab122bd-2933-480f-9ed9-ea3feadcbc22 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.078400 Nov 09 20:32:55.223168 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1034/2096] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:32:55 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:32:56.239675 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-1e64da11-49e2-4798-8892-04a5f7093169 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:32:56.240271 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-1e64da11-49e2-4798-8892-04a5f7093169 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:32:56.246684 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-1e64da11-49e2-4798-8892-04a5f7093169 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:32:56.247126 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-1e64da11-49e2-4798-8892-04a5f7093169 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:32:56.248147 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-1e64da11-49e2-4798-8892-04a5f7093169 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:32:56.248610 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-1e64da11-49e2-4798-8892-04a5f7093169 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:32:56.311536 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-1e64da11-49e2-4798-8892-04a5f7093169 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:32:56.319593 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-1e64da11-49e2-4798-8892-04a5f7093169 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.083330 Nov 09 20:32:56.320201 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1063/2097] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:32:56 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:32:57.335226 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-c879bf70-823d-4a99-8877-0b0aebcf24e9 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:32:57.335821 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-c879bf70-823d-4a99-8877-0b0aebcf24e9 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:32:57.341710 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c879bf70-823d-4a99-8877-0b0aebcf24e9 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:32:57.342152 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c879bf70-823d-4a99-8877-0b0aebcf24e9 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:32:57.342914 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c879bf70-823d-4a99-8877-0b0aebcf24e9 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:32:57.343338 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c879bf70-823d-4a99-8877-0b0aebcf24e9 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:32:57.400984 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-c879bf70-823d-4a99-8877-0b0aebcf24e9 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:32:57.408538 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-c879bf70-823d-4a99-8877-0b0aebcf24e9 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.077140 Nov 09 20:32:57.409090 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1035/2098] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:32:57 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 20:32:58.425997 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-a23e6d03-b256-42e6-94f1-66cc45f79c07 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:32:58.426609 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-a23e6d03-b256-42e6-94f1-66cc45f79c07 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:32:58.433138 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a23e6d03-b256-42e6-94f1-66cc45f79c07 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:32:58.433703 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a23e6d03-b256-42e6-94f1-66cc45f79c07 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:32:58.434316 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a23e6d03-b256-42e6-94f1-66cc45f79c07 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:32:58.434754 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a23e6d03-b256-42e6-94f1-66cc45f79c07 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:32:58.493636 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-a23e6d03-b256-42e6-94f1-66cc45f79c07 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:32:58.501718 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-a23e6d03-b256-42e6-94f1-66cc45f79c07 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.079362 Nov 09 20:32:58.502297 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1064/2099] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:32:58 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:32:59.518448 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-16b98207-96ba-4ea3-b439-806a7e95ee6d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:32:59.519047 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-16b98207-96ba-4ea3-b439-806a7e95ee6d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:32:59.525291 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-16b98207-96ba-4ea3-b439-806a7e95ee6d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:32:59.525737 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-16b98207-96ba-4ea3-b439-806a7e95ee6d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:32:59.526506 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-16b98207-96ba-4ea3-b439-806a7e95ee6d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:32:59.527221 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-16b98207-96ba-4ea3-b439-806a7e95ee6d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:32:59.588715 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-16b98207-96ba-4ea3-b439-806a7e95ee6d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:32:59.596629 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-16b98207-96ba-4ea3-b439-806a7e95ee6d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.081792 Nov 09 20:32:59.597188 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1036/2100] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:32:59 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:33:00.614273 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-b0d00ad0-1ce5-46f8-80c3-6b5a52a6d5f0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:33:00.614856 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-b0d00ad0-1ce5-46f8-80c3-6b5a52a6d5f0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:33:00.621911 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b0d00ad0-1ce5-46f8-80c3-6b5a52a6d5f0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:33:00.622357 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b0d00ad0-1ce5-46f8-80c3-6b5a52a6d5f0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:33:00.623414 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b0d00ad0-1ce5-46f8-80c3-6b5a52a6d5f0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:33:00.623844 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b0d00ad0-1ce5-46f8-80c3-6b5a52a6d5f0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:33:00.682349 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-b0d00ad0-1ce5-46f8-80c3-6b5a52a6d5f0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:33:00.690740 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-b0d00ad0-1ce5-46f8-80c3-6b5a52a6d5f0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.080097 Nov 09 20:33:00.691302 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1065/2101] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:33:00 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:33:01.707408 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-80ff2ce9-e82a-435d-9d6f-f5bfa7258f8e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:33:01.708009 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-80ff2ce9-e82a-435d-9d6f-f5bfa7258f8e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:33:01.714804 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-80ff2ce9-e82a-435d-9d6f-f5bfa7258f8e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:33:01.715392 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-80ff2ce9-e82a-435d-9d6f-f5bfa7258f8e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:33:01.716156 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-80ff2ce9-e82a-435d-9d6f-f5bfa7258f8e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:33:01.716681 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-80ff2ce9-e82a-435d-9d6f-f5bfa7258f8e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:33:01.774798 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-80ff2ce9-e82a-435d-9d6f-f5bfa7258f8e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:33:01.783313 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-80ff2ce9-e82a-435d-9d6f-f5bfa7258f8e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.079525 Nov 09 20:33:01.783866 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1037/2102] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:33:01 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:33:02.800216 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-b669e5e5-6603-4938-98fe-bffaeba296b8 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:33:02.800849 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-b669e5e5-6603-4938-98fe-bffaeba296b8 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:33:02.807029 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b669e5e5-6603-4938-98fe-bffaeba296b8 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:33:02.807476 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b669e5e5-6603-4938-98fe-bffaeba296b8 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:33:02.808933 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b669e5e5-6603-4938-98fe-bffaeba296b8 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:33:02.809368 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b669e5e5-6603-4938-98fe-bffaeba296b8 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:33:02.872125 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-b669e5e5-6603-4938-98fe-bffaeba296b8 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:33:02.880277 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-b669e5e5-6603-4938-98fe-bffaeba296b8 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.083738 Nov 09 20:33:02.880876 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1066/2103] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:33:02 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:33:03.896709 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-9bd9e1fe-128b-4192-ae96-6a679a6496c3 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:33:03.897313 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-9bd9e1fe-128b-4192-ae96-6a679a6496c3 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:33:03.904422 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9bd9e1fe-128b-4192-ae96-6a679a6496c3 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:33:03.904869 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9bd9e1fe-128b-4192-ae96-6a679a6496c3 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:33:03.905636 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9bd9e1fe-128b-4192-ae96-6a679a6496c3 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:33:03.906066 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9bd9e1fe-128b-4192-ae96-6a679a6496c3 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:33:03.966013 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-9bd9e1fe-128b-4192-ae96-6a679a6496c3 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:33:03.973679 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-9bd9e1fe-128b-4192-ae96-6a679a6496c3 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.080595 Nov 09 20:33:03.974233 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1038/2104] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:33:03 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:33:04.990129 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-6dc37ff5-6998-4db6-bc60-e545a4a60035 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:33:04.990757 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-6dc37ff5-6998-4db6-bc60-e545a4a60035 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:33:04.998085 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6dc37ff5-6998-4db6-bc60-e545a4a60035 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:33:04.998526 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6dc37ff5-6998-4db6-bc60-e545a4a60035 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:33:04.999342 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6dc37ff5-6998-4db6-bc60-e545a4a60035 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:33:04.999765 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6dc37ff5-6998-4db6-bc60-e545a4a60035 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:33:05.058584 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-6dc37ff5-6998-4db6-bc60-e545a4a60035 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:33:05.066157 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-6dc37ff5-6998-4db6-bc60-e545a4a60035 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.079755 Nov 09 20:33:05.066710 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1067/2105] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:33:04 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:33:06.082722 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-0434f990-a881-446b-9418-ce88dc8504ad tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:33:06.083322 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-0434f990-a881-446b-9418-ce88dc8504ad tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:33:06.089578 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0434f990-a881-446b-9418-ce88dc8504ad tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:33:06.090024 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0434f990-a881-446b-9418-ce88dc8504ad tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:33:06.090794 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0434f990-a881-446b-9418-ce88dc8504ad tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:33:06.091221 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0434f990-a881-446b-9418-ce88dc8504ad tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:33:06.152097 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-0434f990-a881-446b-9418-ce88dc8504ad tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:33:06.161047 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-0434f990-a881-446b-9418-ce88dc8504ad tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.081901 Nov 09 20:33:06.161611 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1039/2106] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:33:06 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:33:07.177621 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-f1c8310d-2fc2-49b9-8e44-2ac3c0d8d00f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:33:07.178216 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-f1c8310d-2fc2-49b9-8e44-2ac3c0d8d00f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:33:07.184842 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f1c8310d-2fc2-49b9-8e44-2ac3c0d8d00f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:33:07.185289 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f1c8310d-2fc2-49b9-8e44-2ac3c0d8d00f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:33:07.186056 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f1c8310d-2fc2-49b9-8e44-2ac3c0d8d00f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:33:07.186487 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f1c8310d-2fc2-49b9-8e44-2ac3c0d8d00f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:33:07.246909 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-f1c8310d-2fc2-49b9-8e44-2ac3c0d8d00f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:33:07.254898 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-f1c8310d-2fc2-49b9-8e44-2ac3c0d8d00f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.080926 Nov 09 20:33:07.255458 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1068/2107] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:33:07 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:33:08.272162 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-532a4680-6e54-4109-a1d0-7092f4f46520 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:33:08.272794 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-532a4680-6e54-4109-a1d0-7092f4f46520 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:33:08.279483 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-532a4680-6e54-4109-a1d0-7092f4f46520 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:33:08.279918 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-532a4680-6e54-4109-a1d0-7092f4f46520 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:33:08.280722 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-532a4680-6e54-4109-a1d0-7092f4f46520 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:33:08.281150 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-532a4680-6e54-4109-a1d0-7092f4f46520 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:33:08.340950 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-532a4680-6e54-4109-a1d0-7092f4f46520 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:33:08.348582 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-532a4680-6e54-4109-a1d0-7092f4f46520 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.080047 Nov 09 20:33:08.349138 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1040/2108] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:33:08 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:33:09.365092 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-387156e1-ef70-405d-bfde-2cdd1965c219 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:33:09.365674 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-387156e1-ef70-405d-bfde-2cdd1965c219 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:33:09.373030 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-387156e1-ef70-405d-bfde-2cdd1965c219 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:33:09.373471 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-387156e1-ef70-405d-bfde-2cdd1965c219 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:33:09.374229 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-387156e1-ef70-405d-bfde-2cdd1965c219 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:33:09.374657 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-387156e1-ef70-405d-bfde-2cdd1965c219 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:33:09.437337 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-387156e1-ef70-405d-bfde-2cdd1965c219 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:33:09.444926 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-387156e1-ef70-405d-bfde-2cdd1965c219 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.083465 Nov 09 20:33:09.445476 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1069/2109] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:33:09 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:33:10.461199 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-7ffa5aa5-a1bc-4dd9-be43-112aaa13b4b2 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:33:10.461851 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-7ffa5aa5-a1bc-4dd9-be43-112aaa13b4b2 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:33:10.468554 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7ffa5aa5-a1bc-4dd9-be43-112aaa13b4b2 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:33:10.469002 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7ffa5aa5-a1bc-4dd9-be43-112aaa13b4b2 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:33:10.469766 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7ffa5aa5-a1bc-4dd9-be43-112aaa13b4b2 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:33:10.470198 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7ffa5aa5-a1bc-4dd9-be43-112aaa13b4b2 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:33:10.529466 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-7ffa5aa5-a1bc-4dd9-be43-112aaa13b4b2 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:33:10.537091 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-7ffa5aa5-a1bc-4dd9-be43-112aaa13b4b2 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.079476 Nov 09 20:33:10.537587 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1041/2110] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:33:10 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:33:11.554007 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-a768a7f0-a523-4668-8f7e-f06ded96121a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:33:11.554531 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-a768a7f0-a523-4668-8f7e-f06ded96121a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:33:11.560921 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a768a7f0-a523-4668-8f7e-f06ded96121a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:33:11.561395 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a768a7f0-a523-4668-8f7e-f06ded96121a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:33:11.562172 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a768a7f0-a523-4668-8f7e-f06ded96121a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:33:11.562610 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a768a7f0-a523-4668-8f7e-f06ded96121a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:33:11.620718 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-a768a7f0-a523-4668-8f7e-f06ded96121a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:33:11.628755 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-a768a7f0-a523-4668-8f7e-f06ded96121a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.078409 Nov 09 20:33:11.629316 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1070/2111] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:33:11 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:33:12.646253 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-759e1442-82c7-48d9-8b6c-53dbcf6882ca tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:33:12.646868 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-759e1442-82c7-48d9-8b6c-53dbcf6882ca tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:33:12.653921 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-759e1442-82c7-48d9-8b6c-53dbcf6882ca tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:33:12.654406 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-759e1442-82c7-48d9-8b6c-53dbcf6882ca tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:33:12.655186 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-759e1442-82c7-48d9-8b6c-53dbcf6882ca tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:33:12.655638 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-759e1442-82c7-48d9-8b6c-53dbcf6882ca tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:33:12.715095 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-759e1442-82c7-48d9-8b6c-53dbcf6882ca tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:33:12.722644 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-759e1442-82c7-48d9-8b6c-53dbcf6882ca tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.080079 Nov 09 20:33:12.723201 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1042/2112] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:33:12 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:33:13.740174 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-d94787d9-bec4-43a2-aa08-3a1b0bb653cc tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:33:13.740792 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-d94787d9-bec4-43a2-aa08-3a1b0bb653cc tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:33:13.747574 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d94787d9-bec4-43a2-aa08-3a1b0bb653cc tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:33:13.748272 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d94787d9-bec4-43a2-aa08-3a1b0bb653cc tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:33:13.749133 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d94787d9-bec4-43a2-aa08-3a1b0bb653cc tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:33:13.749562 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d94787d9-bec4-43a2-aa08-3a1b0bb653cc tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:33:13.807332 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-d94787d9-bec4-43a2-aa08-3a1b0bb653cc tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:33:13.815710 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-d94787d9-bec4-43a2-aa08-3a1b0bb653cc tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.079169 Nov 09 20:33:13.816249 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1071/2113] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:33:13 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:33:14.832582 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-b553df9f-81b2-4bd3-9eab-774bbf2e8a42 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:33:14.833210 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-b553df9f-81b2-4bd3-9eab-774bbf2e8a42 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:33:14.840306 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b553df9f-81b2-4bd3-9eab-774bbf2e8a42 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:33:14.840794 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b553df9f-81b2-4bd3-9eab-774bbf2e8a42 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:33:14.841577 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b553df9f-81b2-4bd3-9eab-774bbf2e8a42 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:33:14.842015 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b553df9f-81b2-4bd3-9eab-774bbf2e8a42 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:33:14.902820 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-b553df9f-81b2-4bd3-9eab-774bbf2e8a42 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:33:14.910477 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-b553df9f-81b2-4bd3-9eab-774bbf2e8a42 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.081545 Nov 09 20:33:14.911037 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1043/2114] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:33:14 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:33:15.926747 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-5a318757-e94a-4588-a896-e6f6b4c3a10e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:33:15.927339 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-5a318757-e94a-4588-a896-e6f6b4c3a10e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:33:15.933295 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-5a318757-e94a-4588-a896-e6f6b4c3a10e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:33:15.933730 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-5a318757-e94a-4588-a896-e6f6b4c3a10e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:33:15.934487 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-5a318757-e94a-4588-a896-e6f6b4c3a10e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:33:15.934919 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-5a318757-e94a-4588-a896-e6f6b4c3a10e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:33:15.996856 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-5a318757-e94a-4588-a896-e6f6b4c3a10e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:33:16.004683 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-5a318757-e94a-4588-a896-e6f6b4c3a10e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.081520 Nov 09 20:33:16.005237 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1072/2115] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:33:15 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:33:17.022046 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-a81b587d-3e25-4690-88d0-97f6b88e98ab tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:33:17.022670 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-a81b587d-3e25-4690-88d0-97f6b88e98ab tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:33:17.029094 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a81b587d-3e25-4690-88d0-97f6b88e98ab tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:33:17.029538 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a81b587d-3e25-4690-88d0-97f6b88e98ab tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:33:17.030301 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a81b587d-3e25-4690-88d0-97f6b88e98ab tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:33:17.030732 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a81b587d-3e25-4690-88d0-97f6b88e98ab tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:33:17.090022 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-a81b587d-3e25-4690-88d0-97f6b88e98ab tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:33:17.097676 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-a81b587d-3e25-4690-88d0-97f6b88e98ab tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.079237 Nov 09 20:33:17.098231 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1044/2116] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:33:17 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:33:18.114730 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-939cfe7d-d3c1-4e89-ad89-035549e7b290 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:33:18.115363 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-939cfe7d-d3c1-4e89-ad89-035549e7b290 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:33:18.122301 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-939cfe7d-d3c1-4e89-ad89-035549e7b290 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:33:18.122747 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-939cfe7d-d3c1-4e89-ad89-035549e7b290 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:33:18.123769 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-939cfe7d-d3c1-4e89-ad89-035549e7b290 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:33:18.124203 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-939cfe7d-d3c1-4e89-ad89-035549e7b290 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:33:18.183342 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-939cfe7d-d3c1-4e89-ad89-035549e7b290 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:33:18.191317 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-939cfe7d-d3c1-4e89-ad89-035549e7b290 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.080226 Nov 09 20:33:18.191889 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1073/2117] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:33:18 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:33:19.208653 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-b7af83e9-32eb-4893-89ae-d76974e4267a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:33:19.209256 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-b7af83e9-32eb-4893-89ae-d76974e4267a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:33:19.216174 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b7af83e9-32eb-4893-89ae-d76974e4267a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:33:19.216656 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b7af83e9-32eb-4893-89ae-d76974e4267a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:33:19.217427 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b7af83e9-32eb-4893-89ae-d76974e4267a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:33:19.217861 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b7af83e9-32eb-4893-89ae-d76974e4267a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:33:19.279189 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-b7af83e9-32eb-4893-89ae-d76974e4267a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:33:19.287355 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-b7af83e9-32eb-4893-89ae-d76974e4267a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.082358 Nov 09 20:33:19.287914 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1045/2118] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:33:19 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:33:20.303273 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-b0e6f4ad-75fe-4f79-bac9-6dce18a9c352 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:33:20.303809 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-b0e6f4ad-75fe-4f79-bac9-6dce18a9c352 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:33:20.310926 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b0e6f4ad-75fe-4f79-bac9-6dce18a9c352 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:33:20.311368 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b0e6f4ad-75fe-4f79-bac9-6dce18a9c352 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:33:20.312133 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b0e6f4ad-75fe-4f79-bac9-6dce18a9c352 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:33:20.312598 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b0e6f4ad-75fe-4f79-bac9-6dce18a9c352 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:33:20.371199 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-b0e6f4ad-75fe-4f79-bac9-6dce18a9c352 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:33:20.379290 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-b0e6f4ad-75fe-4f79-bac9-6dce18a9c352 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.079771 Nov 09 20:33:20.379843 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1074/2119] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:33:20 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:33:21.396672 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-088aba5b-90ab-453d-856e-e6dc212790df tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:33:21.397405 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-088aba5b-90ab-453d-856e-e6dc212790df tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:33:21.404108 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-088aba5b-90ab-453d-856e-e6dc212790df tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:33:21.404577 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-088aba5b-90ab-453d-856e-e6dc212790df tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:33:21.405331 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-088aba5b-90ab-453d-856e-e6dc212790df tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:33:21.405753 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-088aba5b-90ab-453d-856e-e6dc212790df tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:33:21.462921 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-088aba5b-90ab-453d-856e-e6dc212790df tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:33:21.471118 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-088aba5b-90ab-453d-856e-e6dc212790df tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.078129 Nov 09 20:33:21.471665 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1046/2120] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:33:21 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:33:22.486775 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-1b28bbac-8d00-4f1b-a25f-2736e0b00b2d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:33:22.487382 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-1b28bbac-8d00-4f1b-a25f-2736e0b00b2d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:33:22.493541 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-1b28bbac-8d00-4f1b-a25f-2736e0b00b2d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:33:22.493983 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-1b28bbac-8d00-4f1b-a25f-2736e0b00b2d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:33:22.494770 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-1b28bbac-8d00-4f1b-a25f-2736e0b00b2d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:33:22.495747 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-1b28bbac-8d00-4f1b-a25f-2736e0b00b2d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:33:22.561789 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-1b28bbac-8d00-4f1b-a25f-2736e0b00b2d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:33:22.569540 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-1b28bbac-8d00-4f1b-a25f-2736e0b00b2d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.086432 Nov 09 20:33:22.570100 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1075/2121] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:33:22 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:33:23.586147 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-5cc34d88-f63d-4175-b448-6bb134662ece tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:33:23.586721 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-5cc34d88-f63d-4175-b448-6bb134662ece tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:33:23.593110 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5cc34d88-f63d-4175-b448-6bb134662ece tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:33:23.593554 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5cc34d88-f63d-4175-b448-6bb134662ece tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:33:23.594315 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5cc34d88-f63d-4175-b448-6bb134662ece tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:33:23.594760 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5cc34d88-f63d-4175-b448-6bb134662ece tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:33:23.654530 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-5cc34d88-f63d-4175-b448-6bb134662ece tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:33:23.662287 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-5cc34d88-f63d-4175-b448-6bb134662ece tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.079986 Nov 09 20:33:23.662843 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1047/2122] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:33:23 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:33:24.679212 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-c699178f-9b93-4f6a-b44b-8126abfbc6e1 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:33:24.679808 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-c699178f-9b93-4f6a-b44b-8126abfbc6e1 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:33:24.686726 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c699178f-9b93-4f6a-b44b-8126abfbc6e1 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:33:24.687167 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c699178f-9b93-4f6a-b44b-8126abfbc6e1 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:33:24.687931 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c699178f-9b93-4f6a-b44b-8126abfbc6e1 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:33:24.688383 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c699178f-9b93-4f6a-b44b-8126abfbc6e1 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:33:24.747039 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-c699178f-9b93-4f6a-b44b-8126abfbc6e1 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:33:24.755035 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-c699178f-9b93-4f6a-b44b-8126abfbc6e1 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.079465 Nov 09 20:33:24.755630 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1076/2123] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:33:24 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:33:25.772773 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-4fd8a6be-9284-44e6-b5f0-1efbe1cb1ee0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:33:25.773363 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-4fd8a6be-9284-44e6-b5f0-1efbe1cb1ee0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:33:25.780728 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4fd8a6be-9284-44e6-b5f0-1efbe1cb1ee0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:33:25.781176 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4fd8a6be-9284-44e6-b5f0-1efbe1cb1ee0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:33:25.781939 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4fd8a6be-9284-44e6-b5f0-1efbe1cb1ee0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:33:25.782374 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4fd8a6be-9284-44e6-b5f0-1efbe1cb1ee0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:33:25.841605 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-4fd8a6be-9284-44e6-b5f0-1efbe1cb1ee0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:33:25.849194 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-4fd8a6be-9284-44e6-b5f0-1efbe1cb1ee0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.080041 Nov 09 20:33:25.849762 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1048/2124] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:33:25 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:33:26.865352 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-a50d2abd-1430-40e3-9165-b6cd9d0f81a9 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:33:26.865959 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-a50d2abd-1430-40e3-9165-b6cd9d0f81a9 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:33:26.873361 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a50d2abd-1430-40e3-9165-b6cd9d0f81a9 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:33:26.873751 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a50d2abd-1430-40e3-9165-b6cd9d0f81a9 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:33:26.874520 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a50d2abd-1430-40e3-9165-b6cd9d0f81a9 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:33:26.874955 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a50d2abd-1430-40e3-9165-b6cd9d0f81a9 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:33:26.933805 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-a50d2abd-1430-40e3-9165-b6cd9d0f81a9 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:33:26.941339 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-a50d2abd-1430-40e3-9165-b6cd9d0f81a9 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.079632 Nov 09 20:33:26.941893 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1077/2125] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:33:26 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:33:27.957513 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-ce1e92da-22a9-4355-a3bc-3901069ec25f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:33:27.958121 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-ce1e92da-22a9-4355-a3bc-3901069ec25f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:33:27.964311 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ce1e92da-22a9-4355-a3bc-3901069ec25f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:33:27.964983 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ce1e92da-22a9-4355-a3bc-3901069ec25f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:33:27.965750 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ce1e92da-22a9-4355-a3bc-3901069ec25f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:33:27.966180 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ce1e92da-22a9-4355-a3bc-3901069ec25f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:33:28.027171 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-ce1e92da-22a9-4355-a3bc-3901069ec25f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:33:28.034802 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-ce1e92da-22a9-4355-a3bc-3901069ec25f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.081089 Nov 09 20:33:28.035370 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1049/2126] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:33:27 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:33:29.051867 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-1e825aaa-9808-40db-a9b2-c37e292f91a4 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:33:29.052475 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-1e825aaa-9808-40db-a9b2-c37e292f91a4 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:33:29.058803 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-1e825aaa-9808-40db-a9b2-c37e292f91a4 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:33:29.059239 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-1e825aaa-9808-40db-a9b2-c37e292f91a4 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:33:29.059993 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-1e825aaa-9808-40db-a9b2-c37e292f91a4 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:33:29.060437 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-1e825aaa-9808-40db-a9b2-c37e292f91a4 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:33:29.122270 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-1e825aaa-9808-40db-a9b2-c37e292f91a4 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:33:29.130209 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-1e825aaa-9808-40db-a9b2-c37e292f91a4 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.082030 Nov 09 20:33:29.130754 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1078/2127] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:33:29 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:33:30.147699 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-cce1df44-0c72-4e0a-8d62-40e13645bf84 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:33:30.148294 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-cce1df44-0c72-4e0a-8d62-40e13645bf84 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:33:30.155203 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cce1df44-0c72-4e0a-8d62-40e13645bf84 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:33:30.155666 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cce1df44-0c72-4e0a-8d62-40e13645bf84 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:33:30.156430 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cce1df44-0c72-4e0a-8d62-40e13645bf84 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:33:30.156867 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cce1df44-0c72-4e0a-8d62-40e13645bf84 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:33:30.214565 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-cce1df44-0c72-4e0a-8d62-40e13645bf84 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:33:30.222221 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-cce1df44-0c72-4e0a-8d62-40e13645bf84 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.078152 Nov 09 20:33:30.222782 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1050/2128] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:33:30 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:33:31.238850 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-997bf465-58d8-43b6-9193-d1d2e9d6d845 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:33:31.239477 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-997bf465-58d8-43b6-9193-d1d2e9d6d845 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:33:31.246386 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-997bf465-58d8-43b6-9193-d1d2e9d6d845 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:33:31.246822 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-997bf465-58d8-43b6-9193-d1d2e9d6d845 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:33:31.247578 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-997bf465-58d8-43b6-9193-d1d2e9d6d845 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:33:31.248258 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-997bf465-58d8-43b6-9193-d1d2e9d6d845 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:33:31.309005 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-997bf465-58d8-43b6-9193-d1d2e9d6d845 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:33:31.316682 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-997bf465-58d8-43b6-9193-d1d2e9d6d845 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.081482 Nov 09 20:33:31.317246 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1079/2129] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:33:31 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:33:32.333944 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-257950f7-9bf6-47d6-8268-2501245b29af tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:33:32.334555 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-257950f7-9bf6-47d6-8268-2501245b29af tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:33:32.341891 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-257950f7-9bf6-47d6-8268-2501245b29af tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:33:32.342399 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-257950f7-9bf6-47d6-8268-2501245b29af tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:33:32.343084 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-257950f7-9bf6-47d6-8268-2501245b29af tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:33:32.343517 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-257950f7-9bf6-47d6-8268-2501245b29af tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:33:32.403482 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-257950f7-9bf6-47d6-8268-2501245b29af tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:33:32.411117 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-257950f7-9bf6-47d6-8268-2501245b29af tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.080799 Nov 09 20:33:32.411675 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1051/2130] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:33:32 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:33:33.428724 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-d441a42c-f3d2-4f7d-b58b-db5d8d024df2 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:33:33.429331 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-d441a42c-f3d2-4f7d-b58b-db5d8d024df2 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:33:33.435601 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d441a42c-f3d2-4f7d-b58b-db5d8d024df2 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:33:33.436048 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d441a42c-f3d2-4f7d-b58b-db5d8d024df2 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:33:33.436838 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d441a42c-f3d2-4f7d-b58b-db5d8d024df2 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:33:33.437273 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d441a42c-f3d2-4f7d-b58b-db5d8d024df2 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:33:33.494873 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-d441a42c-f3d2-4f7d-b58b-db5d8d024df2 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:33:33.502948 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-d441a42c-f3d2-4f7d-b58b-db5d8d024df2 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.077688 Nov 09 20:33:33.503518 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1080/2131] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:33:33 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:33:34.520483 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-366476f4-94d5-4e03-917e-1f28f7659333 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:33:34.521086 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-366476f4-94d5-4e03-917e-1f28f7659333 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:33:34.527997 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-366476f4-94d5-4e03-917e-1f28f7659333 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:33:34.528458 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-366476f4-94d5-4e03-917e-1f28f7659333 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:33:34.529217 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-366476f4-94d5-4e03-917e-1f28f7659333 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:33:34.529642 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-366476f4-94d5-4e03-917e-1f28f7659333 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:33:34.587233 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-366476f4-94d5-4e03-917e-1f28f7659333 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:33:34.595963 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-366476f4-94d5-4e03-917e-1f28f7659333 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.079168 Nov 09 20:33:34.596546 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1052/2132] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:33:34 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:33:35.613034 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-22602b62-93ed-464f-9fac-86b48d614e29 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:33:35.613642 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-22602b62-93ed-464f-9fac-86b48d614e29 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:33:35.620696 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-22602b62-93ed-464f-9fac-86b48d614e29 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:33:35.621186 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-22602b62-93ed-464f-9fac-86b48d614e29 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:33:35.621950 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-22602b62-93ed-464f-9fac-86b48d614e29 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:33:35.622380 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-22602b62-93ed-464f-9fac-86b48d614e29 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:33:35.686147 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-22602b62-93ed-464f-9fac-86b48d614e29 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:33:35.693808 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-22602b62-93ed-464f-9fac-86b48d614e29 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.084415 Nov 09 20:33:35.694369 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1081/2133] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:33:35 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:33:36.710283 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-038e6acf-c5ce-4c38-9e16-ce446bc6d6a7 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:33:36.710881 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-038e6acf-c5ce-4c38-9e16-ce446bc6d6a7 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:33:36.717204 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-038e6acf-c5ce-4c38-9e16-ce446bc6d6a7 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:33:36.717642 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-038e6acf-c5ce-4c38-9e16-ce446bc6d6a7 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:33:36.718400 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-038e6acf-c5ce-4c38-9e16-ce446bc6d6a7 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:33:36.718825 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-038e6acf-c5ce-4c38-9e16-ce446bc6d6a7 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:33:36.777853 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-038e6acf-c5ce-4c38-9e16-ce446bc6d6a7 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:33:36.785435 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-038e6acf-c5ce-4c38-9e16-ce446bc6d6a7 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.078786 Nov 09 20:33:36.785994 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1053/2134] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:33:36 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:33:37.802081 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-902c35ba-99d7-414a-942d-a8f108828158 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:33:37.802680 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-902c35ba-99d7-414a-942d-a8f108828158 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:33:37.809136 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-902c35ba-99d7-414a-942d-a8f108828158 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:33:37.809585 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-902c35ba-99d7-414a-942d-a8f108828158 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:33:37.810354 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-902c35ba-99d7-414a-942d-a8f108828158 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:33:37.810788 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-902c35ba-99d7-414a-942d-a8f108828158 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:33:37.868660 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-902c35ba-99d7-414a-942d-a8f108828158 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:33:37.876682 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-902c35ba-99d7-414a-942d-a8f108828158 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.078177 Nov 09 20:33:37.877239 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1082/2135] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:33:37 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:33:38.894826 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-b4481751-f084-4058-b535-32fbfd825a0d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:33:38.895467 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-b4481751-f084-4058-b535-32fbfd825a0d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:33:38.902439 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b4481751-f084-4058-b535-32fbfd825a0d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:33:38.902959 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b4481751-f084-4058-b535-32fbfd825a0d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:33:38.903732 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b4481751-f084-4058-b535-32fbfd825a0d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:33:38.904167 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b4481751-f084-4058-b535-32fbfd825a0d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:33:38.963430 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-b4481751-f084-4058-b535-32fbfd825a0d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:33:38.971724 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-b4481751-f084-4058-b535-32fbfd825a0d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.081370 Nov 09 20:33:38.972281 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1054/2136] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:33:38 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:33:39.988913 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-3d9924ac-7e43-4a45-8d25-a20335b6fbff tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:33:39.989595 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-3d9924ac-7e43-4a45-8d25-a20335b6fbff tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:33:39.996568 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-3d9924ac-7e43-4a45-8d25-a20335b6fbff tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:33:39.997017 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-3d9924ac-7e43-4a45-8d25-a20335b6fbff tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:33:39.997791 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-3d9924ac-7e43-4a45-8d25-a20335b6fbff tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:33:39.998497 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-3d9924ac-7e43-4a45-8d25-a20335b6fbff tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:33:40.055742 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-3d9924ac-7e43-4a45-8d25-a20335b6fbff tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:33:40.064151 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-3d9924ac-7e43-4a45-8d25-a20335b6fbff tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.078913 Nov 09 20:33:40.064746 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1083/2137] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:33:39 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:33:41.080314 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-ee28ca1a-ea92-483c-87e5-a7c40d8d2b67 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:33:41.080954 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-ee28ca1a-ea92-483c-87e5-a7c40d8d2b67 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:33:41.087078 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ee28ca1a-ea92-483c-87e5-a7c40d8d2b67 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:33:41.087517 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ee28ca1a-ea92-483c-87e5-a7c40d8d2b67 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:33:41.088276 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ee28ca1a-ea92-483c-87e5-a7c40d8d2b67 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:33:41.089334 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ee28ca1a-ea92-483c-87e5-a7c40d8d2b67 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:33:41.146965 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-ee28ca1a-ea92-483c-87e5-a7c40d8d2b67 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:33:41.154621 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-ee28ca1a-ea92-483c-87e5-a7c40d8d2b67 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.077930 Nov 09 20:33:41.155175 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1055/2138] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:33:41 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:33:42.171620 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-74c08552-174e-4145-aba4-effe14899936 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:33:42.172217 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-74c08552-174e-4145-aba4-effe14899936 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:33:42.178455 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-74c08552-174e-4145-aba4-effe14899936 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:33:42.178896 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-74c08552-174e-4145-aba4-effe14899936 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:33:42.179648 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-74c08552-174e-4145-aba4-effe14899936 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:33:42.180072 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-74c08552-174e-4145-aba4-effe14899936 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:33:42.242568 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-74c08552-174e-4145-aba4-effe14899936 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:33:42.250705 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-74c08552-174e-4145-aba4-effe14899936 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.083555 Nov 09 20:33:42.251276 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1084/2139] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:33:42 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:33:43.267080 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-a8882cf6-3cc4-466d-ba08-e755dd7d125d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:33:43.267710 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-a8882cf6-3cc4-466d-ba08-e755dd7d125d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:33:43.273898 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a8882cf6-3cc4-466d-ba08-e755dd7d125d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:33:43.274336 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a8882cf6-3cc4-466d-ba08-e755dd7d125d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:33:43.275091 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a8882cf6-3cc4-466d-ba08-e755dd7d125d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:33:43.275512 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a8882cf6-3cc4-466d-ba08-e755dd7d125d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:33:43.335236 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-a8882cf6-3cc4-466d-ba08-e755dd7d125d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:33:43.342934 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-a8882cf6-3cc4-466d-ba08-e755dd7d125d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.079483 Nov 09 20:33:43.343490 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1056/2140] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:33:43 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:33:44.359160 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-fd58c896-0395-409b-9bd1-c942ca7c9d26 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:33:44.359757 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-fd58c896-0395-409b-9bd1-c942ca7c9d26 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:33:44.365948 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-fd58c896-0395-409b-9bd1-c942ca7c9d26 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:33:44.366387 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-fd58c896-0395-409b-9bd1-c942ca7c9d26 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:33:44.367146 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-fd58c896-0395-409b-9bd1-c942ca7c9d26 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:33:44.367570 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-fd58c896-0395-409b-9bd1-c942ca7c9d26 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:33:44.426323 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-fd58c896-0395-409b-9bd1-c942ca7c9d26 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:33:44.434527 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-fd58c896-0395-409b-9bd1-c942ca7c9d26 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.079044 Nov 09 20:33:44.435093 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1085/2141] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:33:44 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 20:33:45.451481 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-c3f12e24-32fc-4dce-96ab-21bb2d3f7718 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:33:45.452118 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-c3f12e24-32fc-4dce-96ab-21bb2d3f7718 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:33:45.458373 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c3f12e24-32fc-4dce-96ab-21bb2d3f7718 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:33:45.458820 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c3f12e24-32fc-4dce-96ab-21bb2d3f7718 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:33:45.459590 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c3f12e24-32fc-4dce-96ab-21bb2d3f7718 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:33:45.460021 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c3f12e24-32fc-4dce-96ab-21bb2d3f7718 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:33:45.519984 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-c3f12e24-32fc-4dce-96ab-21bb2d3f7718 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:33:45.528695 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-c3f12e24-32fc-4dce-96ab-21bb2d3f7718 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.081758 Nov 09 20:33:45.529253 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1057/2142] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:33:45 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:33:46.546070 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-fc6c8a42-b46e-48c1-9891-d9de85f81146 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:33:46.546613 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-fc6c8a42-b46e-48c1-9891-d9de85f81146 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:33:46.552556 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-fc6c8a42-b46e-48c1-9891-d9de85f81146 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:33:46.552885 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-fc6c8a42-b46e-48c1-9891-d9de85f81146 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:33:46.553651 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-fc6c8a42-b46e-48c1-9891-d9de85f81146 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:33:46.554083 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-fc6c8a42-b46e-48c1-9891-d9de85f81146 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:33:46.611709 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-fc6c8a42-b46e-48c1-9891-d9de85f81146 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:33:46.619444 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-fc6c8a42-b46e-48c1-9891-d9de85f81146 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.077986 Nov 09 20:33:46.620041 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1086/2143] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:33:46 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:33:47.636346 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-00fd7ff7-a737-4d83-b8c3-9bf1bee05033 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:33:47.637033 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-00fd7ff7-a737-4d83-b8c3-9bf1bee05033 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:33:47.643173 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-00fd7ff7-a737-4d83-b8c3-9bf1bee05033 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:33:47.643611 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-00fd7ff7-a737-4d83-b8c3-9bf1bee05033 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:33:47.644361 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-00fd7ff7-a737-4d83-b8c3-9bf1bee05033 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:33:47.644810 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-00fd7ff7-a737-4d83-b8c3-9bf1bee05033 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:33:47.702543 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-00fd7ff7-a737-4d83-b8c3-9bf1bee05033 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:33:47.710080 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-00fd7ff7-a737-4d83-b8c3-9bf1bee05033 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.077856 Nov 09 20:33:47.710633 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1058/2144] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:33:47 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:33:48.727581 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-6e480993-d187-484c-805f-82388dfea5cc tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:33:48.728160 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-6e480993-d187-484c-805f-82388dfea5cc tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:33:48.735169 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6e480993-d187-484c-805f-82388dfea5cc tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:33:48.735609 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6e480993-d187-484c-805f-82388dfea5cc tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:33:48.736363 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6e480993-d187-484c-805f-82388dfea5cc tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:33:48.736807 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6e480993-d187-484c-805f-82388dfea5cc tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:33:48.799167 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-6e480993-d187-484c-805f-82388dfea5cc tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:33:48.806720 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-6e480993-d187-484c-805f-82388dfea5cc tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.082761 Nov 09 20:33:48.807272 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1087/2145] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:33:48 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:33:49.823738 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-bb46dd97-b09c-46ae-9c1c-1677d47c1869 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:33:49.824381 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-bb46dd97-b09c-46ae-9c1c-1677d47c1869 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:33:49.830556 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bb46dd97-b09c-46ae-9c1c-1677d47c1869 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:33:49.830996 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bb46dd97-b09c-46ae-9c1c-1677d47c1869 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:33:49.831753 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bb46dd97-b09c-46ae-9c1c-1677d47c1869 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:33:49.832180 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bb46dd97-b09c-46ae-9c1c-1677d47c1869 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:33:49.891995 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-bb46dd97-b09c-46ae-9c1c-1677d47c1869 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:33:49.899665 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-bb46dd97-b09c-46ae-9c1c-1677d47c1869 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.080041 Nov 09 20:33:49.900217 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1059/2146] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:33:49 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:33:50.917565 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-b6a2cfe8-f48b-4e09-955e-4b8fea012840 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:33:50.918179 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-b6a2cfe8-f48b-4e09-955e-4b8fea012840 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:33:50.924373 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b6a2cfe8-f48b-4e09-955e-4b8fea012840 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:33:50.924849 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b6a2cfe8-f48b-4e09-955e-4b8fea012840 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:33:50.925620 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b6a2cfe8-f48b-4e09-955e-4b8fea012840 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:33:50.926051 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b6a2cfe8-f48b-4e09-955e-4b8fea012840 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:33:50.986269 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-b6a2cfe8-f48b-4e09-955e-4b8fea012840 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:33:50.993805 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-b6a2cfe8-f48b-4e09-955e-4b8fea012840 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.080491 Nov 09 20:33:50.994357 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1088/2147] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:33:50 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:33:52.011615 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-eb062b29-5d9d-4b65-b2cd-8c07063318ae tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:33:52.012218 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-eb062b29-5d9d-4b65-b2cd-8c07063318ae tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:33:52.018413 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-eb062b29-5d9d-4b65-b2cd-8c07063318ae tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:33:52.018852 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-eb062b29-5d9d-4b65-b2cd-8c07063318ae tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:33:52.019615 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-eb062b29-5d9d-4b65-b2cd-8c07063318ae tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:33:52.020070 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-eb062b29-5d9d-4b65-b2cd-8c07063318ae tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:33:52.078622 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-eb062b29-5d9d-4b65-b2cd-8c07063318ae tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:33:52.086137 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-eb062b29-5d9d-4b65-b2cd-8c07063318ae tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.078691 Nov 09 20:33:52.086697 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1060/2148] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:33:52 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:33:53.102481 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-3d8a5037-becf-44e6-8e34-2835ccc18d2f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:33:53.103085 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-3d8a5037-becf-44e6-8e34-2835ccc18d2f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:33:53.109933 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-3d8a5037-becf-44e6-8e34-2835ccc18d2f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:33:53.110446 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-3d8a5037-becf-44e6-8e34-2835ccc18d2f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:33:53.111210 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-3d8a5037-becf-44e6-8e34-2835ccc18d2f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:33:53.111643 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-3d8a5037-becf-44e6-8e34-2835ccc18d2f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:33:53.169472 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-3d8a5037-becf-44e6-8e34-2835ccc18d2f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:33:53.177261 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-3d8a5037-becf-44e6-8e34-2835ccc18d2f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.078400 Nov 09 20:33:53.178154 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1089/2149] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:33:53 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:33:54.194341 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-46405bf1-e9cb-4ba6-a70a-5324b6529865 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:33:54.194949 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-46405bf1-e9cb-4ba6-a70a-5324b6529865 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:33:54.201233 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-46405bf1-e9cb-4ba6-a70a-5324b6529865 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:33:54.201677 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-46405bf1-e9cb-4ba6-a70a-5324b6529865 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:33:54.202437 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-46405bf1-e9cb-4ba6-a70a-5324b6529865 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:33:54.202861 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-46405bf1-e9cb-4ba6-a70a-5324b6529865 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:33:54.262114 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-46405bf1-e9cb-4ba6-a70a-5324b6529865 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:33:54.270196 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-46405bf1-e9cb-4ba6-a70a-5324b6529865 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.079435 Nov 09 20:33:54.270763 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1061/2150] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:33:54 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:33:55.290004 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-cc46746d-122f-4efb-8613-9d83aaad779f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:33:55.290655 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-cc46746d-122f-4efb-8613-9d83aaad779f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:33:55.297607 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-cc46746d-122f-4efb-8613-9d83aaad779f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:33:55.298050 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-cc46746d-122f-4efb-8613-9d83aaad779f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:33:55.298924 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-cc46746d-122f-4efb-8613-9d83aaad779f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:33:55.299358 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-cc46746d-122f-4efb-8613-9d83aaad779f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:33:55.360743 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-cc46746d-122f-4efb-8613-9d83aaad779f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:33:55.368460 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-cc46746d-122f-4efb-8613-9d83aaad779f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.082029 Nov 09 20:33:55.369018 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1090/2151] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:33:55 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:33:56.385706 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-492d74b0-af75-4a8f-af2f-b46ade1577d0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:33:56.386341 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-492d74b0-af75-4a8f-af2f-b46ade1577d0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:33:56.392154 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-492d74b0-af75-4a8f-af2f-b46ade1577d0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:33:56.392642 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-492d74b0-af75-4a8f-af2f-b46ade1577d0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:33:56.393493 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-492d74b0-af75-4a8f-af2f-b46ade1577d0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:33:56.393923 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-492d74b0-af75-4a8f-af2f-b46ade1577d0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:33:56.454178 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-492d74b0-af75-4a8f-af2f-b46ade1577d0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:33:56.461738 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-492d74b0-af75-4a8f-af2f-b46ade1577d0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.079985 Nov 09 20:33:56.462292 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1062/2152] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:33:56 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:33:57.478265 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-2d624153-2b9d-44bc-a0da-b64639b03a2a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:33:57.478862 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-2d624153-2b9d-44bc-a0da-b64639b03a2a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:33:57.485160 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-2d624153-2b9d-44bc-a0da-b64639b03a2a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:33:57.485600 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-2d624153-2b9d-44bc-a0da-b64639b03a2a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:33:57.486355 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-2d624153-2b9d-44bc-a0da-b64639b03a2a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:33:57.486811 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-2d624153-2b9d-44bc-a0da-b64639b03a2a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:33:57.545670 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-2d624153-2b9d-44bc-a0da-b64639b03a2a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:33:57.553422 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-2d624153-2b9d-44bc-a0da-b64639b03a2a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.078832 Nov 09 20:33:57.553988 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1091/2153] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:33:57 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:33:58.570501 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-37df1f02-1f44-4167-8535-20d4a4873e41 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:33:58.571038 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-37df1f02-1f44-4167-8535-20d4a4873e41 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:33:58.578160 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-37df1f02-1f44-4167-8535-20d4a4873e41 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:33:58.578603 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-37df1f02-1f44-4167-8535-20d4a4873e41 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:33:58.579365 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-37df1f02-1f44-4167-8535-20d4a4873e41 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:33:58.579791 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-37df1f02-1f44-4167-8535-20d4a4873e41 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:33:58.639292 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-37df1f02-1f44-4167-8535-20d4a4873e41 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:33:58.646967 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-37df1f02-1f44-4167-8535-20d4a4873e41 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.080234 Nov 09 20:33:58.647524 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1063/2154] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:33:58 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:33:59.664674 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-e95020e7-623d-4cb3-b5e3-7269c07553f8 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:33:59.665279 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-e95020e7-623d-4cb3-b5e3-7269c07553f8 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:33:59.672631 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e95020e7-623d-4cb3-b5e3-7269c07553f8 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:33:59.673076 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e95020e7-623d-4cb3-b5e3-7269c07553f8 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:33:59.673852 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e95020e7-623d-4cb3-b5e3-7269c07553f8 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:33:59.674287 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e95020e7-623d-4cb3-b5e3-7269c07553f8 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:33:59.736828 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-e95020e7-623d-4cb3-b5e3-7269c07553f8 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:33:59.744829 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-e95020e7-623d-4cb3-b5e3-7269c07553f8 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.083787 Nov 09 20:33:59.745451 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1092/2155] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:33:59 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:34:00.762026 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-67101014-a7b0-42e1-9d79-debe4cc70bf0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:34:00.762614 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-67101014-a7b0-42e1-9d79-debe4cc70bf0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:34:00.768964 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-67101014-a7b0-42e1-9d79-debe4cc70bf0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:34:00.769409 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-67101014-a7b0-42e1-9d79-debe4cc70bf0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:34:00.770172 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-67101014-a7b0-42e1-9d79-debe4cc70bf0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:34:00.770599 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-67101014-a7b0-42e1-9d79-debe4cc70bf0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:34:00.829119 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-67101014-a7b0-42e1-9d79-debe4cc70bf0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:34:00.836633 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-67101014-a7b0-42e1-9d79-debe4cc70bf0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.078217 Nov 09 20:34:00.837192 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1064/2156] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:34:00 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:34:01.853488 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-de28e4f3-3013-4e6e-ae0e-8a12fb44498f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:34:01.854100 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-de28e4f3-3013-4e6e-ae0e-8a12fb44498f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:34:01.860475 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-de28e4f3-3013-4e6e-ae0e-8a12fb44498f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:34:01.860923 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-de28e4f3-3013-4e6e-ae0e-8a12fb44498f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:34:01.861701 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-de28e4f3-3013-4e6e-ae0e-8a12fb44498f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:34:01.862121 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-de28e4f3-3013-4e6e-ae0e-8a12fb44498f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:34:01.924317 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-de28e4f3-3013-4e6e-ae0e-8a12fb44498f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:34:01.931979 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-de28e4f3-3013-4e6e-ae0e-8a12fb44498f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.082209 Nov 09 20:34:01.933217 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1093/2157] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:34:01 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:34:02.949676 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-f02e4205-a90e-4b24-ba83-a48d3e12cc7f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:34:02.950270 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-f02e4205-a90e-4b24-ba83-a48d3e12cc7f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:34:02.956599 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f02e4205-a90e-4b24-ba83-a48d3e12cc7f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:34:02.957050 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f02e4205-a90e-4b24-ba83-a48d3e12cc7f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:34:02.957822 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f02e4205-a90e-4b24-ba83-a48d3e12cc7f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:34:02.958257 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f02e4205-a90e-4b24-ba83-a48d3e12cc7f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:34:03.017274 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-f02e4205-a90e-4b24-ba83-a48d3e12cc7f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:34:03.024851 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-f02e4205-a90e-4b24-ba83-a48d3e12cc7f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.079438 Nov 09 20:34:03.025439 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1065/2158] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:34:02 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:34:04.042765 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-4e0f1c1d-fa3d-4961-9b4a-143ff0ba0d8d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:34:04.043379 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-4e0f1c1d-fa3d-4961-9b4a-143ff0ba0d8d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:34:04.049575 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-4e0f1c1d-fa3d-4961-9b4a-143ff0ba0d8d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:34:04.050018 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-4e0f1c1d-fa3d-4961-9b4a-143ff0ba0d8d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:34:04.050779 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-4e0f1c1d-fa3d-4961-9b4a-143ff0ba0d8d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:34:04.051208 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-4e0f1c1d-fa3d-4961-9b4a-143ff0ba0d8d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:34:04.109623 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-4e0f1c1d-fa3d-4961-9b4a-143ff0ba0d8d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:34:04.117193 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-4e0f1c1d-fa3d-4961-9b4a-143ff0ba0d8d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.078760 Nov 09 20:34:04.117745 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1094/2159] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:34:04 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:34:05.134225 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-bbe1a7e2-624e-4998-a8c3-d0ac52b5b8c3 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:34:05.134818 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-bbe1a7e2-624e-4998-a8c3-d0ac52b5b8c3 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:34:05.141675 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bbe1a7e2-624e-4998-a8c3-d0ac52b5b8c3 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:34:05.142125 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bbe1a7e2-624e-4998-a8c3-d0ac52b5b8c3 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:34:05.142898 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bbe1a7e2-624e-4998-a8c3-d0ac52b5b8c3 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:34:05.143332 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bbe1a7e2-624e-4998-a8c3-d0ac52b5b8c3 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:34:05.201949 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-bbe1a7e2-624e-4998-a8c3-d0ac52b5b8c3 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:34:05.209864 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-bbe1a7e2-624e-4998-a8c3-d0ac52b5b8c3 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.079462 Nov 09 20:34:05.210437 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1066/2160] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:34:05 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:34:06.226852 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-a60719f8-e09b-49a1-b7b3-3d028cbcb111 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:34:06.227440 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-a60719f8-e09b-49a1-b7b3-3d028cbcb111 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:34:06.233765 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a60719f8-e09b-49a1-b7b3-3d028cbcb111 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:34:06.234205 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a60719f8-e09b-49a1-b7b3-3d028cbcb111 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:34:06.234962 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a60719f8-e09b-49a1-b7b3-3d028cbcb111 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:34:06.235384 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a60719f8-e09b-49a1-b7b3-3d028cbcb111 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:34:06.296193 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-a60719f8-e09b-49a1-b7b3-3d028cbcb111 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:34:06.304143 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-a60719f8-e09b-49a1-b7b3-3d028cbcb111 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.080950 Nov 09 20:34:06.304777 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1095/2161] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:34:06 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:34:07.321875 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-71529598-8af7-41d1-8705-ed54c87cf3f7 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:34:07.322481 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-71529598-8af7-41d1-8705-ed54c87cf3f7 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:34:07.328675 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-71529598-8af7-41d1-8705-ed54c87cf3f7 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:34:07.329129 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-71529598-8af7-41d1-8705-ed54c87cf3f7 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:34:07.329898 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-71529598-8af7-41d1-8705-ed54c87cf3f7 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:34:07.330327 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-71529598-8af7-41d1-8705-ed54c87cf3f7 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:34:07.388908 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-71529598-8af7-41d1-8705-ed54c87cf3f7 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:34:07.396591 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-71529598-8af7-41d1-8705-ed54c87cf3f7 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.078377 Nov 09 20:34:07.397160 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1067/2162] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:34:07 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:34:08.413802 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-86fd16cd-6d83-4da9-9b04-f69b22ad3d82 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:34:08.414398 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-86fd16cd-6d83-4da9-9b04-f69b22ad3d82 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:34:08.421254 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-86fd16cd-6d83-4da9-9b04-f69b22ad3d82 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:34:08.421697 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-86fd16cd-6d83-4da9-9b04-f69b22ad3d82 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:34:08.422451 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-86fd16cd-6d83-4da9-9b04-f69b22ad3d82 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:34:08.422875 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-86fd16cd-6d83-4da9-9b04-f69b22ad3d82 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:34:08.485005 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-86fd16cd-6d83-4da9-9b04-f69b22ad3d82 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:34:08.492645 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-86fd16cd-6d83-4da9-9b04-f69b22ad3d82 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.082529 Nov 09 20:34:08.493201 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1096/2163] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:34:08 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:34:09.510129 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-cb9c76f6-c30b-4212-b6e6-7dc359a0c7b6 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:34:09.511596 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-cb9c76f6-c30b-4212-b6e6-7dc359a0c7b6 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:34:09.517660 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cb9c76f6-c30b-4212-b6e6-7dc359a0c7b6 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:34:09.518112 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cb9c76f6-c30b-4212-b6e6-7dc359a0c7b6 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:34:09.518884 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cb9c76f6-c30b-4212-b6e6-7dc359a0c7b6 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:34:09.519322 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cb9c76f6-c30b-4212-b6e6-7dc359a0c7b6 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:34:09.578619 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-cb9c76f6-c30b-4212-b6e6-7dc359a0c7b6 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:34:09.586621 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-cb9c76f6-c30b-4212-b6e6-7dc359a0c7b6 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.080167 Nov 09 20:34:09.587186 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1068/2164] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:34:09 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:34:10.602861 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-ec73a1ee-c3e3-4f62-87f6-eeb26d2eb4de tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:34:10.603477 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-ec73a1ee-c3e3-4f62-87f6-eeb26d2eb4de tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:34:10.609759 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ec73a1ee-c3e3-4f62-87f6-eeb26d2eb4de tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:34:10.610198 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ec73a1ee-c3e3-4f62-87f6-eeb26d2eb4de tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:34:10.610953 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ec73a1ee-c3e3-4f62-87f6-eeb26d2eb4de tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:34:10.611378 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ec73a1ee-c3e3-4f62-87f6-eeb26d2eb4de tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:34:10.669612 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-ec73a1ee-c3e3-4f62-87f6-eeb26d2eb4de tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:34:10.677167 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-ec73a1ee-c3e3-4f62-87f6-eeb26d2eb4de tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.078017 Nov 09 20:34:10.677752 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1097/2165] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:34:10 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:34:11.693992 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-ec5e6823-e043-4273-a922-80076f64d502 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:34:11.694601 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-ec5e6823-e043-4273-a922-80076f64d502 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:34:11.701673 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ec5e6823-e043-4273-a922-80076f64d502 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:34:11.702110 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ec5e6823-e043-4273-a922-80076f64d502 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:34:11.702865 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ec5e6823-e043-4273-a922-80076f64d502 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:34:11.703289 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ec5e6823-e043-4273-a922-80076f64d502 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:34:11.763162 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-ec5e6823-e043-4273-a922-80076f64d502 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:34:11.770691 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-ec5e6823-e043-4273-a922-80076f64d502 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.080368 Nov 09 20:34:11.771241 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1069/2166] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:34:11 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:34:12.787084 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-6c282eb3-d1c4-42f8-bcfb-58d1655ac5f0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:34:12.787664 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-6c282eb3-d1c4-42f8-bcfb-58d1655ac5f0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:34:12.794010 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6c282eb3-d1c4-42f8-bcfb-58d1655ac5f0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:34:12.794447 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6c282eb3-d1c4-42f8-bcfb-58d1655ac5f0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:34:12.795202 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6c282eb3-d1c4-42f8-bcfb-58d1655ac5f0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:34:12.795625 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6c282eb3-d1c4-42f8-bcfb-58d1655ac5f0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:34:12.854331 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-6c282eb3-d1c4-42f8-bcfb-58d1655ac5f0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:34:12.862055 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-6c282eb3-d1c4-42f8-bcfb-58d1655ac5f0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.078554 Nov 09 20:34:12.862617 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1098/2167] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:34:12 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:34:13.878155 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-d8492dad-485d-4453-9e16-44f6d0a3cc96 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:34:13.878836 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-d8492dad-485d-4453-9e16-44f6d0a3cc96 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:34:13.884909 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d8492dad-485d-4453-9e16-44f6d0a3cc96 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:34:13.885428 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d8492dad-485d-4453-9e16-44f6d0a3cc96 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:34:13.886704 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d8492dad-485d-4453-9e16-44f6d0a3cc96 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:34:13.887126 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d8492dad-485d-4453-9e16-44f6d0a3cc96 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:34:13.944279 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-d8492dad-485d-4453-9e16-44f6d0a3cc96 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:34:13.952387 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-d8492dad-485d-4453-9e16-44f6d0a3cc96 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.077920 Nov 09 20:34:13.952959 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1070/2168] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:34:13 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:34:14.969307 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-9aeb4f1d-0401-4ea1-8616-c54a4c265281 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:34:14.969909 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-9aeb4f1d-0401-4ea1-8616-c54a4c265281 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:34:14.976052 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-9aeb4f1d-0401-4ea1-8616-c54a4c265281 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:34:14.976534 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-9aeb4f1d-0401-4ea1-8616-c54a4c265281 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:34:14.977294 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-9aeb4f1d-0401-4ea1-8616-c54a4c265281 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:34:14.977720 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-9aeb4f1d-0401-4ea1-8616-c54a4c265281 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:34:15.040389 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-9aeb4f1d-0401-4ea1-8616-c54a4c265281 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:34:15.048105 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-9aeb4f1d-0401-4ea1-8616-c54a4c265281 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.082411 Nov 09 20:34:15.048696 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1099/2169] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:34:14 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:34:16.064619 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-f2a52dfe-6661-41a7-bd64-371be7d040b5 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:34:16.065224 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-f2a52dfe-6661-41a7-bd64-371be7d040b5 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:34:16.071393 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f2a52dfe-6661-41a7-bd64-371be7d040b5 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:34:16.071839 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f2a52dfe-6661-41a7-bd64-371be7d040b5 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:34:16.072633 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f2a52dfe-6661-41a7-bd64-371be7d040b5 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:34:16.073067 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f2a52dfe-6661-41a7-bd64-371be7d040b5 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:34:16.132031 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-f2a52dfe-6661-41a7-bd64-371be7d040b5 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:34:16.140082 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-f2a52dfe-6661-41a7-bd64-371be7d040b5 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.079105 Nov 09 20:34:16.140670 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1071/2170] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:34:16 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:34:17.157067 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-fec49ea9-4413-4a7f-8a13-4d574ace04b0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:34:17.157656 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-fec49ea9-4413-4a7f-8a13-4d574ace04b0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:34:17.163615 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-fec49ea9-4413-4a7f-8a13-4d574ace04b0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:34:17.164069 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-fec49ea9-4413-4a7f-8a13-4d574ace04b0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:34:17.164866 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-fec49ea9-4413-4a7f-8a13-4d574ace04b0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:34:17.165299 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-fec49ea9-4413-4a7f-8a13-4d574ace04b0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:34:17.224105 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-fec49ea9-4413-4a7f-8a13-4d574ace04b0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:34:17.232259 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-fec49ea9-4413-4a7f-8a13-4d574ace04b0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.079750 Nov 09 20:34:17.232841 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1100/2171] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:34:17 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:34:18.249523 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-b61cb6fe-4968-4e70-adac-2453295ee2a2 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:34:18.250122 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-b61cb6fe-4968-4e70-adac-2453295ee2a2 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:34:18.256377 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b61cb6fe-4968-4e70-adac-2453295ee2a2 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:34:18.256847 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b61cb6fe-4968-4e70-adac-2453295ee2a2 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:34:18.257617 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b61cb6fe-4968-4e70-adac-2453295ee2a2 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:34:18.258043 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b61cb6fe-4968-4e70-adac-2453295ee2a2 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:34:18.319996 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-b61cb6fe-4968-4e70-adac-2453295ee2a2 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:34:18.327617 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-b61cb6fe-4968-4e70-adac-2453295ee2a2 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.083056 Nov 09 20:34:18.328165 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1072/2172] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:34:18 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:34:19.343873 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-825645ad-c2c7-4255-bc1c-934f35aeaedb tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:34:19.344592 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-825645ad-c2c7-4255-bc1c-934f35aeaedb tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:34:19.351013 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-825645ad-c2c7-4255-bc1c-934f35aeaedb tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:34:19.351453 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-825645ad-c2c7-4255-bc1c-934f35aeaedb tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:34:19.352212 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-825645ad-c2c7-4255-bc1c-934f35aeaedb tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:34:19.352664 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-825645ad-c2c7-4255-bc1c-934f35aeaedb tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:34:19.412063 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-825645ad-c2c7-4255-bc1c-934f35aeaedb tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:34:19.420324 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-825645ad-c2c7-4255-bc1c-934f35aeaedb tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.080116 Nov 09 20:34:19.420905 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1101/2173] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:34:19 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:34:20.437007 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-da750c80-b6c1-4c4b-a201-2acd8e626a0e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:34:20.437643 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-da750c80-b6c1-4c4b-a201-2acd8e626a0e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:34:20.443851 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-da750c80-b6c1-4c4b-a201-2acd8e626a0e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:34:20.444296 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-da750c80-b6c1-4c4b-a201-2acd8e626a0e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:34:20.445089 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-da750c80-b6c1-4c4b-a201-2acd8e626a0e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:34:20.445519 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-da750c80-b6c1-4c4b-a201-2acd8e626a0e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:34:20.504336 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-da750c80-b6c1-4c4b-a201-2acd8e626a0e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:34:20.512670 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-da750c80-b6c1-4c4b-a201-2acd8e626a0e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.078631 Nov 09 20:34:20.513226 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1073/2174] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:34:20 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:34:21.530223 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-93ecbde8-cac3-4da0-85a0-952ef746b243 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:34:21.530863 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-93ecbde8-cac3-4da0-85a0-952ef746b243 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:34:21.537148 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-93ecbde8-cac3-4da0-85a0-952ef746b243 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:34:21.537530 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-93ecbde8-cac3-4da0-85a0-952ef746b243 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:34:21.538294 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-93ecbde8-cac3-4da0-85a0-952ef746b243 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:34:21.538724 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-93ecbde8-cac3-4da0-85a0-952ef746b243 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:34:21.601910 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-93ecbde8-cac3-4da0-85a0-952ef746b243 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:34:21.610138 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-93ecbde8-cac3-4da0-85a0-952ef746b243 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.084556 Nov 09 20:34:21.610694 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1102/2175] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:34:21 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:34:22.627957 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-3c922e3f-33d4-44c6-a016-b5c24b4c2193 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:34:22.628598 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-3c922e3f-33d4-44c6-a016-b5c24b4c2193 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:34:22.634789 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3c922e3f-33d4-44c6-a016-b5c24b4c2193 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:34:22.635236 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3c922e3f-33d4-44c6-a016-b5c24b4c2193 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:34:22.636003 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3c922e3f-33d4-44c6-a016-b5c24b4c2193 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:34:22.636461 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3c922e3f-33d4-44c6-a016-b5c24b4c2193 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:34:22.695459 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-3c922e3f-33d4-44c6-a016-b5c24b4c2193 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:34:22.703067 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-3c922e3f-33d4-44c6-a016-b5c24b4c2193 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.079055 Nov 09 20:34:22.703616 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1074/2176] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:34:22 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 20:34:23.718947 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-816d1637-20c6-45ca-ae02-18803d7e99fe tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:34:23.719551 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-816d1637-20c6-45ca-ae02-18803d7e99fe tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:34:23.725890 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-816d1637-20c6-45ca-ae02-18803d7e99fe tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:34:23.726331 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-816d1637-20c6-45ca-ae02-18803d7e99fe tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:34:23.727103 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-816d1637-20c6-45ca-ae02-18803d7e99fe tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:34:23.727534 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-816d1637-20c6-45ca-ae02-18803d7e99fe tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:34:23.786889 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-816d1637-20c6-45ca-ae02-18803d7e99fe tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:34:23.794730 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-816d1637-20c6-45ca-ae02-18803d7e99fe tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.079579 Nov 09 20:34:23.795285 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1103/2177] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:34:23 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:34:24.811575 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-0110d8d0-d2b7-45da-be1e-1c127276f5d9 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:34:24.812176 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-0110d8d0-d2b7-45da-be1e-1c127276f5d9 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:34:24.818407 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0110d8d0-d2b7-45da-be1e-1c127276f5d9 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:34:24.818849 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0110d8d0-d2b7-45da-be1e-1c127276f5d9 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:34:24.819600 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0110d8d0-d2b7-45da-be1e-1c127276f5d9 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:34:24.820058 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0110d8d0-d2b7-45da-be1e-1c127276f5d9 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:34:24.880126 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-0110d8d0-d2b7-45da-be1e-1c127276f5d9 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:34:24.888242 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-0110d8d0-d2b7-45da-be1e-1c127276f5d9 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.080677 Nov 09 20:34:24.888816 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1075/2178] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:34:24 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:34:25.650023 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 09 20:34:25.650600 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: Tue Nov 9 20:34:25 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 09 20:34:25.905337 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-c1cd3810-64d5-4ddf-8c2a-b22dd2e36b63 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:34:25.905860 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-c1cd3810-64d5-4ddf-8c2a-b22dd2e36b63 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:34:25.912061 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c1cd3810-64d5-4ddf-8c2a-b22dd2e36b63 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:34:25.912541 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c1cd3810-64d5-4ddf-8c2a-b22dd2e36b63 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:34:25.913305 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c1cd3810-64d5-4ddf-8c2a-b22dd2e36b63 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:34:25.913732 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c1cd3810-64d5-4ddf-8c2a-b22dd2e36b63 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:34:25.972507 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-c1cd3810-64d5-4ddf-8c2a-b22dd2e36b63 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:34:25.980125 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-c1cd3810-64d5-4ddf-8c2a-b22dd2e36b63 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.078698 Nov 09 20:34:25.981291 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1104/2179] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:34:25 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:34:26.997423 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-c4b21201-09c0-4342-a7a1-8cdae9cb94cb tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:34:26.997962 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-c4b21201-09c0-4342-a7a1-8cdae9cb94cb tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:34:27.003931 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c4b21201-09c0-4342-a7a1-8cdae9cb94cb tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:34:27.004373 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c4b21201-09c0-4342-a7a1-8cdae9cb94cb tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:34:27.005155 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c4b21201-09c0-4342-a7a1-8cdae9cb94cb tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:34:27.005577 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c4b21201-09c0-4342-a7a1-8cdae9cb94cb tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:34:27.063427 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-c4b21201-09c0-4342-a7a1-8cdae9cb94cb tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:34:27.070998 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-c4b21201-09c0-4342-a7a1-8cdae9cb94cb tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.077532 Nov 09 20:34:27.071556 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1076/2180] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:34:26 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:34:28.088165 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-bdf2f29d-9003-4ce4-9c4a-2c72225f47fa tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:34:28.088796 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-bdf2f29d-9003-4ce4-9c4a-2c72225f47fa tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:34:28.095608 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-bdf2f29d-9003-4ce4-9c4a-2c72225f47fa tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:34:28.096055 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-bdf2f29d-9003-4ce4-9c4a-2c72225f47fa tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:34:28.096850 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-bdf2f29d-9003-4ce4-9c4a-2c72225f47fa tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:34:28.097286 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-bdf2f29d-9003-4ce4-9c4a-2c72225f47fa tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:34:28.159241 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-bdf2f29d-9003-4ce4-9c4a-2c72225f47fa tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:34:28.166851 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-bdf2f29d-9003-4ce4-9c4a-2c72225f47fa tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.082337 Nov 09 20:34:28.167407 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1105/2181] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:34:28 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:34:29.184478 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-ed217106-d254-4bef-802e-a843bc0741f1 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:34:29.185165 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-ed217106-d254-4bef-802e-a843bc0741f1 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:34:29.191299 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ed217106-d254-4bef-802e-a843bc0741f1 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:34:29.191742 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ed217106-d254-4bef-802e-a843bc0741f1 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:34:29.192534 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ed217106-d254-4bef-802e-a843bc0741f1 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:34:29.192962 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ed217106-d254-4bef-802e-a843bc0741f1 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:34:29.251300 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-ed217106-d254-4bef-802e-a843bc0741f1 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:34:29.258952 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-ed217106-d254-4bef-802e-a843bc0741f1 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.078199 Nov 09 20:34:29.259515 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1077/2182] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:34:29 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:34:30.276233 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-be4eee64-b111-47c6-ac70-8c28187cd001 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:34:30.276969 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-be4eee64-b111-47c6-ac70-8c28187cd001 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:34:30.283330 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-be4eee64-b111-47c6-ac70-8c28187cd001 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:34:30.283811 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-be4eee64-b111-47c6-ac70-8c28187cd001 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:34:30.284640 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-be4eee64-b111-47c6-ac70-8c28187cd001 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:34:30.285069 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-be4eee64-b111-47c6-ac70-8c28187cd001 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:34:30.343236 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-be4eee64-b111-47c6-ac70-8c28187cd001 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:34:30.350838 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-be4eee64-b111-47c6-ac70-8c28187cd001 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.078239 Nov 09 20:34:30.351398 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1106/2183] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:34:30 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:34:31.367322 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-99319078-bc06-41b1-9233-f4260266b645 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:34:31.367924 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-99319078-bc06-41b1-9233-f4260266b645 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:34:31.374621 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-99319078-bc06-41b1-9233-f4260266b645 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:34:31.375065 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-99319078-bc06-41b1-9233-f4260266b645 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:34:31.375824 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-99319078-bc06-41b1-9233-f4260266b645 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:34:31.376255 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-99319078-bc06-41b1-9233-f4260266b645 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:34:31.435796 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-99319078-bc06-41b1-9233-f4260266b645 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:34:31.443463 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-99319078-bc06-41b1-9233-f4260266b645 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.079808 Nov 09 20:34:31.444021 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1078/2184] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:34:31 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:34:32.460588 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-b2eb2c6e-eb46-4e1a-8fb4-5fed5d726995 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:34:32.461199 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-b2eb2c6e-eb46-4e1a-8fb4-5fed5d726995 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:34:32.467894 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b2eb2c6e-eb46-4e1a-8fb4-5fed5d726995 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:34:32.468343 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b2eb2c6e-eb46-4e1a-8fb4-5fed5d726995 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:34:32.469133 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b2eb2c6e-eb46-4e1a-8fb4-5fed5d726995 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:34:32.469566 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b2eb2c6e-eb46-4e1a-8fb4-5fed5d726995 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:34:32.529065 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-b2eb2c6e-eb46-4e1a-8fb4-5fed5d726995 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:34:32.536771 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-b2eb2c6e-eb46-4e1a-8fb4-5fed5d726995 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.079696 Nov 09 20:34:32.537280 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1107/2185] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:34:32 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:34:33.553969 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-245333bc-904b-4e54-804a-6bb6a107fd10 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:34:33.554536 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-245333bc-904b-4e54-804a-6bb6a107fd10 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:34:33.560822 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-245333bc-904b-4e54-804a-6bb6a107fd10 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:34:33.561264 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-245333bc-904b-4e54-804a-6bb6a107fd10 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:34:33.562028 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-245333bc-904b-4e54-804a-6bb6a107fd10 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:34:33.562454 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-245333bc-904b-4e54-804a-6bb6a107fd10 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:34:33.620049 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-245333bc-904b-4e54-804a-6bb6a107fd10 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:34:33.628950 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-245333bc-904b-4e54-804a-6bb6a107fd10 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.078747 Nov 09 20:34:33.629503 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1079/2186] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:34:33 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:34:34.646404 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-54b04cc6-fd58-4861-9819-036c24b98d84 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:34:34.647001 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-54b04cc6-fd58-4861-9819-036c24b98d84 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:34:34.653521 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-54b04cc6-fd58-4861-9819-036c24b98d84 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:34:34.653959 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-54b04cc6-fd58-4861-9819-036c24b98d84 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:34:34.654814 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-54b04cc6-fd58-4861-9819-036c24b98d84 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:34:34.655299 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-54b04cc6-fd58-4861-9819-036c24b98d84 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:34:34.722679 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-54b04cc6-fd58-4861-9819-036c24b98d84 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:34:34.730996 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-54b04cc6-fd58-4861-9819-036c24b98d84 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.087645 Nov 09 20:34:34.731587 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1108/2187] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:34:34 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:34:35.747754 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-3cffb17c-2748-452f-8585-76cf171ff201 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:34:35.748356 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-3cffb17c-2748-452f-8585-76cf171ff201 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:34:35.754818 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3cffb17c-2748-452f-8585-76cf171ff201 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:34:35.755266 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3cffb17c-2748-452f-8585-76cf171ff201 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:34:35.756026 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3cffb17c-2748-452f-8585-76cf171ff201 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:34:35.756475 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3cffb17c-2748-452f-8585-76cf171ff201 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:34:35.816326 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-3cffb17c-2748-452f-8585-76cf171ff201 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:34:35.824040 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-3cffb17c-2748-452f-8585-76cf171ff201 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.080438 Nov 09 20:34:35.824623 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1080/2188] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:34:35 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:34:36.844001 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-219c83b8-dbfc-4b3c-96ba-5575ae858f8e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:34:36.844634 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-219c83b8-dbfc-4b3c-96ba-5575ae858f8e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:34:36.850866 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-219c83b8-dbfc-4b3c-96ba-5575ae858f8e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:34:36.851309 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-219c83b8-dbfc-4b3c-96ba-5575ae858f8e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:34:36.852072 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-219c83b8-dbfc-4b3c-96ba-5575ae858f8e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:34:36.852546 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-219c83b8-dbfc-4b3c-96ba-5575ae858f8e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:34:36.911187 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-219c83b8-dbfc-4b3c-96ba-5575ae858f8e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:34:36.918891 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-219c83b8-dbfc-4b3c-96ba-5575ae858f8e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.079264 Nov 09 20:34:36.919610 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1109/2189] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:34:36 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:34:37.261698 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 09 20:34:37.262230 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: Tue Nov 9 20:34:37 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 09 20:34:37.935415 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-c83899e0-e35d-49f9-9059-b1c3ae01eb1d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:34:37.936012 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-c83899e0-e35d-49f9-9059-b1c3ae01eb1d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:34:37.942493 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c83899e0-e35d-49f9-9059-b1c3ae01eb1d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:34:37.942934 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c83899e0-e35d-49f9-9059-b1c3ae01eb1d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:34:37.943691 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c83899e0-e35d-49f9-9059-b1c3ae01eb1d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:34:37.944113 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c83899e0-e35d-49f9-9059-b1c3ae01eb1d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:34:38.002630 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-c83899e0-e35d-49f9-9059-b1c3ae01eb1d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:34:38.010076 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-c83899e0-e35d-49f9-9059-b1c3ae01eb1d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.078343 Nov 09 20:34:38.010625 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1081/2190] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:34:37 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:34:39.026770 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-34b6de86-f06d-44e8-b432-4c709ad218af tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:34:39.027379 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-34b6de86-f06d-44e8-b432-4c709ad218af tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:34:39.033902 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-34b6de86-f06d-44e8-b432-4c709ad218af tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:34:39.034353 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-34b6de86-f06d-44e8-b432-4c709ad218af tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:34:39.035120 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-34b6de86-f06d-44e8-b432-4c709ad218af tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:34:39.035557 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-34b6de86-f06d-44e8-b432-4c709ad218af tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:34:39.093485 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-34b6de86-f06d-44e8-b432-4c709ad218af tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:34:39.101012 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-34b6de86-f06d-44e8-b432-4c709ad218af tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.077933 Nov 09 20:34:39.101566 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1110/2191] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:34:39 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:34:40.117366 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-e01d3d80-0953-439e-aac2-562fb8938045 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:34:40.117959 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-e01d3d80-0953-439e-aac2-562fb8938045 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:34:40.125567 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e01d3d80-0953-439e-aac2-562fb8938045 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:34:40.126007 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e01d3d80-0953-439e-aac2-562fb8938045 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:34:40.126766 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e01d3d80-0953-439e-aac2-562fb8938045 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:34:40.127187 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e01d3d80-0953-439e-aac2-562fb8938045 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:34:40.187021 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-e01d3d80-0953-439e-aac2-562fb8938045 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:34:40.194551 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-e01d3d80-0953-439e-aac2-562fb8938045 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.080950 Nov 09 20:34:40.195127 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1082/2192] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:34:40 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:34:41.210828 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-dfc520c9-7952-40fc-8e5e-9058e92293fe tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:34:41.211513 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-dfc520c9-7952-40fc-8e5e-9058e92293fe tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:34:41.218633 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-dfc520c9-7952-40fc-8e5e-9058e92293fe tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:34:41.219075 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-dfc520c9-7952-40fc-8e5e-9058e92293fe tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:34:41.219839 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-dfc520c9-7952-40fc-8e5e-9058e92293fe tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:34:41.220269 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-dfc520c9-7952-40fc-8e5e-9058e92293fe tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:34:41.283176 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-dfc520c9-7952-40fc-8e5e-9058e92293fe tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:34:41.290992 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-dfc520c9-7952-40fc-8e5e-9058e92293fe tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.083832 Nov 09 20:34:41.291542 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1111/2193] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:34:41 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:34:42.307535 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-ac2e26af-f6d6-4b67-82b3-959b935ebcdb tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:34:42.308179 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-ac2e26af-f6d6-4b67-82b3-959b935ebcdb tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:34:42.315051 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ac2e26af-f6d6-4b67-82b3-959b935ebcdb tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:34:42.315488 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ac2e26af-f6d6-4b67-82b3-959b935ebcdb tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:34:42.316250 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ac2e26af-f6d6-4b67-82b3-959b935ebcdb tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:34:42.316705 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ac2e26af-f6d6-4b67-82b3-959b935ebcdb tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:34:42.375598 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-ac2e26af-f6d6-4b67-82b3-959b935ebcdb tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:34:42.383320 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-ac2e26af-f6d6-4b67-82b3-959b935ebcdb tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 200 len: 1368 microversion: 2.1 time: 0.079436 Nov 09 20:34:42.383865 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1083/2194] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:34:42 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:34:42.400235 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-f3d6452b-97bb-4648-b4a2-43192c1b5055 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '.version_select at 0x7fab3ffaa670>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:34:42.420587 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-f3d6452b-97bb-4648-b4a2-43192c1b5055 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-919557392" status: 202 len: 0 microversion: 2.1 time: 0.023476 Nov 09 20:34:42.421590 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1112/2195] 10.222.0.25 () {58 vars in 1217 bytes} [Tue Nov 9 20:34:42 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-919557392 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 09 20:34:43.306256 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-ae8ef603-62ce-4400-96b6-5e1503d56295 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Action: 'create', calling method: .version_select at 0x7fab3ff831f0>, body: {"keypair": {"name": "tempest-keypair-1663927794"}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:34:43.320336 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.quota [None req-ae8ef603-62ce-4400-96b6-5e1503d56295 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Getting quotas for project 04aa1d479bda429cb8cc96145ab3e4ab. Resources: {'key_pairs'} {{(pid=116103) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 09 20:34:43.324116 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.quota [None req-ae8ef603-62ce-4400-96b6-5e1503d56295 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Getting quotas for user 5d2764f4c77b47629d7c33ea15a5b566 and project 04aa1d479bda429cb8cc96145ab3e4ab. Resources: {'key_pairs'} {{(pid=116103) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 09 20:34:43.460118 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.quota [None req-ae8ef603-62ce-4400-96b6-5e1503d56295 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Getting quotas for project 04aa1d479bda429cb8cc96145ab3e4ab. Resources: {'key_pairs'} {{(pid=116103) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 09 20:34:43.463705 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.quota [None req-ae8ef603-62ce-4400-96b6-5e1503d56295 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Getting quotas for user 5d2764f4c77b47629d7c33ea15a5b566 and project 04aa1d479bda429cb8cc96145ab3e4ab. Resources: {'key_pairs'} {{(pid=116103) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 09 20:34:43.477374 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-ae8ef603-62ce-4400-96b6-5e1503d56295 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.174866 Nov 09 20:34:43.477970 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1084/2196] 10.222.0.25 () {60 vars in 1157 bytes} [Tue Nov 9 20:34:43 2021] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:34:44.708801 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-aadb3edc-b178-4699-b91e-e90a91ef7752 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-85639492", "imageRef": "109ded43-8c19-4f17-afac-7625dcfef942", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "38a3e273-4c80-49c2-bd2f-f5745f189daa"}], "security_groups": [{"name": "tempest-securitygroup--179645791"}], "key_name": "tempest-keypair-1663927794", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:34:44.808477 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.network.neutron [None req-aadb3edc-b178-4699-b91e-e90a91ef7752 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] validate_networks() for [('38a3e273-4c80-49c2-bd2f-f5745f189daa', None, None, None, None, None)] {{(pid=116102) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 09 20:34:45.222869 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.virt.hardware [None req-aadb3edc-b178-4699-b91e-e90a91ef7752 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Flavor limits 0:0:0 {{(pid=116102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 09 20:34:45.223289 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.virt.hardware [None req-aadb3edc-b178-4699-b91e-e90a91ef7752 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Image limits 0:0:0 {{(pid=116102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 09 20:34:45.223827 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.virt.hardware [None req-aadb3edc-b178-4699-b91e-e90a91ef7752 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Flavor pref 0:0:0 {{(pid=116102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 09 20:34:45.224139 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.virt.hardware [None req-aadb3edc-b178-4699-b91e-e90a91ef7752 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Image pref 0:0:0 {{(pid=116102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 09 20:34:45.224572 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.virt.hardware [None req-aadb3edc-b178-4699-b91e-e90a91ef7752 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 09 20:34:45.233890 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-aadb3edc-b178-4699-b91e-e90a91ef7752 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:34:45.234342 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-aadb3edc-b178-4699-b91e-e90a91ef7752 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:34:45.235233 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-aadb3edc-b178-4699-b91e-e90a91ef7752 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:34:45.235677 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-aadb3edc-b178-4699-b91e-e90a91ef7752 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:34:45.253386 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.quota [None req-aadb3edc-b178-4699-b91e-e90a91ef7752 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Getting quotas for project 04aa1d479bda429cb8cc96145ab3e4ab. Resources: {'cores', 'instances', 'ram'} {{(pid=116102) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 09 20:34:45.257750 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.quota [None req-aadb3edc-b178-4699-b91e-e90a91ef7752 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Getting quotas for user 5d2764f4c77b47629d7c33ea15a5b566 and project 04aa1d479bda429cb8cc96145ab3e4ab. Resources: {'cores', 'instances', 'ram'} {{(pid=116102) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 09 20:34:45.270382 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-aadb3edc-b178-4699-b91e-e90a91ef7752 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Going to run 1 instances... {{(pid=116102) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 09 20:34:45.272779 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-aadb3edc-b178-4699-b91e-e90a91ef7752 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: a79c44fc-e2f7-4c5b-9013-ae2a33cd3684] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='109ded43-8c19-4f17-afac-7625dcfef942',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 09 20:34:45.320130 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-aadb3edc-b178-4699-b91e-e90a91ef7752 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.615724 Nov 09 20:34:45.320980 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1113/2197] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Nov 9 20:34:44 2021] POST /compute/v2.1/servers => generated 401 bytes in 617 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 09 20:34:45.334370 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-c9388419-de6e-4d71-b6ca-6ade8b87b548 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:34:45.335351 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-c9388419-de6e-4d71-b6ca-6ade8b87b548 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: a79c44fc-e2f7-4c5b-9013-ae2a33cd3684] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:34:45.393704 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-c9388419-de6e-4d71-b6ca-6ade8b87b548 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:34:45.401000 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-c9388419-de6e-4d71-b6ca-6ade8b87b548 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/a79c44fc-e2f7-4c5b-9013-ae2a33cd3684" status: 200 len: 1236 microversion: 2.1 time: 0.074010 Nov 09 20:34:45.401554 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1085/2198] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:34:45 2021] GET /compute/v2.1/servers/a79c44fc-e2f7-4c5b-9013-ae2a33cd3684 => generated 1236 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:34:46.255452 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 09 20:34:46.256326 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: Tue Nov 9 20:34:46 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 09 20:34:46.418312 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-c493a677-b1cd-43ef-935b-06ae324a87a6 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:34:46.419398 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-c493a677-b1cd-43ef-935b-06ae324a87a6 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: a79c44fc-e2f7-4c5b-9013-ae2a33cd3684] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:34:46.427253 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c493a677-b1cd-43ef-935b-06ae324a87a6 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:34:46.427694 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c493a677-b1cd-43ef-935b-06ae324a87a6 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:34:46.428483 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c493a677-b1cd-43ef-935b-06ae324a87a6 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:34:46.428914 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c493a677-b1cd-43ef-935b-06ae324a87a6 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:34:46.487936 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-c493a677-b1cd-43ef-935b-06ae324a87a6 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:34:46.494929 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-c493a677-b1cd-43ef-935b-06ae324a87a6 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/a79c44fc-e2f7-4c5b-9013-ae2a33cd3684" status: 200 len: 1294 microversion: 2.1 time: 0.080441 Nov 09 20:34:46.495476 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1114/2199] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:34:46 2021] GET /compute/v2.1/servers/a79c44fc-e2f7-4c5b-9013-ae2a33cd3684 => generated 1294 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:34:47.511993 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-4d46c213-74bd-493f-ac62-cf53d31f9a96 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:34:47.512855 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-4d46c213-74bd-493f-ac62-cf53d31f9a96 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: a79c44fc-e2f7-4c5b-9013-ae2a33cd3684] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:34:47.519579 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4d46c213-74bd-493f-ac62-cf53d31f9a96 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:34:47.520271 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4d46c213-74bd-493f-ac62-cf53d31f9a96 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:34:47.521086 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4d46c213-74bd-493f-ac62-cf53d31f9a96 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:34:47.521547 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4d46c213-74bd-493f-ac62-cf53d31f9a96 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:34:47.598777 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 09 20:34:47.599020 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: Tue Nov 9 20:34:47 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a79c44fc-e2f7-4c5b-9013-ae2a33cd3684 (ip 10.222.0.25) !!! Nov 09 20:34:47.690317 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-4d46c213-74bd-493f-ac62-cf53d31f9a96 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:34:47.693703 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [req-8f1e329f-52b6-4058-9f90-36a02c7ac9b9 req-cf469453-1858-4abd-a33e-1b3472931617 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a79c44fc-e2f7-4c5b-9013-ae2a33cd3684", "tag": "562b8c9f-655f-4545-9bf0-9400740a6fe4"}]} {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:34:47.696296 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 20:34:47.696296 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: warnings.warn(msg) Nov 09 20:34:47.698767 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-4d46c213-74bd-493f-ac62-cf53d31f9a96 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/a79c44fc-e2f7-4c5b-9013-ae2a33cd3684" status: 200 len: 1361 microversion: 2.1 time: 0.190735 Nov 09 20:34:47.699444 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1086/2200] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:34:47 2021] GET /compute/v2.1/servers/a79c44fc-e2f7-4c5b-9013-ae2a33cd3684 => generated 1361 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 20:34:47.704340 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [req-8f1e329f-52b6-4058-9f90-36a02c7ac9b9 req-cf469453-1858-4abd-a33e-1b3472931617 service nova] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:34:47.712339 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [req-8f1e329f-52b6-4058-9f90-36a02c7ac9b9 req-cf469453-1858-4abd-a33e-1b3472931617 service nova] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:34:47.725531 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.compute.server_external_events [req-8f1e329f-52b6-4058-9f90-36a02c7ac9b9 req-cf469453-1858-4abd-a33e-1b3472931617 service nova] Creating event network-changed:562b8c9f-655f-4545-9bf0-9400740a6fe4 for instance a79c44fc-e2f7-4c5b-9013-ae2a33cd3684 on hv-cinder-80135 Nov 09 20:34:47.732133 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [req-8f1e329f-52b6-4058-9f90-36a02c7ac9b9 req-cf469453-1858-4abd-a33e-1b3472931617 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.169642 Nov 09 20:34:47.732828 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1115/2201] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Nov 9 20:34:47 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 20:34:48.715492 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-326e594a-2f67-4b58-af39-273e285e412e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:34:48.716860 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-326e594a-2f67-4b58-af39-273e285e412e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: a79c44fc-e2f7-4c5b-9013-ae2a33cd3684] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:34:48.722974 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-326e594a-2f67-4b58-af39-273e285e412e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:34:48.723413 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-326e594a-2f67-4b58-af39-273e285e412e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:34:48.724165 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-326e594a-2f67-4b58-af39-273e285e412e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:34:48.724681 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-326e594a-2f67-4b58-af39-273e285e412e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:34:48.851520 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-326e594a-2f67-4b58-af39-273e285e412e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:34:48.858885 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-326e594a-2f67-4b58-af39-273e285e412e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/a79c44fc-e2f7-4c5b-9013-ae2a33cd3684" status: 200 len: 1361 microversion: 2.1 time: 0.147125 Nov 09 20:34:48.859439 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1087/2202] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:34:48 2021] GET /compute/v2.1/servers/a79c44fc-e2f7-4c5b-9013-ae2a33cd3684 => generated 1361 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:34:49.877282 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-4ce70e4f-e7fc-4284-8132-4715b6f9edcf tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:34:49.878091 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-4ce70e4f-e7fc-4284-8132-4715b6f9edcf tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: a79c44fc-e2f7-4c5b-9013-ae2a33cd3684] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:34:49.884032 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-4ce70e4f-e7fc-4284-8132-4715b6f9edcf tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:34:49.884524 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-4ce70e4f-e7fc-4284-8132-4715b6f9edcf tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:34:49.885296 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-4ce70e4f-e7fc-4284-8132-4715b6f9edcf tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:34:49.885727 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-4ce70e4f-e7fc-4284-8132-4715b6f9edcf tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:34:50.022100 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-4ce70e4f-e7fc-4284-8132-4715b6f9edcf tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:34:50.029733 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-4ce70e4f-e7fc-4284-8132-4715b6f9edcf tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/a79c44fc-e2f7-4c5b-9013-ae2a33cd3684" status: 200 len: 1361 microversion: 2.1 time: 0.157817 Nov 09 20:34:50.030300 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1116/2203] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:34:49 2021] GET /compute/v2.1/servers/a79c44fc-e2f7-4c5b-9013-ae2a33cd3684 => generated 1361 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:34:51.046673 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-1e868dc3-b327-486d-a1b5-31ca457d3030 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:34:51.047856 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-1e868dc3-b327-486d-a1b5-31ca457d3030 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: a79c44fc-e2f7-4c5b-9013-ae2a33cd3684] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:34:51.054212 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1e868dc3-b327-486d-a1b5-31ca457d3030 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:34:51.054653 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1e868dc3-b327-486d-a1b5-31ca457d3030 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:34:51.055421 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1e868dc3-b327-486d-a1b5-31ca457d3030 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:34:51.055852 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1e868dc3-b327-486d-a1b5-31ca457d3030 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:34:51.187559 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-1e868dc3-b327-486d-a1b5-31ca457d3030 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:34:51.194677 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-1e868dc3-b327-486d-a1b5-31ca457d3030 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/a79c44fc-e2f7-4c5b-9013-ae2a33cd3684" status: 200 len: 1361 microversion: 2.1 time: 0.152163 Nov 09 20:34:51.195234 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1088/2204] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:34:51 2021] GET /compute/v2.1/servers/a79c44fc-e2f7-4c5b-9013-ae2a33cd3684 => generated 1361 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:34:52.055544 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [req-b7d0a89c-c444-4957-9ed2-d719c72a7fbb req-1086a6c9-d59f-48ec-846f-98ed9e9bff0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a79c44fc-e2f7-4c5b-9013-ae2a33cd3684", "name": "network-vif-plugged", "status": "completed", "tag": "562b8c9f-655f-4545-9bf0-9400740a6fe4"}]} {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:34:52.057106 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 20:34:52.057106 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: warnings.warn(msg) Nov 09 20:34:52.064508 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [req-b7d0a89c-c444-4957-9ed2-d719c72a7fbb req-1086a6c9-d59f-48ec-846f-98ed9e9bff0b service nova] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:34:52.064948 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [req-b7d0a89c-c444-4957-9ed2-d719c72a7fbb req-1086a6c9-d59f-48ec-846f-98ed9e9bff0b service nova] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:34:52.077877 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.compute.server_external_events [req-b7d0a89c-c444-4957-9ed2-d719c72a7fbb req-1086a6c9-d59f-48ec-846f-98ed9e9bff0b service nova] Creating event network-vif-plugged:562b8c9f-655f-4545-9bf0-9400740a6fe4 for instance a79c44fc-e2f7-4c5b-9013-ae2a33cd3684 on hv-cinder-80135 Nov 09 20:34:52.082620 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [req-b7d0a89c-c444-4957-9ed2-d719c72a7fbb req-1086a6c9-d59f-48ec-846f-98ed9e9bff0b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084686 Nov 09 20:34:52.083183 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1117/2205] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Nov 9 20:34:51 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:34:52.210851 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-633dfffc-b414-4105-b515-6ca6b5c8c8e6 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:34:52.211444 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-633dfffc-b414-4105-b515-6ca6b5c8c8e6 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: a79c44fc-e2f7-4c5b-9013-ae2a33cd3684] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:34:52.217880 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-633dfffc-b414-4105-b515-6ca6b5c8c8e6 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:34:52.218329 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-633dfffc-b414-4105-b515-6ca6b5c8c8e6 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:34:52.219109 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-633dfffc-b414-4105-b515-6ca6b5c8c8e6 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:34:52.219545 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-633dfffc-b414-4105-b515-6ca6b5c8c8e6 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:34:52.350710 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-633dfffc-b414-4105-b515-6ca6b5c8c8e6 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:34:52.358355 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-633dfffc-b414-4105-b515-6ca6b5c8c8e6 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/a79c44fc-e2f7-4c5b-9013-ae2a33cd3684" status: 200 len: 1361 microversion: 2.1 time: 0.151228 Nov 09 20:34:52.358915 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1089/2206] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:34:52 2021] GET /compute/v2.1/servers/a79c44fc-e2f7-4c5b-9013-ae2a33cd3684 => generated 1361 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:34:53.376204 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-295b69aa-0ac0-4f26-87ab-f339c47ff69a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:34:53.377157 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-295b69aa-0ac0-4f26-87ab-f339c47ff69a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: a79c44fc-e2f7-4c5b-9013-ae2a33cd3684] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:34:53.384265 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-295b69aa-0ac0-4f26-87ab-f339c47ff69a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:34:53.384737 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-295b69aa-0ac0-4f26-87ab-f339c47ff69a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:34:53.385536 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-295b69aa-0ac0-4f26-87ab-f339c47ff69a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:34:53.385967 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-295b69aa-0ac0-4f26-87ab-f339c47ff69a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:34:53.752518 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-295b69aa-0ac0-4f26-87ab-f339c47ff69a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:34:53.759591 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-295b69aa-0ac0-4f26-87ab-f339c47ff69a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/a79c44fc-e2f7-4c5b-9013-ae2a33cd3684" status: 200 len: 1548 microversion: 2.1 time: 0.387915 Nov 09 20:34:53.760144 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1118/2207] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:34:53 2021] GET /compute/v2.1/servers/a79c44fc-e2f7-4c5b-9013-ae2a33cd3684 => generated 1548 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 20:34:53.775801 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-56de5038-4280-45fe-bb47-48147fce75b7 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:34:53.776318 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-56de5038-4280-45fe-bb47-48147fce75b7 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: a79c44fc-e2f7-4c5b-9013-ae2a33cd3684] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:34:53.783045 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-56de5038-4280-45fe-bb47-48147fce75b7 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:34:53.783485 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-56de5038-4280-45fe-bb47-48147fce75b7 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:34:53.784252 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-56de5038-4280-45fe-bb47-48147fce75b7 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:34:53.784718 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-56de5038-4280-45fe-bb47-48147fce75b7 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:34:53.865272 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-56de5038-4280-45fe-bb47-48147fce75b7 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/a79c44fc-e2f7-4c5b-9013-ae2a33cd3684/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.093053 Nov 09 20:34:53.865862 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1090/2208] 10.222.0.25 () {58 vars in 1274 bytes} [Tue Nov 9 20:34:53 2021] GET /compute/v2.1/servers/a79c44fc-e2f7-4c5b-9013-ae2a33cd3684/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:34:54.782251 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-adf47b78-0fa6-4fe1-b4b6-5879ebd272c3 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:34:54.783267 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-adf47b78-0fa6-4fe1-b4b6-5879ebd272c3 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: a79c44fc-e2f7-4c5b-9013-ae2a33cd3684] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:34:54.790045 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-adf47b78-0fa6-4fe1-b4b6-5879ebd272c3 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:34:54.790680 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-adf47b78-0fa6-4fe1-b4b6-5879ebd272c3 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:34:54.791526 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-adf47b78-0fa6-4fe1-b4b6-5879ebd272c3 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:34:54.792226 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-adf47b78-0fa6-4fe1-b4b6-5879ebd272c3 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:34:54.840350 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [req-b684936f-4c66-4c2d-880d-6e1d89c9db1b req-d6c9360c-4b28-422f-96a2-cfdc8091983c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a79c44fc-e2f7-4c5b-9013-ae2a33cd3684", "tag": "562b8c9f-655f-4545-9bf0-9400740a6fe4"}]} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:34:54.842772 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 20:34:54.842772 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: warnings.warn(msg) Nov 09 20:34:54.849733 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-b684936f-4c66-4c2d-880d-6e1d89c9db1b req-d6c9360c-4b28-422f-96a2-cfdc8091983c service nova] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:34:54.850168 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-b684936f-4c66-4c2d-880d-6e1d89c9db1b req-d6c9360c-4b28-422f-96a2-cfdc8091983c service nova] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:34:54.859884 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-adf47b78-0fa6-4fe1-b4b6-5879ebd272c3 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "POST /compute/v2.1/servers/a79c44fc-e2f7-4c5b-9013-ae2a33cd3684/action" status: 200 len: 14 microversion: 2.1 time: 0.081759 Nov 09 20:34:54.860851 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1119/2209] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Nov 9 20:34:54 2021] POST /compute/v2.1/servers/a79c44fc-e2f7-4c5b-9013-ae2a33cd3684/action => generated 14 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 09 20:34:54.862151 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.compute.server_external_events [req-b684936f-4c66-4c2d-880d-6e1d89c9db1b req-d6c9360c-4b28-422f-96a2-cfdc8091983c service nova] Creating event network-changed:562b8c9f-655f-4545-9bf0-9400740a6fe4 for instance a79c44fc-e2f7-4c5b-9013-ae2a33cd3684 on hv-cinder-80135 Nov 09 20:34:54.868136 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [req-b684936f-4c66-4c2d-880d-6e1d89c9db1b req-d6c9360c-4b28-422f-96a2-cfdc8091983c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086701 Nov 09 20:34:54.868858 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1091/2210] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Nov 9 20:34:54 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:34:55.871534 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-a5e053c7-ec48-4661-a1ad-2305780f0592 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:34:55.872624 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-a5e053c7-ec48-4661-a1ad-2305780f0592 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: a79c44fc-e2f7-4c5b-9013-ae2a33cd3684] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:34:55.879744 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a5e053c7-ec48-4661-a1ad-2305780f0592 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:34:55.880192 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a5e053c7-ec48-4661-a1ad-2305780f0592 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:34:55.880994 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a5e053c7-ec48-4661-a1ad-2305780f0592 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:34:55.881433 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a5e053c7-ec48-4661-a1ad-2305780f0592 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:34:55.939865 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-a5e053c7-ec48-4661-a1ad-2305780f0592 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "POST /compute/v2.1/servers/a79c44fc-e2f7-4c5b-9013-ae2a33cd3684/action" status: 200 len: 14 microversion: 2.1 time: 0.072171 Nov 09 20:34:55.940532 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1120/2211] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Nov 9 20:34:55 2021] POST /compute/v2.1/servers/a79c44fc-e2f7-4c5b-9013-ae2a33cd3684/action => generated 14 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 09 20:34:56.951617 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-49a00426-a068-4b44-a428-26fe0fa15a84 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:34:56.952527 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-49a00426-a068-4b44-a428-26fe0fa15a84 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: a79c44fc-e2f7-4c5b-9013-ae2a33cd3684] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:34:56.958630 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-49a00426-a068-4b44-a428-26fe0fa15a84 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:34:56.959067 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-49a00426-a068-4b44-a428-26fe0fa15a84 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:34:56.959825 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-49a00426-a068-4b44-a428-26fe0fa15a84 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:34:56.960276 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-49a00426-a068-4b44-a428-26fe0fa15a84 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:34:57.019392 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-49a00426-a068-4b44-a428-26fe0fa15a84 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "POST /compute/v2.1/servers/a79c44fc-e2f7-4c5b-9013-ae2a33cd3684/action" status: 200 len: 14 microversion: 2.1 time: 0.072282 Nov 09 20:34:57.020164 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1092/2212] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Nov 9 20:34:56 2021] POST /compute/v2.1/servers/a79c44fc-e2f7-4c5b-9013-ae2a33cd3684/action => generated 14 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 09 20:34:58.031423 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-f020176b-be0f-4ef4-85d8-09c9584358b5 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:34:58.032476 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-f020176b-be0f-4ef4-85d8-09c9584358b5 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: a79c44fc-e2f7-4c5b-9013-ae2a33cd3684] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:34:58.039272 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f020176b-be0f-4ef4-85d8-09c9584358b5 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:34:58.039723 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f020176b-be0f-4ef4-85d8-09c9584358b5 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:34:58.040521 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f020176b-be0f-4ef4-85d8-09c9584358b5 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:34:58.040957 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f020176b-be0f-4ef4-85d8-09c9584358b5 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:34:58.099168 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-f020176b-be0f-4ef4-85d8-09c9584358b5 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "POST /compute/v2.1/servers/a79c44fc-e2f7-4c5b-9013-ae2a33cd3684/action" status: 200 len: 14 microversion: 2.1 time: 0.072470 Nov 09 20:34:58.100012 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1121/2213] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Nov 9 20:34:58 2021] POST /compute/v2.1/servers/a79c44fc-e2f7-4c5b-9013-ae2a33cd3684/action => generated 14 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 09 20:34:59.110744 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-7ee31f0a-c9f5-4ab1-8c3f-08668c0ef59f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:34:59.111765 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-7ee31f0a-c9f5-4ab1-8c3f-08668c0ef59f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: a79c44fc-e2f7-4c5b-9013-ae2a33cd3684] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:34:59.118668 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7ee31f0a-c9f5-4ab1-8c3f-08668c0ef59f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:34:59.119348 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7ee31f0a-c9f5-4ab1-8c3f-08668c0ef59f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:34:59.120111 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7ee31f0a-c9f5-4ab1-8c3f-08668c0ef59f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:34:59.120568 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7ee31f0a-c9f5-4ab1-8c3f-08668c0ef59f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:34:59.177123 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-7ee31f0a-c9f5-4ab1-8c3f-08668c0ef59f tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "POST /compute/v2.1/servers/a79c44fc-e2f7-4c5b-9013-ae2a33cd3684/action" status: 200 len: 14 microversion: 2.1 time: 0.070644 Nov 09 20:34:59.177760 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1093/2214] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Nov 9 20:34:59 2021] POST /compute/v2.1/servers/a79c44fc-e2f7-4c5b-9013-ae2a33cd3684/action => generated 14 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 09 20:35:00.188372 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-1fc23f7e-6c04-4474-a2fe-fcdac1cac845 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:35:00.189397 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-1fc23f7e-6c04-4474-a2fe-fcdac1cac845 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: a79c44fc-e2f7-4c5b-9013-ae2a33cd3684] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:35:00.196285 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-1fc23f7e-6c04-4474-a2fe-fcdac1cac845 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:35:00.196758 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-1fc23f7e-6c04-4474-a2fe-fcdac1cac845 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:35:00.197539 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-1fc23f7e-6c04-4474-a2fe-fcdac1cac845 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:35:00.198109 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-1fc23f7e-6c04-4474-a2fe-fcdac1cac845 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:35:00.264724 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-1fc23f7e-6c04-4474-a2fe-fcdac1cac845 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "POST /compute/v2.1/servers/a79c44fc-e2f7-4c5b-9013-ae2a33cd3684/action" status: 200 len: 14 microversion: 2.1 time: 0.080806 Nov 09 20:35:00.265365 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1122/2215] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Nov 9 20:35:00 2021] POST /compute/v2.1/servers/a79c44fc-e2f7-4c5b-9013-ae2a33cd3684/action => generated 14 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 09 20:35:01.275944 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-71bffa57-6e66-4d5d-a10f-bfd257fd5ff3 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:35:01.276888 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-71bffa57-6e66-4d5d-a10f-bfd257fd5ff3 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: a79c44fc-e2f7-4c5b-9013-ae2a33cd3684] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:35:01.284192 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-71bffa57-6e66-4d5d-a10f-bfd257fd5ff3 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:35:01.284665 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-71bffa57-6e66-4d5d-a10f-bfd257fd5ff3 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:35:01.285431 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-71bffa57-6e66-4d5d-a10f-bfd257fd5ff3 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:35:01.285858 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-71bffa57-6e66-4d5d-a10f-bfd257fd5ff3 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:35:01.342933 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-71bffa57-6e66-4d5d-a10f-bfd257fd5ff3 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "POST /compute/v2.1/servers/a79c44fc-e2f7-4c5b-9013-ae2a33cd3684/action" status: 200 len: 14 microversion: 2.1 time: 0.070984 Nov 09 20:35:01.343534 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1094/2216] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Nov 9 20:35:01 2021] POST /compute/v2.1/servers/a79c44fc-e2f7-4c5b-9013-ae2a33cd3684/action => generated 14 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 09 20:35:02.354080 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-fd352658-7aa0-4b06-a8ad-28cbaf674377 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:35:02.355081 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-fd352658-7aa0-4b06-a8ad-28cbaf674377 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: a79c44fc-e2f7-4c5b-9013-ae2a33cd3684] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:35:02.362341 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-fd352658-7aa0-4b06-a8ad-28cbaf674377 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:35:02.362788 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-fd352658-7aa0-4b06-a8ad-28cbaf674377 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:35:02.363564 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-fd352658-7aa0-4b06-a8ad-28cbaf674377 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:35:02.364027 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-fd352658-7aa0-4b06-a8ad-28cbaf674377 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:35:02.423989 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-fd352658-7aa0-4b06-a8ad-28cbaf674377 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "POST /compute/v2.1/servers/a79c44fc-e2f7-4c5b-9013-ae2a33cd3684/action" status: 200 len: 14 microversion: 2.1 time: 0.073769 Nov 09 20:35:02.424865 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1123/2217] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Nov 9 20:35:02 2021] POST /compute/v2.1/servers/a79c44fc-e2f7-4c5b-9013-ae2a33cd3684/action => generated 14 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 09 20:35:03.435539 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-bf452eb6-1e63-41fc-bf82-ba583d7827c3 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:35:03.436563 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-bf452eb6-1e63-41fc-bf82-ba583d7827c3 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: a79c44fc-e2f7-4c5b-9013-ae2a33cd3684] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:35:03.443371 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bf452eb6-1e63-41fc-bf82-ba583d7827c3 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:35:03.443817 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bf452eb6-1e63-41fc-bf82-ba583d7827c3 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:35:03.444612 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bf452eb6-1e63-41fc-bf82-ba583d7827c3 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:35:03.445041 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bf452eb6-1e63-41fc-bf82-ba583d7827c3 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:35:03.504384 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-bf452eb6-1e63-41fc-bf82-ba583d7827c3 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "POST /compute/v2.1/servers/a79c44fc-e2f7-4c5b-9013-ae2a33cd3684/action" status: 200 len: 14 microversion: 2.1 time: 0.072784 Nov 09 20:35:03.505011 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1095/2218] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Nov 9 20:35:03 2021] POST /compute/v2.1/servers/a79c44fc-e2f7-4c5b-9013-ae2a33cd3684/action => generated 14 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 09 20:35:04.515782 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-10338e8e-56bf-42a7-a9f3-16ba6a98fdba tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:35:04.516888 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-10338e8e-56bf-42a7-a9f3-16ba6a98fdba tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: a79c44fc-e2f7-4c5b-9013-ae2a33cd3684] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:35:04.523733 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-10338e8e-56bf-42a7-a9f3-16ba6a98fdba tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:35:04.524181 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-10338e8e-56bf-42a7-a9f3-16ba6a98fdba tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:35:04.524987 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-10338e8e-56bf-42a7-a9f3-16ba6a98fdba tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:35:04.525420 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-10338e8e-56bf-42a7-a9f3-16ba6a98fdba tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:35:04.584530 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-10338e8e-56bf-42a7-a9f3-16ba6a98fdba tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "POST /compute/v2.1/servers/a79c44fc-e2f7-4c5b-9013-ae2a33cd3684/action" status: 200 len: 14 microversion: 2.1 time: 0.072785 Nov 09 20:35:04.585232 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1124/2219] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Nov 9 20:35:04 2021] POST /compute/v2.1/servers/a79c44fc-e2f7-4c5b-9013-ae2a33cd3684/action => generated 14 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 09 20:35:05.595800 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-964618b3-0f03-4c88-9073-320eb00513dc tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:35:05.596877 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-964618b3-0f03-4c88-9073-320eb00513dc tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: a79c44fc-e2f7-4c5b-9013-ae2a33cd3684] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:35:05.603590 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-964618b3-0f03-4c88-9073-320eb00513dc tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:35:05.604030 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-964618b3-0f03-4c88-9073-320eb00513dc tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:35:05.604826 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-964618b3-0f03-4c88-9073-320eb00513dc tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:35:05.605250 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-964618b3-0f03-4c88-9073-320eb00513dc tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:35:05.678441 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-964618b3-0f03-4c88-9073-320eb00513dc tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "POST /compute/v2.1/servers/a79c44fc-e2f7-4c5b-9013-ae2a33cd3684/action" status: 200 len: 8229 microversion: 2.1 time: 0.086491 Nov 09 20:35:05.679265 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1096/2220] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Nov 9 20:35:05 2021] POST /compute/v2.1/servers/a79c44fc-e2f7-4c5b-9013-ae2a33cd3684/action => generated 8229 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:35:06.689653 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-381c7b8c-a02f-4466-85a5-34e09b0e97b3 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:35:06.690653 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-381c7b8c-a02f-4466-85a5-34e09b0e97b3 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: a79c44fc-e2f7-4c5b-9013-ae2a33cd3684] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:35:06.697524 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-381c7b8c-a02f-4466-85a5-34e09b0e97b3 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:35:06.697971 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-381c7b8c-a02f-4466-85a5-34e09b0e97b3 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:35:06.698768 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-381c7b8c-a02f-4466-85a5-34e09b0e97b3 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:35:06.699224 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-381c7b8c-a02f-4466-85a5-34e09b0e97b3 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:35:06.793967 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-381c7b8c-a02f-4466-85a5-34e09b0e97b3 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "POST /compute/v2.1/servers/a79c44fc-e2f7-4c5b-9013-ae2a33cd3684/action" status: 200 len: 16280 microversion: 2.1 time: 0.108185 Nov 09 20:35:06.794785 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1125/2221] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Nov 9 20:35:06 2021] POST /compute/v2.1/servers/a79c44fc-e2f7-4c5b-9013-ae2a33cd3684/action => generated 16280 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 20:35:07.806028 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-1c9bbc40-f557-4ab2-b0a6-9ccbe9f52d06 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:35:07.807040 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-1c9bbc40-f557-4ab2-b0a6-9ccbe9f52d06 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: a79c44fc-e2f7-4c5b-9013-ae2a33cd3684] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:35:07.814592 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1c9bbc40-f557-4ab2-b0a6-9ccbe9f52d06 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:35:07.815032 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1c9bbc40-f557-4ab2-b0a6-9ccbe9f52d06 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:35:07.815788 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1c9bbc40-f557-4ab2-b0a6-9ccbe9f52d06 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:35:07.816211 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1c9bbc40-f557-4ab2-b0a6-9ccbe9f52d06 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:35:07.891728 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-1c9bbc40-f557-4ab2-b0a6-9ccbe9f52d06 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "POST /compute/v2.1/servers/a79c44fc-e2f7-4c5b-9013-ae2a33cd3684/action" status: 200 len: 18608 microversion: 2.1 time: 0.089502 Nov 09 20:35:07.892657 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1097/2222] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Nov 9 20:35:07 2021] POST /compute/v2.1/servers/a79c44fc-e2f7-4c5b-9013-ae2a33cd3684/action => generated 18608 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 20:35:08.904370 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-ffff8032-f2e3-49be-b34c-09b97e44713e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:35:08.905397 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-ffff8032-f2e3-49be-b34c-09b97e44713e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: a79c44fc-e2f7-4c5b-9013-ae2a33cd3684] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:35:08.912286 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ffff8032-f2e3-49be-b34c-09b97e44713e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:35:08.912759 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ffff8032-f2e3-49be-b34c-09b97e44713e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:35:08.913536 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ffff8032-f2e3-49be-b34c-09b97e44713e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:35:08.914169 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ffff8032-f2e3-49be-b34c-09b97e44713e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:35:08.990195 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-ffff8032-f2e3-49be-b34c-09b97e44713e tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "POST /compute/v2.1/servers/a79c44fc-e2f7-4c5b-9013-ae2a33cd3684/action" status: 200 len: 20997 microversion: 2.1 time: 0.090473 Nov 09 20:35:08.990818 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1126/2223] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Nov 9 20:35:08 2021] POST /compute/v2.1/servers/a79c44fc-e2f7-4c5b-9013-ae2a33cd3684/action => generated 20997 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 20:35:10.002758 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-c6c8e795-5f71-4de8-8667-e845f64dcf79 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:35:10.003744 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-c6c8e795-5f71-4de8-8667-e845f64dcf79 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: a79c44fc-e2f7-4c5b-9013-ae2a33cd3684] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:35:10.010555 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c6c8e795-5f71-4de8-8667-e845f64dcf79 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:35:10.011001 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c6c8e795-5f71-4de8-8667-e845f64dcf79 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:35:10.011768 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c6c8e795-5f71-4de8-8667-e845f64dcf79 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:35:10.012198 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c6c8e795-5f71-4de8-8667-e845f64dcf79 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:35:10.082211 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-c6c8e795-5f71-4de8-8667-e845f64dcf79 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "POST /compute/v2.1/servers/a79c44fc-e2f7-4c5b-9013-ae2a33cd3684/action" status: 200 len: 22981 microversion: 2.1 time: 0.083477 Nov 09 20:35:10.082853 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1098/2224] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Nov 9 20:35:09 2021] POST /compute/v2.1/servers/a79c44fc-e2f7-4c5b-9013-ae2a33cd3684/action => generated 22981 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 20:35:11.094795 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-47f9e1de-1093-487e-8851-2d1aa5c5c3e7 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:35:11.095796 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-47f9e1de-1093-487e-8851-2d1aa5c5c3e7 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: a79c44fc-e2f7-4c5b-9013-ae2a33cd3684] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:35:11.102639 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-47f9e1de-1093-487e-8851-2d1aa5c5c3e7 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:35:11.103088 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-47f9e1de-1093-487e-8851-2d1aa5c5c3e7 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:35:11.103870 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-47f9e1de-1093-487e-8851-2d1aa5c5c3e7 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:35:11.104284 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-47f9e1de-1093-487e-8851-2d1aa5c5c3e7 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:35:11.173693 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-47f9e1de-1093-487e-8851-2d1aa5c5c3e7 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "POST /compute/v2.1/servers/a79c44fc-e2f7-4c5b-9013-ae2a33cd3684/action" status: 200 len: 24157 microversion: 2.1 time: 0.083670 Nov 09 20:35:11.174331 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1127/2225] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Nov 9 20:35:11 2021] POST /compute/v2.1/servers/a79c44fc-e2f7-4c5b-9013-ae2a33cd3684/action => generated 24157 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 20:35:12.186094 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-a678723b-1412-4c16-8831-c6d43839cc84 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:35:12.187098 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-a678723b-1412-4c16-8831-c6d43839cc84 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: a79c44fc-e2f7-4c5b-9013-ae2a33cd3684] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:35:12.194090 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a678723b-1412-4c16-8831-c6d43839cc84 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:35:12.194534 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a678723b-1412-4c16-8831-c6d43839cc84 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:35:12.195306 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a678723b-1412-4c16-8831-c6d43839cc84 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:35:12.195769 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a678723b-1412-4c16-8831-c6d43839cc84 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:35:12.272007 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-a678723b-1412-4c16-8831-c6d43839cc84 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "POST /compute/v2.1/servers/a79c44fc-e2f7-4c5b-9013-ae2a33cd3684/action" status: 200 len: 25878 microversion: 2.1 time: 0.090348 Nov 09 20:35:12.272700 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1099/2226] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Nov 9 20:35:12 2021] POST /compute/v2.1/servers/a79c44fc-e2f7-4c5b-9013-ae2a33cd3684/action => generated 25878 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 20:35:13.283922 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-ae4d2f3f-0cf1-4feb-ac03-d64b067e0b26 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:35:13.284970 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-ae4d2f3f-0cf1-4feb-ac03-d64b067e0b26 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: a79c44fc-e2f7-4c5b-9013-ae2a33cd3684] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:35:13.291796 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ae4d2f3f-0cf1-4feb-ac03-d64b067e0b26 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:35:13.292242 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ae4d2f3f-0cf1-4feb-ac03-d64b067e0b26 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:35:13.293031 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ae4d2f3f-0cf1-4feb-ac03-d64b067e0b26 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:35:13.293466 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ae4d2f3f-0cf1-4feb-ac03-d64b067e0b26 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:35:13.368374 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-ae4d2f3f-0cf1-4feb-ac03-d64b067e0b26 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "POST /compute/v2.1/servers/a79c44fc-e2f7-4c5b-9013-ae2a33cd3684/action" status: 200 len: 27162 microversion: 2.1 time: 0.088404 Nov 09 20:35:13.369034 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1128/2227] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Nov 9 20:35:13 2021] POST /compute/v2.1/servers/a79c44fc-e2f7-4c5b-9013-ae2a33cd3684/action => generated 27162 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 09 20:35:14.381323 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-97b81196-b37f-4c32-bce6-bcc8fdd62f78 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:35:14.382320 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-97b81196-b37f-4c32-bce6-bcc8fdd62f78 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: a79c44fc-e2f7-4c5b-9013-ae2a33cd3684] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:35:14.389921 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-97b81196-b37f-4c32-bce6-bcc8fdd62f78 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:35:14.390376 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-97b81196-b37f-4c32-bce6-bcc8fdd62f78 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:35:14.391137 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-97b81196-b37f-4c32-bce6-bcc8fdd62f78 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:35:14.391565 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-97b81196-b37f-4c32-bce6-bcc8fdd62f78 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:35:14.466337 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-97b81196-b37f-4c32-bce6-bcc8fdd62f78 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "POST /compute/v2.1/servers/a79c44fc-e2f7-4c5b-9013-ae2a33cd3684/action" status: 200 len: 27871 microversion: 2.1 time: 0.088765 Nov 09 20:35:14.467004 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1100/2228] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Nov 9 20:35:14 2021] POST /compute/v2.1/servers/a79c44fc-e2f7-4c5b-9013-ae2a33cd3684/action => generated 27871 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 20:35:15.478610 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-a6c0c273-94c0-4f61-910e-fc8c243f19bf tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:35:15.479652 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-a6c0c273-94c0-4f61-910e-fc8c243f19bf tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: a79c44fc-e2f7-4c5b-9013-ae2a33cd3684] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:35:15.487701 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a6c0c273-94c0-4f61-910e-fc8c243f19bf tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:35:15.488142 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a6c0c273-94c0-4f61-910e-fc8c243f19bf tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:35:15.488942 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a6c0c273-94c0-4f61-910e-fc8c243f19bf tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:35:15.489367 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a6c0c273-94c0-4f61-910e-fc8c243f19bf tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:35:15.564578 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-a6c0c273-94c0-4f61-910e-fc8c243f19bf tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "POST /compute/v2.1/servers/a79c44fc-e2f7-4c5b-9013-ae2a33cd3684/action" status: 200 len: 28174 microversion: 2.1 time: 0.089921 Nov 09 20:35:15.565156 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1129/2229] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Nov 9 20:35:15 2021] POST /compute/v2.1/servers/a79c44fc-e2f7-4c5b-9013-ae2a33cd3684/action => generated 28174 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 20:35:16.575537 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-caf66977-bb48-4297-a58c-737751f79154 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:35:16.576452 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-caf66977-bb48-4297-a58c-737751f79154 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: a79c44fc-e2f7-4c5b-9013-ae2a33cd3684] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:35:16.583219 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-caf66977-bb48-4297-a58c-737751f79154 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:35:16.583655 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-caf66977-bb48-4297-a58c-737751f79154 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:35:16.584426 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-caf66977-bb48-4297-a58c-737751f79154 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:35:16.584855 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-caf66977-bb48-4297-a58c-737751f79154 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:35:16.646557 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-caf66977-bb48-4297-a58c-737751f79154 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "POST /compute/v2.1/servers/a79c44fc-e2f7-4c5b-9013-ae2a33cd3684/action" status: 200 len: 28174 microversion: 2.1 time: 0.074952 Nov 09 20:35:16.647458 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1101/2230] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Nov 9 20:35:16 2021] POST /compute/v2.1/servers/a79c44fc-e2f7-4c5b-9013-ae2a33cd3684/action => generated 28174 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 20:35:17.658726 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-b2e33976-6528-4123-8d1d-226cf63c12e3 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:35:17.659714 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-b2e33976-6528-4123-8d1d-226cf63c12e3 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: a79c44fc-e2f7-4c5b-9013-ae2a33cd3684] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:35:17.666468 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b2e33976-6528-4123-8d1d-226cf63c12e3 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:35:17.666906 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b2e33976-6528-4123-8d1d-226cf63c12e3 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:35:17.667662 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b2e33976-6528-4123-8d1d-226cf63c12e3 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:35:17.668083 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b2e33976-6528-4123-8d1d-226cf63c12e3 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:35:17.742591 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-b2e33976-6528-4123-8d1d-226cf63c12e3 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "POST /compute/v2.1/servers/a79c44fc-e2f7-4c5b-9013-ae2a33cd3684/action" status: 200 len: 28465 microversion: 2.1 time: 0.087761 Nov 09 20:35:17.743254 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1130/2231] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Nov 9 20:35:17 2021] POST /compute/v2.1/servers/a79c44fc-e2f7-4c5b-9013-ae2a33cd3684/action => generated 28465 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 09 20:35:18.754693 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-89158e66-2444-4e0f-95e2-d0d3f3545c3b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:35:18.755681 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-89158e66-2444-4e0f-95e2-d0d3f3545c3b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: a79c44fc-e2f7-4c5b-9013-ae2a33cd3684] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:35:18.763183 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-89158e66-2444-4e0f-95e2-d0d3f3545c3b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:35:18.763622 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-89158e66-2444-4e0f-95e2-d0d3f3545c3b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:35:18.764379 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-89158e66-2444-4e0f-95e2-d0d3f3545c3b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:35:18.764822 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-89158e66-2444-4e0f-95e2-d0d3f3545c3b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:35:18.841060 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-89158e66-2444-4e0f-95e2-d0d3f3545c3b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "POST /compute/v2.1/servers/a79c44fc-e2f7-4c5b-9013-ae2a33cd3684/action" status: 200 len: 28633 microversion: 2.1 time: 0.089565 Nov 09 20:35:18.841740 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1102/2232] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Nov 9 20:35:18 2021] POST /compute/v2.1/servers/a79c44fc-e2f7-4c5b-9013-ae2a33cd3684/action => generated 28633 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 20:35:19.853165 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-6d98d471-c184-424a-9856-16388b342bc8 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:35:19.854186 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-6d98d471-c184-424a-9856-16388b342bc8 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: a79c44fc-e2f7-4c5b-9013-ae2a33cd3684] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:35:19.861879 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6d98d471-c184-424a-9856-16388b342bc8 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:35:19.862321 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6d98d471-c184-424a-9856-16388b342bc8 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:35:19.863108 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6d98d471-c184-424a-9856-16388b342bc8 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:35:19.863532 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6d98d471-c184-424a-9856-16388b342bc8 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:35:19.930327 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-6d98d471-c184-424a-9856-16388b342bc8 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "POST /compute/v2.1/servers/a79c44fc-e2f7-4c5b-9013-ae2a33cd3684/action" status: 200 len: 28633 microversion: 2.1 time: 0.080995 Nov 09 20:35:19.931637 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1131/2233] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Nov 9 20:35:19 2021] POST /compute/v2.1/servers/a79c44fc-e2f7-4c5b-9013-ae2a33cd3684/action => generated 28633 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 20:35:20.942624 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-79261a59-2e56-4c56-a52c-74fb2a8d06c1 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:35:20.943620 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-79261a59-2e56-4c56-a52c-74fb2a8d06c1 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: a79c44fc-e2f7-4c5b-9013-ae2a33cd3684] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:35:20.950454 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-79261a59-2e56-4c56-a52c-74fb2a8d06c1 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:35:20.950899 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-79261a59-2e56-4c56-a52c-74fb2a8d06c1 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:35:20.951669 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-79261a59-2e56-4c56-a52c-74fb2a8d06c1 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:35:20.952100 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-79261a59-2e56-4c56-a52c-74fb2a8d06c1 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:35:21.013065 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-79261a59-2e56-4c56-a52c-74fb2a8d06c1 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "POST /compute/v2.1/servers/a79c44fc-e2f7-4c5b-9013-ae2a33cd3684/action" status: 200 len: 28633 microversion: 2.1 time: 0.074198 Nov 09 20:35:21.013634 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1103/2234] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Nov 9 20:35:20 2021] POST /compute/v2.1/servers/a79c44fc-e2f7-4c5b-9013-ae2a33cd3684/action => generated 28633 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 20:35:22.024614 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-4cd00966-b68f-4afa-a6b1-d3d9d4e75cd2 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:35:22.025625 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-4cd00966-b68f-4afa-a6b1-d3d9d4e75cd2 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: a79c44fc-e2f7-4c5b-9013-ae2a33cd3684] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:35:22.032910 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-4cd00966-b68f-4afa-a6b1-d3d9d4e75cd2 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:35:22.033360 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-4cd00966-b68f-4afa-a6b1-d3d9d4e75cd2 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:35:22.034127 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-4cd00966-b68f-4afa-a6b1-d3d9d4e75cd2 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:35:22.034560 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-4cd00966-b68f-4afa-a6b1-d3d9d4e75cd2 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:35:22.109645 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-4cd00966-b68f-4afa-a6b1-d3d9d4e75cd2 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "POST /compute/v2.1/servers/a79c44fc-e2f7-4c5b-9013-ae2a33cd3684/action" status: 200 len: 29019 microversion: 2.1 time: 0.088929 Nov 09 20:35:22.110307 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1132/2235] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Nov 9 20:35:22 2021] POST /compute/v2.1/servers/a79c44fc-e2f7-4c5b-9013-ae2a33cd3684/action => generated 29019 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 20:35:23.120694 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-ca473aca-1785-40d3-b209-bfa80dfd3102 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:35:23.121929 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-ca473aca-1785-40d3-b209-bfa80dfd3102 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: a79c44fc-e2f7-4c5b-9013-ae2a33cd3684] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:35:23.128802 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ca473aca-1785-40d3-b209-bfa80dfd3102 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:35:23.129252 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ca473aca-1785-40d3-b209-bfa80dfd3102 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:35:23.130014 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ca473aca-1785-40d3-b209-bfa80dfd3102 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:35:23.130448 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ca473aca-1785-40d3-b209-bfa80dfd3102 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:35:23.212678 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-ca473aca-1785-40d3-b209-bfa80dfd3102 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "POST /compute/v2.1/servers/a79c44fc-e2f7-4c5b-9013-ae2a33cd3684/action" status: 200 len: 31200 microversion: 2.1 time: 0.095854 Nov 09 20:35:23.213333 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1104/2236] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Nov 9 20:35:23 2021] POST /compute/v2.1/servers/a79c44fc-e2f7-4c5b-9013-ae2a33cd3684/action => generated 31200 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 20:35:24.225308 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-ed693a4e-94dc-4848-8373-3db08da380bc tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:35:24.226297 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-ed693a4e-94dc-4848-8373-3db08da380bc tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: a79c44fc-e2f7-4c5b-9013-ae2a33cd3684] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:35:24.233653 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ed693a4e-94dc-4848-8373-3db08da380bc tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:35:24.234093 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ed693a4e-94dc-4848-8373-3db08da380bc tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:35:24.234850 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ed693a4e-94dc-4848-8373-3db08da380bc tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:35:24.235276 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ed693a4e-94dc-4848-8373-3db08da380bc tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:35:24.305956 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-ed693a4e-94dc-4848-8373-3db08da380bc tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "POST /compute/v2.1/servers/a79c44fc-e2f7-4c5b-9013-ae2a33cd3684/action" status: 200 len: 33075 microversion: 2.1 time: 0.084430 Nov 09 20:35:24.306607 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1133/2237] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Nov 9 20:35:24 2021] POST /compute/v2.1/servers/a79c44fc-e2f7-4c5b-9013-ae2a33cd3684/action => generated 33075 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 20:35:25.317553 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-34c0497a-2e33-4f73-a05d-6fb3e604430b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:35:25.318539 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-34c0497a-2e33-4f73-a05d-6fb3e604430b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: a79c44fc-e2f7-4c5b-9013-ae2a33cd3684] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:35:25.326039 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-34c0497a-2e33-4f73-a05d-6fb3e604430b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:35:25.326483 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-34c0497a-2e33-4f73-a05d-6fb3e604430b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:35:25.327237 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-34c0497a-2e33-4f73-a05d-6fb3e604430b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:35:25.327667 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-34c0497a-2e33-4f73-a05d-6fb3e604430b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:35:25.397156 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-34c0497a-2e33-4f73-a05d-6fb3e604430b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "POST /compute/v2.1/servers/a79c44fc-e2f7-4c5b-9013-ae2a33cd3684/action" status: 200 len: 34044 microversion: 2.1 time: 0.083511 Nov 09 20:35:25.397770 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1105/2238] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Nov 9 20:35:25 2021] POST /compute/v2.1/servers/a79c44fc-e2f7-4c5b-9013-ae2a33cd3684/action => generated 34044 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 20:35:26.409789 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-57b8ad9d-6c7d-4ac8-b41f-ee7eca46bfb6 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:35:26.410799 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-57b8ad9d-6c7d-4ac8-b41f-ee7eca46bfb6 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: a79c44fc-e2f7-4c5b-9013-ae2a33cd3684] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:35:26.417835 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-57b8ad9d-6c7d-4ac8-b41f-ee7eca46bfb6 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:35:26.418285 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-57b8ad9d-6c7d-4ac8-b41f-ee7eca46bfb6 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:35:26.419126 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-57b8ad9d-6c7d-4ac8-b41f-ee7eca46bfb6 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:35:26.419553 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-57b8ad9d-6c7d-4ac8-b41f-ee7eca46bfb6 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:35:26.499961 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-57b8ad9d-6c7d-4ac8-b41f-ee7eca46bfb6 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "POST /compute/v2.1/servers/a79c44fc-e2f7-4c5b-9013-ae2a33cd3684/action" status: 200 len: 35227 microversion: 2.1 time: 0.093741 Nov 09 20:35:26.500636 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1134/2239] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Nov 9 20:35:26 2021] POST /compute/v2.1/servers/a79c44fc-e2f7-4c5b-9013-ae2a33cd3684/action => generated 35227 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 20:35:27.512587 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-30174db1-8140-4011-8400-812a96b02357 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:35:27.513582 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-30174db1-8140-4011-8400-812a96b02357 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: a79c44fc-e2f7-4c5b-9013-ae2a33cd3684] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:35:27.520291 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-30174db1-8140-4011-8400-812a96b02357 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:35:27.520765 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-30174db1-8140-4011-8400-812a96b02357 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:35:27.521528 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-30174db1-8140-4011-8400-812a96b02357 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:35:27.521959 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-30174db1-8140-4011-8400-812a96b02357 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:35:27.596250 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-30174db1-8140-4011-8400-812a96b02357 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "POST /compute/v2.1/servers/a79c44fc-e2f7-4c5b-9013-ae2a33cd3684/action" status: 200 len: 36695 microversion: 2.1 time: 0.087655 Nov 09 20:35:27.596939 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1106/2240] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Nov 9 20:35:27 2021] POST /compute/v2.1/servers/a79c44fc-e2f7-4c5b-9013-ae2a33cd3684/action => generated 36695 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 20:35:28.607951 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-ddf4a884-db72-4b04-93ba-d81fd1b068f0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:35:28.609009 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-ddf4a884-db72-4b04-93ba-d81fd1b068f0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: a79c44fc-e2f7-4c5b-9013-ae2a33cd3684] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:35:28.615782 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ddf4a884-db72-4b04-93ba-d81fd1b068f0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:35:28.616228 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ddf4a884-db72-4b04-93ba-d81fd1b068f0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:35:28.617031 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ddf4a884-db72-4b04-93ba-d81fd1b068f0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:35:28.617464 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ddf4a884-db72-4b04-93ba-d81fd1b068f0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:35:28.690497 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-ddf4a884-db72-4b04-93ba-d81fd1b068f0 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "POST /compute/v2.1/servers/a79c44fc-e2f7-4c5b-9013-ae2a33cd3684/action" status: 200 len: 38158 microversion: 2.1 time: 0.086891 Nov 09 20:35:28.691185 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1135/2241] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Nov 9 20:35:28 2021] POST /compute/v2.1/servers/a79c44fc-e2f7-4c5b-9013-ae2a33cd3684/action => generated 38158 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 20:35:29.702978 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-48eac3f4-963a-43ad-953e-28c1de62a80d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:35:29.703980 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-48eac3f4-963a-43ad-953e-28c1de62a80d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: a79c44fc-e2f7-4c5b-9013-ae2a33cd3684] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:35:29.710804 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-48eac3f4-963a-43ad-953e-28c1de62a80d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:35:29.711251 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-48eac3f4-963a-43ad-953e-28c1de62a80d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:35:29.712019 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-48eac3f4-963a-43ad-953e-28c1de62a80d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:35:29.712471 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-48eac3f4-963a-43ad-953e-28c1de62a80d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:35:29.774339 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-48eac3f4-963a-43ad-953e-28c1de62a80d tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "POST /compute/v2.1/servers/a79c44fc-e2f7-4c5b-9013-ae2a33cd3684/action" status: 200 len: 38158 microversion: 2.1 time: 0.075531 Nov 09 20:35:29.774962 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1107/2242] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Nov 9 20:35:29 2021] POST /compute/v2.1/servers/a79c44fc-e2f7-4c5b-9013-ae2a33cd3684/action => generated 38158 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 20:35:30.787031 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-2139cfd4-011a-40aa-bfea-ee48a4a088e3 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:35:30.788019 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-2139cfd4-011a-40aa-bfea-ee48a4a088e3 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: a79c44fc-e2f7-4c5b-9013-ae2a33cd3684] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:35:30.795316 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-2139cfd4-011a-40aa-bfea-ee48a4a088e3 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:35:30.795765 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-2139cfd4-011a-40aa-bfea-ee48a4a088e3 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:35:30.796557 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-2139cfd4-011a-40aa-bfea-ee48a4a088e3 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:35:30.796988 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-2139cfd4-011a-40aa-bfea-ee48a4a088e3 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:35:30.860656 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-2139cfd4-011a-40aa-bfea-ee48a4a088e3 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "POST /compute/v2.1/servers/a79c44fc-e2f7-4c5b-9013-ae2a33cd3684/action" status: 200 len: 38158 microversion: 2.1 time: 0.077429 Nov 09 20:35:30.861299 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1136/2243] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Nov 9 20:35:30 2021] POST /compute/v2.1/servers/a79c44fc-e2f7-4c5b-9013-ae2a33cd3684/action => generated 38158 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 20:35:31.873447 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-8d9e858d-6405-425a-9c31-d84919ad5c15 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:35:31.874454 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-8d9e858d-6405-425a-9c31-d84919ad5c15 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: a79c44fc-e2f7-4c5b-9013-ae2a33cd3684] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:35:31.881507 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8d9e858d-6405-425a-9c31-d84919ad5c15 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:35:31.881946 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8d9e858d-6405-425a-9c31-d84919ad5c15 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:35:31.882699 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8d9e858d-6405-425a-9c31-d84919ad5c15 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:35:31.883120 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8d9e858d-6405-425a-9c31-d84919ad5c15 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:35:31.942459 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-8d9e858d-6405-425a-9c31-d84919ad5c15 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "POST /compute/v2.1/servers/a79c44fc-e2f7-4c5b-9013-ae2a33cd3684/action" status: 200 len: 38158 microversion: 2.1 time: 0.073517 Nov 09 20:35:31.943110 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1108/2244] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Nov 9 20:35:31 2021] POST /compute/v2.1/servers/a79c44fc-e2f7-4c5b-9013-ae2a33cd3684/action => generated 38158 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 20:35:32.955201 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-8479bd42-04ed-48b7-86ea-575917e3bfb9 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:35:32.956196 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-8479bd42-04ed-48b7-86ea-575917e3bfb9 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: a79c44fc-e2f7-4c5b-9013-ae2a33cd3684] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:35:32.963029 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-8479bd42-04ed-48b7-86ea-575917e3bfb9 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:35:32.963482 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-8479bd42-04ed-48b7-86ea-575917e3bfb9 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:35:32.964259 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-8479bd42-04ed-48b7-86ea-575917e3bfb9 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:35:32.964728 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-8479bd42-04ed-48b7-86ea-575917e3bfb9 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:35:33.037601 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-8479bd42-04ed-48b7-86ea-575917e3bfb9 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "POST /compute/v2.1/servers/a79c44fc-e2f7-4c5b-9013-ae2a33cd3684/action" status: 200 len: 38285 microversion: 2.1 time: 0.086162 Nov 09 20:35:33.038206 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1137/2245] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Nov 9 20:35:32 2021] POST /compute/v2.1/servers/a79c44fc-e2f7-4c5b-9013-ae2a33cd3684/action => generated 38285 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 20:35:33.048792 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-bef8c52c-230e-4e93-b7e2-608a68450f8b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:35:33.049375 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-bef8c52c-230e-4e93-b7e2-608a68450f8b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: a79c44fc-e2f7-4c5b-9013-ae2a33cd3684] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:35:33.056226 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bef8c52c-230e-4e93-b7e2-608a68450f8b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:35:33.056708 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bef8c52c-230e-4e93-b7e2-608a68450f8b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:35:33.057474 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bef8c52c-230e-4e93-b7e2-608a68450f8b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:35:33.057906 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bef8c52c-230e-4e93-b7e2-608a68450f8b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:35:33.083138 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-bef8c52c-230e-4e93-b7e2-608a68450f8b tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/a79c44fc-e2f7-4c5b-9013-ae2a33cd3684/ips" status: 200 len: 147 microversion: 2.1 time: 0.038353 Nov 09 20:35:33.083712 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1109/2246] 10.222.0.25 () {58 vars in 1247 bytes} [Tue Nov 9 20:35:33 2021] GET /compute/v2.1/servers/a79c44fc-e2f7-4c5b-9013-ae2a33cd3684/ips => generated 147 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:36:33.175833 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-11a011b5-9f8b-4f47-b5b9-26e27327c563 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:36:33.176475 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-11a011b5-9f8b-4f47-b5b9-26e27327c563 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: a79c44fc-e2f7-4c5b-9013-ae2a33cd3684] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:36:33.183485 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-11a011b5-9f8b-4f47-b5b9-26e27327c563 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:36:33.183935 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-11a011b5-9f8b-4f47-b5b9-26e27327c563 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:36:33.184773 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-11a011b5-9f8b-4f47-b5b9-26e27327c563 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:36:33.185225 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-11a011b5-9f8b-4f47-b5b9-26e27327c563 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:36:33.209824 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-11a011b5-9f8b-4f47-b5b9-26e27327c563 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: a79c44fc-e2f7-4c5b-9013-ae2a33cd3684] Going to try to terminate instance {{(pid=116102) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 09 20:36:33.282837 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-11a011b5-9f8b-4f47-b5b9-26e27327c563 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "DELETE /compute/v2.1/servers/a79c44fc-e2f7-4c5b-9013-ae2a33cd3684" status: 204 len: 0 microversion: 2.1 time: 0.112453 Nov 09 20:36:33.286418 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1138/2247] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Nov 9 20:36:33 2021] DELETE /compute/v2.1/servers/a79c44fc-e2f7-4c5b-9013-ae2a33cd3684 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 09 20:36:33.294089 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-0f55905a-6eff-4f60-a1c7-d5d040e36670 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:36:33.294703 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-0f55905a-6eff-4f60-a1c7-d5d040e36670 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: a79c44fc-e2f7-4c5b-9013-ae2a33cd3684] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:36:33.301470 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0f55905a-6eff-4f60-a1c7-d5d040e36670 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:36:33.301923 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0f55905a-6eff-4f60-a1c7-d5d040e36670 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:36:33.302699 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0f55905a-6eff-4f60-a1c7-d5d040e36670 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:36:33.303137 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0f55905a-6eff-4f60-a1c7-d5d040e36670 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:36:33.434394 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-0f55905a-6eff-4f60-a1c7-d5d040e36670 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:36:33.441967 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-0f55905a-6eff-4f60-a1c7-d5d040e36670 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/a79c44fc-e2f7-4c5b-9013-ae2a33cd3684" status: 200 len: 1673 microversion: 2.1 time: 0.154257 Nov 09 20:36:33.442527 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1110/2248] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:36:33 2021] GET /compute/v2.1/servers/a79c44fc-e2f7-4c5b-9013-ae2a33cd3684 => generated 1673 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:36:34.459475 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-f862fad3-a285-4a87-864a-9bda3ec7cd56 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:36:34.460206 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-f862fad3-a285-4a87-864a-9bda3ec7cd56 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: a79c44fc-e2f7-4c5b-9013-ae2a33cd3684] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:36:34.466390 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f862fad3-a285-4a87-864a-9bda3ec7cd56 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:36:34.466833 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f862fad3-a285-4a87-864a-9bda3ec7cd56 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:36:34.467793 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f862fad3-a285-4a87-864a-9bda3ec7cd56 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:36:34.468262 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f862fad3-a285-4a87-864a-9bda3ec7cd56 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:36:34.598421 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-f862fad3-a285-4a87-864a-9bda3ec7cd56 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:36:34.605659 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-f862fad3-a285-4a87-864a-9bda3ec7cd56 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/a79c44fc-e2f7-4c5b-9013-ae2a33cd3684" status: 200 len: 1673 microversion: 2.1 time: 0.150265 Nov 09 20:36:34.606230 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1139/2249] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:36:34 2021] GET /compute/v2.1/servers/a79c44fc-e2f7-4c5b-9013-ae2a33cd3684 => generated 1673 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:36:35.449247 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [req-2001505e-b769-4d37-b731-fbe8b6380c39 req-d48cd64d-7c8b-4a9c-a6d0-f92da20df86a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a79c44fc-e2f7-4c5b-9013-ae2a33cd3684", "name": "network-vif-deleted", "tag": "562b8c9f-655f-4545-9bf0-9400740a6fe4"}]} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:36:35.452124 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 20:36:35.452124 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: warnings.warn(msg) Nov 09 20:36:35.462045 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-2001505e-b769-4d37-b731-fbe8b6380c39 req-d48cd64d-7c8b-4a9c-a6d0-f92da20df86a service nova] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:36:35.462599 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-2001505e-b769-4d37-b731-fbe8b6380c39 req-d48cd64d-7c8b-4a9c-a6d0-f92da20df86a service nova] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:36:35.476263 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.compute.server_external_events [req-2001505e-b769-4d37-b731-fbe8b6380c39 req-d48cd64d-7c8b-4a9c-a6d0-f92da20df86a service nova] Creating event network-vif-deleted:562b8c9f-655f-4545-9bf0-9400740a6fe4 for instance a79c44fc-e2f7-4c5b-9013-ae2a33cd3684 on hv-cinder-80135 Nov 09 20:36:35.481580 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [req-2001505e-b769-4d37-b731-fbe8b6380c39 req-d48cd64d-7c8b-4a9c-a6d0-f92da20df86a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036188 Nov 09 20:36:35.482272 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1111/2250] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Nov 9 20:36:35 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:36:35.622855 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-dc654b5a-6c22-4037-8542-f72d168e6f3a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:36:35.624730 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-dc654b5a-6c22-4037-8542-f72d168e6f3a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: a79c44fc-e2f7-4c5b-9013-ae2a33cd3684] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:36:35.631748 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-dc654b5a-6c22-4037-8542-f72d168e6f3a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:36:35.632192 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-dc654b5a-6c22-4037-8542-f72d168e6f3a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:36:35.633007 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-dc654b5a-6c22-4037-8542-f72d168e6f3a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:36:35.633434 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-dc654b5a-6c22-4037-8542-f72d168e6f3a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:36:35.666190 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-dc654b5a-6c22-4037-8542-f72d168e6f3a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:36:35.666633 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-dc654b5a-6c22-4037-8542-f72d168e6f3a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:36:35.667073 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.objects.instance [None req-dc654b5a-6c22-4037-8542-f72d168e6f3a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lazy-loading 'fault' on Instance uuid a79c44fc-e2f7-4c5b-9013-ae2a33cd3684 {{(pid=116102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 09 20:36:35.707137 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-dc654b5a-6c22-4037-8542-f72d168e6f3a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2764f4c77b47629d7c33ea15a5b566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04aa1d479bda429cb8cc96145ab3e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:36:35.714507 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-dc654b5a-6c22-4037-8542-f72d168e6f3a tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/a79c44fc-e2f7-4c5b-9013-ae2a33cd3684" status: 200 len: 1326 microversion: 2.1 time: 0.095352 Nov 09 20:36:35.715071 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1140/2251] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:36:35 2021] GET /compute/v2.1/servers/a79c44fc-e2f7-4c5b-9013-ae2a33cd3684 => generated 1326 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:36:36.733383 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-e3a7b106-5553-48ed-ab83-038102bd7068 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:36:36.734095 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-e3a7b106-5553-48ed-ab83-038102bd7068 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: a79c44fc-e2f7-4c5b-9013-ae2a33cd3684] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:36:36.740559 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e3a7b106-5553-48ed-ab83-038102bd7068 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:36:36.741015 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e3a7b106-5553-48ed-ab83-038102bd7068 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:36:36.741784 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e3a7b106-5553-48ed-ab83-038102bd7068 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:36:36.742225 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e3a7b106-5553-48ed-ab83-038102bd7068 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:36:36.755770 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.wsgi [None req-e3a7b106-5553-48ed-ab83-038102bd7068 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] HTTP exception thrown: Instance a79c44fc-e2f7-4c5b-9013-ae2a33cd3684 could not be found. Nov 09 20:36:36.756352 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-e3a7b106-5553-48ed-ab83-038102bd7068 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Returning 404 to user: Instance a79c44fc-e2f7-4c5b-9013-ae2a33cd3684 could not be found. {{(pid=116103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 09 20:36:36.757187 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-e3a7b106-5553-48ed-ab83-038102bd7068 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/a79c44fc-e2f7-4c5b-9013-ae2a33cd3684" status: 404 len: 111 microversion: 2.1 time: 0.028610 Nov 09 20:36:36.757707 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1112/2252] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:36:36 2021] GET /compute/v2.1/servers/a79c44fc-e2f7-4c5b-9013-ae2a33cd3684 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 09 20:36:36.765763 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-001aa9f9-88cb-4e66-a114-504dc7ce6054 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '.version_select at 0x7fab3ff545e0>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:36:36.783103 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-001aa9f9-88cb-4e66-a114-504dc7ce6054 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1663927794" status: 202 len: 0 microversion: 2.1 time: 0.021019 Nov 09 20:36:36.783663 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1141/2253] 10.222.0.25 () {58 vars in 1220 bytes} [Tue Nov 9 20:36:36 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1663927794 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 09 20:36:37.392391 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-4621fe70-afbe-4a66-86f5-6cde949b5a61 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:36:37.392923 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-4621fe70-afbe-4a66-86f5-6cde949b5a61 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: a79c44fc-e2f7-4c5b-9013-ae2a33cd3684] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:36:37.399094 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4621fe70-afbe-4a66-86f5-6cde949b5a61 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:36:37.399534 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4621fe70-afbe-4a66-86f5-6cde949b5a61 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:36:37.400293 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4621fe70-afbe-4a66-86f5-6cde949b5a61 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:36:37.400748 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4621fe70-afbe-4a66-86f5-6cde949b5a61 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:36:37.414262 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.wsgi [None req-4621fe70-afbe-4a66-86f5-6cde949b5a61 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] HTTP exception thrown: Instance a79c44fc-e2f7-4c5b-9013-ae2a33cd3684 could not be found. Nov 09 20:36:37.414875 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-4621fe70-afbe-4a66-86f5-6cde949b5a61 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Returning 404 to user: Instance a79c44fc-e2f7-4c5b-9013-ae2a33cd3684 could not be found. {{(pid=116103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 09 20:36:37.415675 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-4621fe70-afbe-4a66-86f5-6cde949b5a61 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "DELETE /compute/v2.1/servers/a79c44fc-e2f7-4c5b-9013-ae2a33cd3684" status: 404 len: 111 microversion: 2.1 time: 0.027514 Nov 09 20:36:37.416198 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1113/2254] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Nov 9 20:36:37 2021] DELETE /compute/v2.1/servers/a79c44fc-e2f7-4c5b-9013-ae2a33cd3684 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 09 20:36:37.423892 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-3a6c9087-1309-40ba-975c-2c86ceceb143 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:36:37.424528 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-3a6c9087-1309-40ba-975c-2c86ceceb143 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: a79c44fc-e2f7-4c5b-9013-ae2a33cd3684] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:36:37.430319 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-3a6c9087-1309-40ba-975c-2c86ceceb143 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:36:37.430767 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-3a6c9087-1309-40ba-975c-2c86ceceb143 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:36:37.431534 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-3a6c9087-1309-40ba-975c-2c86ceceb143 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:36:37.431968 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-3a6c9087-1309-40ba-975c-2c86ceceb143 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:36:37.444844 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.wsgi [None req-3a6c9087-1309-40ba-975c-2c86ceceb143 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] HTTP exception thrown: Instance a79c44fc-e2f7-4c5b-9013-ae2a33cd3684 could not be found. Nov 09 20:36:37.445429 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-3a6c9087-1309-40ba-975c-2c86ceceb143 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Returning 404 to user: Instance a79c44fc-e2f7-4c5b-9013-ae2a33cd3684 could not be found. {{(pid=116102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 09 20:36:37.446243 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-3a6c9087-1309-40ba-975c-2c86ceceb143 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/a79c44fc-e2f7-4c5b-9013-ae2a33cd3684" status: 404 len: 111 microversion: 2.1 time: 0.026084 Nov 09 20:36:37.446756 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1142/2255] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:36:37 2021] GET /compute/v2.1/servers/a79c44fc-e2f7-4c5b-9013-ae2a33cd3684 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 09 20:36:55.308668 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-f7e5472f-8ba6-45c0-8ef0-9db4a23bc989 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:36:55.309201 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-f7e5472f-8ba6-45c0-8ef0-9db4a23bc989 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 10bef0be-b648-4906-b91c-5582ec00cb5c] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:36:55.315703 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f7e5472f-8ba6-45c0-8ef0-9db4a23bc989 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:36:55.316163 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f7e5472f-8ba6-45c0-8ef0-9db4a23bc989 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:36:55.316984 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f7e5472f-8ba6-45c0-8ef0-9db4a23bc989 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:36:55.317424 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f7e5472f-8ba6-45c0-8ef0-9db4a23bc989 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:36:55.342797 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-f7e5472f-8ba6-45c0-8ef0-9db4a23bc989 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 10bef0be-b648-4906-b91c-5582ec00cb5c] Going to try to terminate instance {{(pid=116103) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 09 20:36:55.346480 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-53e2b4dc-91ab-473b-a2ac-0f248d9ff701 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:36:55.347541 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-53e2b4dc-91ab-473b-a2ac-0f248d9ff701 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:36:55.353739 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-53e2b4dc-91ab-473b-a2ac-0f248d9ff701 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:36:55.354196 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-53e2b4dc-91ab-473b-a2ac-0f248d9ff701 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:36:55.354975 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-53e2b4dc-91ab-473b-a2ac-0f248d9ff701 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:36:55.355479 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-53e2b4dc-91ab-473b-a2ac-0f248d9ff701 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:36:55.371390 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.wsgi [None req-53e2b4dc-91ab-473b-a2ac-0f248d9ff701 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] HTTP exception thrown: Instance ae338c69-d22d-41c2-89b0-b0cec236521e could not be found. Nov 09 20:36:55.372057 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-53e2b4dc-91ab-473b-a2ac-0f248d9ff701 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Returning 404 to user: Instance ae338c69-d22d-41c2-89b0-b0cec236521e could not be found. {{(pid=116102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 09 20:36:55.372901 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-53e2b4dc-91ab-473b-a2ac-0f248d9ff701 tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "DELETE /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 404 len: 111 microversion: 2.1 time: 0.031597 Nov 09 20:36:55.373654 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1143/2256] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Nov 9 20:36:55 2021] DELETE /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 09 20:36:55.382719 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-8478a55a-e4f8-4f4f-ab84-f5204771e17a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:36:55.383383 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-8478a55a-e4f8-4f4f-ab84-f5204771e17a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] [instance: ae338c69-d22d-41c2-89b0-b0cec236521e] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:36:55.389497 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-8478a55a-e4f8-4f4f-ab84-f5204771e17a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:36:55.389940 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-8478a55a-e4f8-4f4f-ab84-f5204771e17a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:36:55.390696 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-8478a55a-e4f8-4f4f-ab84-f5204771e17a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:36:55.391690 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-8478a55a-e4f8-4f4f-ab84-f5204771e17a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:36:55.406293 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.wsgi [None req-8478a55a-e4f8-4f4f-ab84-f5204771e17a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] HTTP exception thrown: Instance ae338c69-d22d-41c2-89b0-b0cec236521e could not be found. Nov 09 20:36:55.407726 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-8478a55a-e4f8-4f4f-ab84-f5204771e17a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] Returning 404 to user: Instance ae338c69-d22d-41c2-89b0-b0cec236521e could not be found. {{(pid=116102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 09 20:36:55.408556 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-8478a55a-e4f8-4f4f-ab84-f5204771e17a tempest-AttachVolumeShelveTestJSON-813204642 tempest-AttachVolumeShelveTestJSON-813204642-project] 10.222.0.25 "GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e" status: 404 len: 111 microversion: 2.1 time: 0.030010 Nov 09 20:36:55.409084 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1144/2257] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:36:55 2021] GET /compute/v2.1/servers/ae338c69-d22d-41c2-89b0-b0cec236521e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 09 20:36:55.428332 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-f7e5472f-8ba6-45c0-8ef0-9db4a23bc989 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "DELETE /compute/v2.1/servers/10bef0be-b648-4906-b91c-5582ec00cb5c" status: 204 len: 0 microversion: 2.1 time: 0.122931 Nov 09 20:36:55.428947 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1114/2258] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Nov 9 20:36:55 2021] DELETE /compute/v2.1/servers/10bef0be-b648-4906-b91c-5582ec00cb5c => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 09 20:36:55.436709 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-c17cc53d-31ef-40d4-ab43-e36917ef9033 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:36:55.437305 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-c17cc53d-31ef-40d4-ab43-e36917ef9033 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 10bef0be-b648-4906-b91c-5582ec00cb5c] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:36:55.443200 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c17cc53d-31ef-40d4-ab43-e36917ef9033 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:36:55.443733 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c17cc53d-31ef-40d4-ab43-e36917ef9033 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:36:55.444528 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c17cc53d-31ef-40d4-ab43-e36917ef9033 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:36:55.444960 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c17cc53d-31ef-40d4-ab43-e36917ef9033 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:36:55.579793 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-c17cc53d-31ef-40d4-ab43-e36917ef9033 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:36:55.587102 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-c17cc53d-31ef-40d4-ab43-e36917ef9033 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/10bef0be-b648-4906-b91c-5582ec00cb5c" status: 200 len: 1506 microversion: 2.1 time: 0.154043 Nov 09 20:36:55.587681 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1145/2259] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:36:55 2021] GET /compute/v2.1/servers/10bef0be-b648-4906-b91c-5582ec00cb5c => generated 1506 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:36:56.604176 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-09934046-782a-4300-a38b-9bff84cbb1f5 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:36:56.604995 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-09934046-782a-4300-a38b-9bff84cbb1f5 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 10bef0be-b648-4906-b91c-5582ec00cb5c] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:36:56.610976 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-09934046-782a-4300-a38b-9bff84cbb1f5 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:36:56.611463 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-09934046-782a-4300-a38b-9bff84cbb1f5 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:36:56.612374 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-09934046-782a-4300-a38b-9bff84cbb1f5 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:36:56.612842 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-09934046-782a-4300-a38b-9bff84cbb1f5 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:36:56.750323 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-09934046-782a-4300-a38b-9bff84cbb1f5 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:36:56.758192 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-09934046-782a-4300-a38b-9bff84cbb1f5 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/10bef0be-b648-4906-b91c-5582ec00cb5c" status: 200 len: 1506 microversion: 2.1 time: 0.158197 Nov 09 20:36:56.758760 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1115/2260] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:36:56 2021] GET /compute/v2.1/servers/10bef0be-b648-4906-b91c-5582ec00cb5c => generated 1506 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:36:56.998037 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [req-475c375f-2b78-483e-9d32-8bfcb19839ed req-663ecf3b-76f6-4ea0-b315-31211b5836da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10bef0be-b648-4906-b91c-5582ec00cb5c", "name": "network-vif-deleted", "tag": "341cb797-77c6-4bd0-a210-da8c6d2f6c39"}]} {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:36:57.000260 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 20:36:57.000260 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: warnings.warn(msg) Nov 09 20:36:57.008654 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [req-475c375f-2b78-483e-9d32-8bfcb19839ed req-663ecf3b-76f6-4ea0-b315-31211b5836da service nova] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:36:57.009107 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [req-475c375f-2b78-483e-9d32-8bfcb19839ed req-663ecf3b-76f6-4ea0-b315-31211b5836da service nova] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:36:57.023231 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.compute.server_external_events [req-475c375f-2b78-483e-9d32-8bfcb19839ed req-663ecf3b-76f6-4ea0-b315-31211b5836da service nova] Creating event network-vif-deleted:341cb797-77c6-4bd0-a210-da8c6d2f6c39 for instance 10bef0be-b648-4906-b91c-5582ec00cb5c on hv-cinder-80135 Nov 09 20:36:57.029184 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [req-475c375f-2b78-483e-9d32-8bfcb19839ed req-663ecf3b-76f6-4ea0-b315-31211b5836da service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034324 Nov 09 20:36:57.029793 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1146/2261] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Nov 9 20:36:56 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:36:57.774868 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-2adde49f-37cb-4859-ba69-0c5435a6e096 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:36:57.775657 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-2adde49f-37cb-4859-ba69-0c5435a6e096 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 10bef0be-b648-4906-b91c-5582ec00cb5c] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:36:57.782276 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2adde49f-37cb-4859-ba69-0c5435a6e096 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:36:57.782672 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2adde49f-37cb-4859-ba69-0c5435a6e096 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:36:57.783435 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2adde49f-37cb-4859-ba69-0c5435a6e096 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:36:57.783861 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2adde49f-37cb-4859-ba69-0c5435a6e096 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:36:57.797294 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.wsgi [None req-2adde49f-37cb-4859-ba69-0c5435a6e096 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] HTTP exception thrown: Instance 10bef0be-b648-4906-b91c-5582ec00cb5c could not be found. Nov 09 20:36:57.797875 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-2adde49f-37cb-4859-ba69-0c5435a6e096 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Returning 404 to user: Instance 10bef0be-b648-4906-b91c-5582ec00cb5c could not be found. {{(pid=116103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 09 20:36:57.798958 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-2adde49f-37cb-4859-ba69-0c5435a6e096 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/10bef0be-b648-4906-b91c-5582ec00cb5c" status: 404 len: 111 microversion: 2.1 time: 0.027919 Nov 09 20:36:57.799497 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1116/2262] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:36:57 2021] GET /compute/v2.1/servers/10bef0be-b648-4906-b91c-5582ec00cb5c => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 09 20:36:57.807853 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-1139e702-153b-416b-83b8-acfcfba6e470 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:36:57.808445 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-1139e702-153b-416b-83b8-acfcfba6e470 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:36:57.815738 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-1139e702-153b-416b-83b8-acfcfba6e470 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:36:57.816527 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-1139e702-153b-416b-83b8-acfcfba6e470 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:36:57.817363 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-1139e702-153b-416b-83b8-acfcfba6e470 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:36:57.818029 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-1139e702-153b-416b-83b8-acfcfba6e470 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:36:57.843541 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-1139e702-153b-416b-83b8-acfcfba6e470 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Going to try to terminate instance {{(pid=116102) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 09 20:36:57.926608 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-1139e702-153b-416b-83b8-acfcfba6e470 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "DELETE /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 204 len: 0 microversion: 2.1 time: 0.122214 Nov 09 20:36:57.928042 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1147/2263] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Nov 9 20:36:57 2021] DELETE /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 09 20:36:57.936342 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-36997a8b-4c07-4f8e-98fb-b83e1a1d7d5b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:36:57.937095 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-36997a8b-4c07-4f8e-98fb-b83e1a1d7d5b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:36:57.944189 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-36997a8b-4c07-4f8e-98fb-b83e1a1d7d5b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:36:57.944754 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-36997a8b-4c07-4f8e-98fb-b83e1a1d7d5b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:36:57.945522 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-36997a8b-4c07-4f8e-98fb-b83e1a1d7d5b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:36:57.946700 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-36997a8b-4c07-4f8e-98fb-b83e1a1d7d5b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:36:58.146599 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-36997a8b-4c07-4f8e-98fb-b83e1a1d7d5b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:36:58.155496 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-36997a8b-4c07-4f8e-98fb-b83e1a1d7d5b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1567 microversion: 2.1 time: 0.223360 Nov 09 20:36:58.165812 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1117/2264] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:36:57 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1567 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:36:59.177334 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-7f0dde4d-34f3-4906-bef8-19abbe26c715 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:36:59.178107 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-7f0dde4d-34f3-4906-bef8-19abbe26c715 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:36:59.190106 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-7f0dde4d-34f3-4906-bef8-19abbe26c715 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:36:59.190563 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-7f0dde4d-34f3-4906-bef8-19abbe26c715 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:36:59.191652 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-7f0dde4d-34f3-4906-bef8-19abbe26c715 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:36:59.192598 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-7f0dde4d-34f3-4906-bef8-19abbe26c715 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:36:59.321657 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-7f0dde4d-34f3-4906-bef8-19abbe26c715 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:36:59.336500 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-7f0dde4d-34f3-4906-bef8-19abbe26c715 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1525 microversion: 2.1 time: 0.164182 Nov 09 20:36:59.341203 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1148/2265] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:36:59 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1525 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:36:59.477878 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [req-51018c36-383f-420d-a97a-a3d6cbb0e956 req-57f6a35e-8e6d-46d1-94cb-3cd72f8f8edd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80ce5722-8f51-457b-9f9b-ff4b63b103df", "name": "network-vif-deleted", "tag": "bbfda69a-3f26-4b91-a131-9256661c754a"}]} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:36:59.479304 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 20:36:59.479304 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: warnings.warn(msg) Nov 09 20:36:59.504850 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-51018c36-383f-420d-a97a-a3d6cbb0e956 req-57f6a35e-8e6d-46d1-94cb-3cd72f8f8edd service nova] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:36:59.505383 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-51018c36-383f-420d-a97a-a3d6cbb0e956 req-57f6a35e-8e6d-46d1-94cb-3cd72f8f8edd service nova] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:36:59.527508 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.compute.server_external_events [req-51018c36-383f-420d-a97a-a3d6cbb0e956 req-57f6a35e-8e6d-46d1-94cb-3cd72f8f8edd service nova] Creating event network-vif-deleted:bbfda69a-3f26-4b91-a131-9256661c754a for instance 80ce5722-8f51-457b-9f9b-ff4b63b103df on hv-cinder-80135 Nov 09 20:36:59.534271 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [req-51018c36-383f-420d-a97a-a3d6cbb0e956 req-57f6a35e-8e6d-46d1-94cb-3cd72f8f8edd service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059834 Nov 09 20:36:59.535149 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1118/2266] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Nov 9 20:36:59 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:37:00.357642 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-fc725028-0e44-493d-837d-367e7fb64fee tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:37:00.358345 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-fc725028-0e44-493d-837d-367e7fb64fee tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:37:00.368546 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-fc725028-0e44-493d-837d-367e7fb64fee tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:37:00.368939 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-fc725028-0e44-493d-837d-367e7fb64fee tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:37:00.369716 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-fc725028-0e44-493d-837d-367e7fb64fee tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:37:00.370144 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-fc725028-0e44-493d-837d-367e7fb64fee tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:37:00.433596 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-fc725028-0e44-493d-837d-367e7fb64fee tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:37:00.441802 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-fc725028-0e44-493d-837d-367e7fb64fee tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.087767 Nov 09 20:37:00.442371 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1149/2267] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:37:00 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:37:01.462046 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-85d48cae-9839-4d46-a75c-405dfe4b4d32 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:37:01.463239 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-85d48cae-9839-4d46-a75c-405dfe4b4d32 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:37:01.471479 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-85d48cae-9839-4d46-a75c-405dfe4b4d32 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:37:01.471994 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-85d48cae-9839-4d46-a75c-405dfe4b4d32 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:37:01.472997 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-85d48cae-9839-4d46-a75c-405dfe4b4d32 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:37:01.473426 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-85d48cae-9839-4d46-a75c-405dfe4b4d32 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:37:01.543523 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-85d48cae-9839-4d46-a75c-405dfe4b4d32 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:37:01.551977 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-85d48cae-9839-4d46-a75c-405dfe4b4d32 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.093839 Nov 09 20:37:01.552582 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1119/2268] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:37:01 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:37:02.571053 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-680ab20d-bb16-42c0-bd8e-5a64c1e10333 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:37:02.571683 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-680ab20d-bb16-42c0-bd8e-5a64c1e10333 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:37:02.577701 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-680ab20d-bb16-42c0-bd8e-5a64c1e10333 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:37:02.578937 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-680ab20d-bb16-42c0-bd8e-5a64c1e10333 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:37:02.580079 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-680ab20d-bb16-42c0-bd8e-5a64c1e10333 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:37:02.580651 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-680ab20d-bb16-42c0-bd8e-5a64c1e10333 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:37:02.655317 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-680ab20d-bb16-42c0-bd8e-5a64c1e10333 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:37:02.663146 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-680ab20d-bb16-42c0-bd8e-5a64c1e10333 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.096809 Nov 09 20:37:02.663704 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1150/2269] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:37:02 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 20:37:03.680442 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-a746bfd9-337f-4a1c-afaf-93500c147dbe tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:37:03.681016 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-a746bfd9-337f-4a1c-afaf-93500c147dbe tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:37:03.687155 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a746bfd9-337f-4a1c-afaf-93500c147dbe tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:37:03.687703 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a746bfd9-337f-4a1c-afaf-93500c147dbe tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:37:03.688539 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a746bfd9-337f-4a1c-afaf-93500c147dbe tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:37:03.688971 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a746bfd9-337f-4a1c-afaf-93500c147dbe tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:37:03.760277 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-a746bfd9-337f-4a1c-afaf-93500c147dbe tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:37:03.768790 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-a746bfd9-337f-4a1c-afaf-93500c147dbe tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.092027 Nov 09 20:37:03.769363 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1120/2270] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:37:03 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:37:04.785316 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-0cdb5a11-6b79-44c0-93bc-14b1da820b46 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:37:04.785915 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-0cdb5a11-6b79-44c0-93bc-14b1da820b46 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:37:04.792189 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-0cdb5a11-6b79-44c0-93bc-14b1da820b46 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:37:04.792611 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-0cdb5a11-6b79-44c0-93bc-14b1da820b46 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:37:04.793383 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-0cdb5a11-6b79-44c0-93bc-14b1da820b46 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:37:04.793816 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-0cdb5a11-6b79-44c0-93bc-14b1da820b46 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:37:05.017037 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-0cdb5a11-6b79-44c0-93bc-14b1da820b46 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:37:05.024652 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-0cdb5a11-6b79-44c0-93bc-14b1da820b46 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.243184 Nov 09 20:37:05.025209 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1151/2271] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:37:04 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:37:06.041752 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-1c06e23b-6724-4a9f-8cf6-085aa6a2fdc2 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:37:06.042354 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-1c06e23b-6724-4a9f-8cf6-085aa6a2fdc2 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:37:06.048607 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1c06e23b-6724-4a9f-8cf6-085aa6a2fdc2 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:37:06.049060 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1c06e23b-6724-4a9f-8cf6-085aa6a2fdc2 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:37:06.049826 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1c06e23b-6724-4a9f-8cf6-085aa6a2fdc2 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:37:06.050258 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1c06e23b-6724-4a9f-8cf6-085aa6a2fdc2 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:37:06.112075 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-1c06e23b-6724-4a9f-8cf6-085aa6a2fdc2 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:37:06.119720 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-1c06e23b-6724-4a9f-8cf6-085aa6a2fdc2 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.081624 Nov 09 20:37:06.120271 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1121/2272] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:37:06 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:37:07.136046 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-b9613ea4-1901-4544-b37c-4d6a7d696819 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:37:07.136722 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-b9613ea4-1901-4544-b37c-4d6a7d696819 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:37:07.143141 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b9613ea4-1901-4544-b37c-4d6a7d696819 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:37:07.143581 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b9613ea4-1901-4544-b37c-4d6a7d696819 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:37:07.144338 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b9613ea4-1901-4544-b37c-4d6a7d696819 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:37:07.144785 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b9613ea4-1901-4544-b37c-4d6a7d696819 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:37:07.202366 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-b9613ea4-1901-4544-b37c-4d6a7d696819 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:37:07.210614 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-b9613ea4-1901-4544-b37c-4d6a7d696819 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.078181 Nov 09 20:37:07.211164 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1152/2273] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:37:07 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:37:08.227798 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-d8d203bd-e7d0-4fdc-be03-cf620cc8a385 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:37:08.228442 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-d8d203bd-e7d0-4fdc-be03-cf620cc8a385 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:37:08.235254 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d8d203bd-e7d0-4fdc-be03-cf620cc8a385 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:37:08.235786 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d8d203bd-e7d0-4fdc-be03-cf620cc8a385 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:37:08.236591 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d8d203bd-e7d0-4fdc-be03-cf620cc8a385 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:37:08.237022 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d8d203bd-e7d0-4fdc-be03-cf620cc8a385 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:37:08.295635 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-d8d203bd-e7d0-4fdc-be03-cf620cc8a385 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:37:08.304036 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-d8d203bd-e7d0-4fdc-be03-cf620cc8a385 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.079902 Nov 09 20:37:08.304637 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1122/2274] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:37:08 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:37:09.321225 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-93ee6947-6beb-4c69-8452-d5718f7685fc tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:37:09.321827 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-93ee6947-6beb-4c69-8452-d5718f7685fc tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:37:09.327940 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-93ee6947-6beb-4c69-8452-d5718f7685fc tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:37:09.329439 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-93ee6947-6beb-4c69-8452-d5718f7685fc tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:37:09.330206 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-93ee6947-6beb-4c69-8452-d5718f7685fc tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:37:09.330636 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-93ee6947-6beb-4c69-8452-d5718f7685fc tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:37:09.387940 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-93ee6947-6beb-4c69-8452-d5718f7685fc tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:37:09.396681 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-93ee6947-6beb-4c69-8452-d5718f7685fc tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.079167 Nov 09 20:37:09.397239 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1153/2275] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:37:09 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:37:10.413130 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-9005ea96-936d-4b32-ab8f-ed55f537ad7f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:37:10.413731 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-9005ea96-936d-4b32-ab8f-ed55f537ad7f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:37:10.419899 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9005ea96-936d-4b32-ab8f-ed55f537ad7f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:37:10.420373 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9005ea96-936d-4b32-ab8f-ed55f537ad7f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:37:10.421235 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9005ea96-936d-4b32-ab8f-ed55f537ad7f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:37:10.421695 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9005ea96-936d-4b32-ab8f-ed55f537ad7f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:37:10.479693 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-9005ea96-936d-4b32-ab8f-ed55f537ad7f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:37:10.487685 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-9005ea96-936d-4b32-ab8f-ed55f537ad7f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.078172 Nov 09 20:37:10.488239 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1123/2276] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:37:10 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:37:11.504387 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-c90d32b7-1b45-4f17-8f9d-56b1e1490eb4 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:37:11.505037 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-c90d32b7-1b45-4f17-8f9d-56b1e1490eb4 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:37:11.511223 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c90d32b7-1b45-4f17-8f9d-56b1e1490eb4 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:37:11.511673 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c90d32b7-1b45-4f17-8f9d-56b1e1490eb4 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:37:11.512456 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c90d32b7-1b45-4f17-8f9d-56b1e1490eb4 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:37:11.512889 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c90d32b7-1b45-4f17-8f9d-56b1e1490eb4 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:37:11.571114 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-c90d32b7-1b45-4f17-8f9d-56b1e1490eb4 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:37:11.578857 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-c90d32b7-1b45-4f17-8f9d-56b1e1490eb4 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.078517 Nov 09 20:37:11.579411 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1154/2277] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:37:11 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:37:12.596275 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-a68e6b63-79be-4682-a4a9-fd9ebbf838c2 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:37:12.596921 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-a68e6b63-79be-4682-a4a9-fd9ebbf838c2 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:37:12.603175 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a68e6b63-79be-4682-a4a9-fd9ebbf838c2 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:37:12.603613 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a68e6b63-79be-4682-a4a9-fd9ebbf838c2 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:37:12.604372 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a68e6b63-79be-4682-a4a9-fd9ebbf838c2 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:37:12.604834 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a68e6b63-79be-4682-a4a9-fd9ebbf838c2 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:37:12.667841 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-a68e6b63-79be-4682-a4a9-fd9ebbf838c2 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:37:12.676035 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-a68e6b63-79be-4682-a4a9-fd9ebbf838c2 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.084057 Nov 09 20:37:12.676641 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1124/2278] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:37:12 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:37:13.691432 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-71a02607-7046-4e10-8530-7d543d952d58 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:37:13.692019 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-71a02607-7046-4e10-8530-7d543d952d58 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:37:13.698150 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-71a02607-7046-4e10-8530-7d543d952d58 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:37:13.698593 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-71a02607-7046-4e10-8530-7d543d952d58 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:37:13.699349 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-71a02607-7046-4e10-8530-7d543d952d58 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:37:13.699773 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-71a02607-7046-4e10-8530-7d543d952d58 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:37:13.758668 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-71a02607-7046-4e10-8530-7d543d952d58 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:37:13.766452 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-71a02607-7046-4e10-8530-7d543d952d58 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.078629 Nov 09 20:37:13.767005 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1155/2279] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:37:13 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:37:14.782853 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-ff06d2af-9ef9-465c-863f-111a05a7492b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:37:14.783531 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-ff06d2af-9ef9-465c-863f-111a05a7492b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:37:14.789568 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ff06d2af-9ef9-465c-863f-111a05a7492b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:37:14.790003 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ff06d2af-9ef9-465c-863f-111a05a7492b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:37:14.790774 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ff06d2af-9ef9-465c-863f-111a05a7492b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:37:14.791172 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ff06d2af-9ef9-465c-863f-111a05a7492b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:37:14.849600 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-ff06d2af-9ef9-465c-863f-111a05a7492b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:37:14.857192 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-ff06d2af-9ef9-465c-863f-111a05a7492b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.077930 Nov 09 20:37:14.857747 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1125/2280] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:37:14 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:37:15.874266 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-989f5f4f-1d69-4b0a-abb2-75b6f07413bf tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:37:15.875553 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-989f5f4f-1d69-4b0a-abb2-75b6f07413bf tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:37:15.881624 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-989f5f4f-1d69-4b0a-abb2-75b6f07413bf tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:37:15.882061 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-989f5f4f-1d69-4b0a-abb2-75b6f07413bf tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:37:15.882811 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-989f5f4f-1d69-4b0a-abb2-75b6f07413bf tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:37:15.883236 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-989f5f4f-1d69-4b0a-abb2-75b6f07413bf tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:37:15.941088 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-989f5f4f-1d69-4b0a-abb2-75b6f07413bf tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:37:15.948601 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-989f5f4f-1d69-4b0a-abb2-75b6f07413bf tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.078100 Nov 09 20:37:15.949146 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1156/2281] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:37:15 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:37:16.965576 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-0485f580-5723-401c-aeaf-220e34b602b5 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:37:16.966176 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-0485f580-5723-401c-aeaf-220e34b602b5 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:37:16.973509 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0485f580-5723-401c-aeaf-220e34b602b5 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:37:16.973951 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0485f580-5723-401c-aeaf-220e34b602b5 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:37:16.974712 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0485f580-5723-401c-aeaf-220e34b602b5 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:37:16.975139 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0485f580-5723-401c-aeaf-220e34b602b5 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:37:17.034810 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-0485f580-5723-401c-aeaf-220e34b602b5 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:37:17.042394 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-0485f580-5723-401c-aeaf-220e34b602b5 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.080472 Nov 09 20:37:17.042947 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1126/2282] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:37:16 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:37:18.059256 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-b2093cae-93f4-4361-8464-f89d68794547 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:37:18.059858 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-b2093cae-93f4-4361-8464-f89d68794547 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:37:18.067125 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b2093cae-93f4-4361-8464-f89d68794547 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:37:18.067570 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b2093cae-93f4-4361-8464-f89d68794547 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:37:18.068340 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b2093cae-93f4-4361-8464-f89d68794547 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:37:18.068797 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b2093cae-93f4-4361-8464-f89d68794547 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:37:18.282121 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-b2093cae-93f4-4361-8464-f89d68794547 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:37:18.290293 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-b2093cae-93f4-4361-8464-f89d68794547 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.234683 Nov 09 20:37:18.290858 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1157/2283] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:37:18 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:37:19.307296 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-91ffd648-03c0-4566-9b3d-4f057d40a4f6 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:37:19.307897 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-91ffd648-03c0-4566-9b3d-4f057d40a4f6 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:37:19.314815 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-91ffd648-03c0-4566-9b3d-4f057d40a4f6 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:37:19.315255 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-91ffd648-03c0-4566-9b3d-4f057d40a4f6 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:37:19.316011 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-91ffd648-03c0-4566-9b3d-4f057d40a4f6 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:37:19.316459 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-91ffd648-03c0-4566-9b3d-4f057d40a4f6 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:37:19.378030 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-91ffd648-03c0-4566-9b3d-4f057d40a4f6 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:37:19.385594 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-91ffd648-03c0-4566-9b3d-4f057d40a4f6 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.081919 Nov 09 20:37:19.386147 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1127/2284] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:37:19 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:37:20.402495 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-41a627ba-ea2d-4575-8fe1-98f1d08624f3 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:37:20.403060 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-41a627ba-ea2d-4575-8fe1-98f1d08624f3 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:37:20.409270 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-41a627ba-ea2d-4575-8fe1-98f1d08624f3 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:37:20.409710 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-41a627ba-ea2d-4575-8fe1-98f1d08624f3 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:37:20.410474 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-41a627ba-ea2d-4575-8fe1-98f1d08624f3 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:37:20.410900 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-41a627ba-ea2d-4575-8fe1-98f1d08624f3 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:37:20.470037 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-41a627ba-ea2d-4575-8fe1-98f1d08624f3 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:37:20.480443 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-41a627ba-ea2d-4575-8fe1-98f1d08624f3 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.081664 Nov 09 20:37:20.480999 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1158/2285] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:37:20 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:37:21.497369 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-dcc18767-daa7-40af-bace-26f9108dd646 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:37:21.497969 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-dcc18767-daa7-40af-bace-26f9108dd646 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:37:21.504623 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-dcc18767-daa7-40af-bace-26f9108dd646 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:37:21.505070 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-dcc18767-daa7-40af-bace-26f9108dd646 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:37:21.505835 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-dcc18767-daa7-40af-bace-26f9108dd646 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:37:21.506265 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-dcc18767-daa7-40af-bace-26f9108dd646 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:37:21.565689 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-dcc18767-daa7-40af-bace-26f9108dd646 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:37:21.573321 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-dcc18767-daa7-40af-bace-26f9108dd646 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.079551 Nov 09 20:37:21.573874 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1128/2286] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:37:21 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:37:22.590833 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-b883cabc-6b3e-414b-bbf6-722f39571a9d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:37:22.591431 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-b883cabc-6b3e-414b-bbf6-722f39571a9d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:37:22.598210 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b883cabc-6b3e-414b-bbf6-722f39571a9d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:37:22.598644 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b883cabc-6b3e-414b-bbf6-722f39571a9d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:37:22.599400 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b883cabc-6b3e-414b-bbf6-722f39571a9d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:37:22.599823 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b883cabc-6b3e-414b-bbf6-722f39571a9d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:37:22.657965 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-b883cabc-6b3e-414b-bbf6-722f39571a9d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:37:22.665568 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-b883cabc-6b3e-414b-bbf6-722f39571a9d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.078439 Nov 09 20:37:22.666115 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1159/2287] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:37:22 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:37:23.682594 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-cfa1a43d-c9c7-4c6c-a09e-a4bda309fe70 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:37:23.683212 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-cfa1a43d-c9c7-4c6c-a09e-a4bda309fe70 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:37:23.690124 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cfa1a43d-c9c7-4c6c-a09e-a4bda309fe70 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:37:23.690577 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cfa1a43d-c9c7-4c6c-a09e-a4bda309fe70 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:37:23.691351 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cfa1a43d-c9c7-4c6c-a09e-a4bda309fe70 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:37:23.691785 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cfa1a43d-c9c7-4c6c-a09e-a4bda309fe70 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:37:23.749497 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-cfa1a43d-c9c7-4c6c-a09e-a4bda309fe70 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:37:23.758110 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-cfa1a43d-c9c7-4c6c-a09e-a4bda309fe70 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.079735 Nov 09 20:37:23.758677 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1129/2288] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:37:23 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:37:24.774904 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-678b665f-19f5-4f4a-b8c4-ee697a02878d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:37:24.775508 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-678b665f-19f5-4f4a-b8c4-ee697a02878d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:37:24.782431 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-678b665f-19f5-4f4a-b8c4-ee697a02878d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:37:24.782875 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-678b665f-19f5-4f4a-b8c4-ee697a02878d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:37:24.783636 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-678b665f-19f5-4f4a-b8c4-ee697a02878d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:37:24.784068 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-678b665f-19f5-4f4a-b8c4-ee697a02878d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:37:24.842045 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-678b665f-19f5-4f4a-b8c4-ee697a02878d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:37:24.849796 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-678b665f-19f5-4f4a-b8c4-ee697a02878d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.078581 Nov 09 20:37:24.850348 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1160/2289] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:37:24 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:37:25.866291 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-f5dfed91-8053-4bbb-8006-4c060e90ec92 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:37:25.866904 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-f5dfed91-8053-4bbb-8006-4c060e90ec92 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:37:25.873318 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f5dfed91-8053-4bbb-8006-4c060e90ec92 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:37:25.873772 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f5dfed91-8053-4bbb-8006-4c060e90ec92 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:37:25.874542 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f5dfed91-8053-4bbb-8006-4c060e90ec92 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:37:25.875320 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f5dfed91-8053-4bbb-8006-4c060e90ec92 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:37:25.939186 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-f5dfed91-8053-4bbb-8006-4c060e90ec92 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:37:25.946871 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-f5dfed91-8053-4bbb-8006-4c060e90ec92 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.084254 Nov 09 20:37:25.947438 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1130/2290] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:37:25 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:37:26.964135 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-928403aa-5bfd-4622-b6bf-e32a6ce310bc tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:37:26.964897 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-928403aa-5bfd-4622-b6bf-e32a6ce310bc tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:37:26.971705 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-928403aa-5bfd-4622-b6bf-e32a6ce310bc tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:37:26.972258 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-928403aa-5bfd-4622-b6bf-e32a6ce310bc tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:37:26.973106 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-928403aa-5bfd-4622-b6bf-e32a6ce310bc tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:37:26.973539 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-928403aa-5bfd-4622-b6bf-e32a6ce310bc tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:37:27.032612 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-928403aa-5bfd-4622-b6bf-e32a6ce310bc tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:37:27.040228 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-928403aa-5bfd-4622-b6bf-e32a6ce310bc tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.079937 Nov 09 20:37:27.040825 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1161/2291] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:37:26 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:37:28.057422 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-cbcb99c4-b6d6-4444-bd86-690305175abc tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:37:28.058049 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-cbcb99c4-b6d6-4444-bd86-690305175abc tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:37:28.064730 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cbcb99c4-b6d6-4444-bd86-690305175abc tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:37:28.065172 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cbcb99c4-b6d6-4444-bd86-690305175abc tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:37:28.065930 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cbcb99c4-b6d6-4444-bd86-690305175abc tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:37:28.066355 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cbcb99c4-b6d6-4444-bd86-690305175abc tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:37:28.123545 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-cbcb99c4-b6d6-4444-bd86-690305175abc tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:37:28.131956 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-cbcb99c4-b6d6-4444-bd86-690305175abc tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.078290 Nov 09 20:37:28.132542 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1131/2292] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:37:28 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:37:29.149665 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-a4d8ae5f-6988-4c8a-9f5e-3eefbc08fad8 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:37:29.150256 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-a4d8ae5f-6988-4c8a-9f5e-3eefbc08fad8 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:37:29.156655 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a4d8ae5f-6988-4c8a-9f5e-3eefbc08fad8 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:37:29.157106 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a4d8ae5f-6988-4c8a-9f5e-3eefbc08fad8 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:37:29.158422 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a4d8ae5f-6988-4c8a-9f5e-3eefbc08fad8 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:37:29.158956 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a4d8ae5f-6988-4c8a-9f5e-3eefbc08fad8 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:37:29.220760 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-a4d8ae5f-6988-4c8a-9f5e-3eefbc08fad8 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:37:29.228500 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-a4d8ae5f-6988-4c8a-9f5e-3eefbc08fad8 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.082543 Nov 09 20:37:29.229041 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1162/2293] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:37:29 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:37:30.244681 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-6b5a07cc-1245-40c1-8560-11df7e3faf9f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:37:30.245286 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-6b5a07cc-1245-40c1-8560-11df7e3faf9f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:37:30.251740 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6b5a07cc-1245-40c1-8560-11df7e3faf9f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:37:30.252183 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6b5a07cc-1245-40c1-8560-11df7e3faf9f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:37:30.252979 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6b5a07cc-1245-40c1-8560-11df7e3faf9f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:37:30.253410 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6b5a07cc-1245-40c1-8560-11df7e3faf9f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:37:30.312729 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-6b5a07cc-1245-40c1-8560-11df7e3faf9f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:37:30.320379 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-6b5a07cc-1245-40c1-8560-11df7e3faf9f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.079421 Nov 09 20:37:30.320962 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1132/2294] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:37:30 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:37:31.337293 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-ee1cdd2d-931d-4fb8-b0fc-bdfd36a97ead tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:37:31.337890 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-ee1cdd2d-931d-4fb8-b0fc-bdfd36a97ead tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:37:31.344253 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ee1cdd2d-931d-4fb8-b0fc-bdfd36a97ead tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:37:31.344742 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ee1cdd2d-931d-4fb8-b0fc-bdfd36a97ead tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:37:31.345499 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ee1cdd2d-931d-4fb8-b0fc-bdfd36a97ead tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:37:31.345920 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ee1cdd2d-931d-4fb8-b0fc-bdfd36a97ead tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:37:31.408295 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-ee1cdd2d-931d-4fb8-b0fc-bdfd36a97ead tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:37:31.416117 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-ee1cdd2d-931d-4fb8-b0fc-bdfd36a97ead tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.082484 Nov 09 20:37:31.416687 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1163/2295] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:37:31 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:37:32.433024 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-f6f4e5c5-c67f-4383-98d7-3680f5bc62a0 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:37:32.433623 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-f6f4e5c5-c67f-4383-98d7-3680f5bc62a0 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:37:32.440930 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f6f4e5c5-c67f-4383-98d7-3680f5bc62a0 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:37:32.441397 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f6f4e5c5-c67f-4383-98d7-3680f5bc62a0 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:37:32.442157 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f6f4e5c5-c67f-4383-98d7-3680f5bc62a0 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:37:32.442615 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f6f4e5c5-c67f-4383-98d7-3680f5bc62a0 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:37:32.505506 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-f6f4e5c5-c67f-4383-98d7-3680f5bc62a0 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:37:32.513081 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-f6f4e5c5-c67f-4383-98d7-3680f5bc62a0 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.083707 Nov 09 20:37:32.513638 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1133/2296] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:37:32 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:37:33.530214 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-a976734f-2c45-4026-b28f-22bacd21eb6b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:37:33.530809 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-a976734f-2c45-4026-b28f-22bacd21eb6b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:37:33.537844 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a976734f-2c45-4026-b28f-22bacd21eb6b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:37:33.538201 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a976734f-2c45-4026-b28f-22bacd21eb6b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:37:33.538954 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a976734f-2c45-4026-b28f-22bacd21eb6b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:37:33.539376 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a976734f-2c45-4026-b28f-22bacd21eb6b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:37:33.596971 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-a976734f-2c45-4026-b28f-22bacd21eb6b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:37:33.604970 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-a976734f-2c45-4026-b28f-22bacd21eb6b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.078294 Nov 09 20:37:33.605558 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1164/2297] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:37:33 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:37:34.622218 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-f1c9251b-c0df-480e-ab8e-4797448740e1 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:37:34.622818 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-f1c9251b-c0df-480e-ab8e-4797448740e1 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:37:34.630366 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f1c9251b-c0df-480e-ab8e-4797448740e1 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:37:34.630814 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f1c9251b-c0df-480e-ab8e-4797448740e1 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:37:34.631577 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f1c9251b-c0df-480e-ab8e-4797448740e1 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:37:34.632012 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f1c9251b-c0df-480e-ab8e-4797448740e1 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:37:34.691226 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-f1c9251b-c0df-480e-ab8e-4797448740e1 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:37:34.698838 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-f1c9251b-c0df-480e-ab8e-4797448740e1 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.080304 Nov 09 20:37:34.699398 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1134/2298] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:37:34 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:37:35.714797 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-7d6cf94c-9d2f-4269-bf0b-9f3d1825a7a1 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:37:35.715376 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-7d6cf94c-9d2f-4269-bf0b-9f3d1825a7a1 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:37:35.721690 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-7d6cf94c-9d2f-4269-bf0b-9f3d1825a7a1 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:37:35.722131 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-7d6cf94c-9d2f-4269-bf0b-9f3d1825a7a1 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:37:35.722886 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-7d6cf94c-9d2f-4269-bf0b-9f3d1825a7a1 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:37:35.723309 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-7d6cf94c-9d2f-4269-bf0b-9f3d1825a7a1 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:37:35.782346 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-7d6cf94c-9d2f-4269-bf0b-9f3d1825a7a1 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:37:35.790076 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-7d6cf94c-9d2f-4269-bf0b-9f3d1825a7a1 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.078986 Nov 09 20:37:35.790634 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1165/2299] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:37:35 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:37:36.806614 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-473d7a72-f9a5-42a9-ab5d-e172df4effc8 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:37:36.807219 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-473d7a72-f9a5-42a9-ab5d-e172df4effc8 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:37:36.813476 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-473d7a72-f9a5-42a9-ab5d-e172df4effc8 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:37:36.813920 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-473d7a72-f9a5-42a9-ab5d-e172df4effc8 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:37:36.815002 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-473d7a72-f9a5-42a9-ab5d-e172df4effc8 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:37:36.815467 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-473d7a72-f9a5-42a9-ab5d-e172df4effc8 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:37:36.873873 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-473d7a72-f9a5-42a9-ab5d-e172df4effc8 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:37:36.882739 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-473d7a72-f9a5-42a9-ab5d-e172df4effc8 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.079911 Nov 09 20:37:36.883304 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1135/2300] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:37:36 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:37:37.899242 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-444218b4-d941-4b0e-8f4d-f6a93c24aa26 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:37:37.899839 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-444218b4-d941-4b0e-8f4d-f6a93c24aa26 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:37:37.905973 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-444218b4-d941-4b0e-8f4d-f6a93c24aa26 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:37:37.906416 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-444218b4-d941-4b0e-8f4d-f6a93c24aa26 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:37:37.907173 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-444218b4-d941-4b0e-8f4d-f6a93c24aa26 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:37:37.907598 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-444218b4-d941-4b0e-8f4d-f6a93c24aa26 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:37:37.966255 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-444218b4-d941-4b0e-8f4d-f6a93c24aa26 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:37:37.974627 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-444218b4-d941-4b0e-8f4d-f6a93c24aa26 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.079101 Nov 09 20:37:37.975181 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1166/2301] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:37:37 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:37:38.991649 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-0bf53ab4-c989-43c8-a005-a0e2c0caa3bc tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:37:38.992249 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-0bf53ab4-c989-43c8-a005-a0e2c0caa3bc tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:37:38.998481 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0bf53ab4-c989-43c8-a005-a0e2c0caa3bc tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:37:38.998917 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0bf53ab4-c989-43c8-a005-a0e2c0caa3bc tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:37:38.999697 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0bf53ab4-c989-43c8-a005-a0e2c0caa3bc tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:37:39.000120 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0bf53ab4-c989-43c8-a005-a0e2c0caa3bc tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:37:39.065299 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-0bf53ab4-c989-43c8-a005-a0e2c0caa3bc tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:37:39.072938 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-0bf53ab4-c989-43c8-a005-a0e2c0caa3bc tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.084921 Nov 09 20:37:39.073495 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1136/2302] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:37:38 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:37:39.161357 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 09 20:37:39.161909 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: Tue Nov 9 20:37:39 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 09 20:37:40.090209 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-6e554d2d-ae69-4074-8fc6-8358db87a512 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:37:40.090723 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-6e554d2d-ae69-4074-8fc6-8358db87a512 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:37:40.096956 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6e554d2d-ae69-4074-8fc6-8358db87a512 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:37:40.097397 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6e554d2d-ae69-4074-8fc6-8358db87a512 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:37:40.098156 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6e554d2d-ae69-4074-8fc6-8358db87a512 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:37:40.098583 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6e554d2d-ae69-4074-8fc6-8358db87a512 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:37:40.157266 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-6e554d2d-ae69-4074-8fc6-8358db87a512 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:37:40.165543 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-6e554d2d-ae69-4074-8fc6-8358db87a512 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.079126 Nov 09 20:37:40.166090 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1167/2303] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:37:40 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:37:41.182389 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-8351cda3-8d29-48d1-9426-a2c4c3a9a3b3 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:37:41.182986 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-8351cda3-8d29-48d1-9426-a2c4c3a9a3b3 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:37:41.189737 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8351cda3-8d29-48d1-9426-a2c4c3a9a3b3 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:37:41.190176 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8351cda3-8d29-48d1-9426-a2c4c3a9a3b3 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:37:41.190929 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8351cda3-8d29-48d1-9426-a2c4c3a9a3b3 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:37:41.191366 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8351cda3-8d29-48d1-9426-a2c4c3a9a3b3 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:37:41.251322 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-8351cda3-8d29-48d1-9426-a2c4c3a9a3b3 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:37:41.260522 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-8351cda3-8d29-48d1-9426-a2c4c3a9a3b3 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.081610 Nov 09 20:37:41.261021 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1137/2304] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:37:41 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:37:42.277687 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-a98bd131-e38d-43b9-9ae1-10352c5baf15 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:37:42.278270 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-a98bd131-e38d-43b9-9ae1-10352c5baf15 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:37:42.285398 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a98bd131-e38d-43b9-9ae1-10352c5baf15 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:37:42.285848 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a98bd131-e38d-43b9-9ae1-10352c5baf15 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:37:42.286623 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a98bd131-e38d-43b9-9ae1-10352c5baf15 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:37:42.287054 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a98bd131-e38d-43b9-9ae1-10352c5baf15 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:37:42.344507 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-a98bd131-e38d-43b9-9ae1-10352c5baf15 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:37:42.352710 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-a98bd131-e38d-43b9-9ae1-10352c5baf15 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.078659 Nov 09 20:37:42.353263 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1168/2305] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:37:42 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:37:43.369318 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-def627e7-98e0-454a-9f79-61ff7b2d265f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:37:43.369921 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-def627e7-98e0-454a-9f79-61ff7b2d265f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:37:43.376115 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-def627e7-98e0-454a-9f79-61ff7b2d265f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:37:43.376891 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-def627e7-98e0-454a-9f79-61ff7b2d265f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:37:43.377890 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-def627e7-98e0-454a-9f79-61ff7b2d265f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:37:43.378330 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-def627e7-98e0-454a-9f79-61ff7b2d265f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:37:43.436705 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-def627e7-98e0-454a-9f79-61ff7b2d265f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:37:43.444693 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-def627e7-98e0-454a-9f79-61ff7b2d265f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.079020 Nov 09 20:37:43.445254 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1138/2306] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:37:43 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:37:44.461160 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-96a767a4-c87e-4b9b-8365-a3008d755279 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:37:44.461753 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-96a767a4-c87e-4b9b-8365-a3008d755279 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:37:44.467962 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-96a767a4-c87e-4b9b-8365-a3008d755279 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:37:44.468505 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-96a767a4-c87e-4b9b-8365-a3008d755279 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:37:44.469211 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-96a767a4-c87e-4b9b-8365-a3008d755279 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:37:44.469642 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-96a767a4-c87e-4b9b-8365-a3008d755279 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:37:44.528489 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-96a767a4-c87e-4b9b-8365-a3008d755279 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:37:44.536334 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-96a767a4-c87e-4b9b-8365-a3008d755279 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.078837 Nov 09 20:37:44.536859 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1169/2307] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:37:44 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:37:45.552991 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-318599ea-4214-460a-9b32-7b34ed530eed tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:37:45.553639 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-318599ea-4214-460a-9b32-7b34ed530eed tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:37:45.559902 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-318599ea-4214-460a-9b32-7b34ed530eed tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:37:45.560384 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-318599ea-4214-460a-9b32-7b34ed530eed tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:37:45.561266 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-318599ea-4214-460a-9b32-7b34ed530eed tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:37:45.561704 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-318599ea-4214-460a-9b32-7b34ed530eed tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:37:45.623514 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-318599ea-4214-460a-9b32-7b34ed530eed tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:37:45.631786 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-318599ea-4214-460a-9b32-7b34ed530eed tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.082759 Nov 09 20:37:45.632360 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1139/2308] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:37:45 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:37:46.648618 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-01ce6fb9-5aca-4f61-8d2e-5ede730bcfb7 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:37:46.649220 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-01ce6fb9-5aca-4f61-8d2e-5ede730bcfb7 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:37:46.655221 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-01ce6fb9-5aca-4f61-8d2e-5ede730bcfb7 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:37:46.655670 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-01ce6fb9-5aca-4f61-8d2e-5ede730bcfb7 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:37:46.656468 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-01ce6fb9-5aca-4f61-8d2e-5ede730bcfb7 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:37:46.656907 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-01ce6fb9-5aca-4f61-8d2e-5ede730bcfb7 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:37:46.716139 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-01ce6fb9-5aca-4f61-8d2e-5ede730bcfb7 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:37:46.724376 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-01ce6fb9-5aca-4f61-8d2e-5ede730bcfb7 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.079559 Nov 09 20:37:46.724951 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1170/2309] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:37:46 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:37:47.741398 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-5ed423b4-8ea9-4a1e-908d-6e035fb1fe33 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:37:47.742035 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-5ed423b4-8ea9-4a1e-908d-6e035fb1fe33 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:37:47.748269 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5ed423b4-8ea9-4a1e-908d-6e035fb1fe33 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:37:47.748747 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5ed423b4-8ea9-4a1e-908d-6e035fb1fe33 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:37:47.749519 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5ed423b4-8ea9-4a1e-908d-6e035fb1fe33 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:37:47.749955 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5ed423b4-8ea9-4a1e-908d-6e035fb1fe33 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:37:47.809072 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-5ed423b4-8ea9-4a1e-908d-6e035fb1fe33 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:37:47.816712 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-5ed423b4-8ea9-4a1e-908d-6e035fb1fe33 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.078995 Nov 09 20:37:47.817272 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1140/2310] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:37:47 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:37:48.833446 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-65e26264-83a9-4235-b052-a75049bd21e7 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:37:48.834078 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-65e26264-83a9-4235-b052-a75049bd21e7 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:37:48.840259 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-65e26264-83a9-4235-b052-a75049bd21e7 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:37:48.840734 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-65e26264-83a9-4235-b052-a75049bd21e7 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:37:48.841500 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-65e26264-83a9-4235-b052-a75049bd21e7 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:37:48.841932 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-65e26264-83a9-4235-b052-a75049bd21e7 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:37:48.900734 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-65e26264-83a9-4235-b052-a75049bd21e7 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:37:48.908827 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-65e26264-83a9-4235-b052-a75049bd21e7 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.079163 Nov 09 20:37:48.909380 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1171/2311] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:37:48 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:37:49.926524 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-b6315311-9ef4-4dbf-8f08-bbdd463342f6 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:37:49.927155 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-b6315311-9ef4-4dbf-8f08-bbdd463342f6 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:37:49.933250 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b6315311-9ef4-4dbf-8f08-bbdd463342f6 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:37:49.933687 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b6315311-9ef4-4dbf-8f08-bbdd463342f6 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:37:49.934442 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b6315311-9ef4-4dbf-8f08-bbdd463342f6 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:37:49.934865 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b6315311-9ef4-4dbf-8f08-bbdd463342f6 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:37:49.993188 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-b6315311-9ef4-4dbf-8f08-bbdd463342f6 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:37:50.000704 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-b6315311-9ef4-4dbf-8f08-bbdd463342f6 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.078456 Nov 09 20:37:50.005798 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1141/2312] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:37:49 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:37:51.017830 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-8a953eac-d643-4109-ba63-fd14eff8ad13 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:37:51.018648 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-8a953eac-d643-4109-ba63-fd14eff8ad13 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:37:51.024868 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-8a953eac-d643-4109-ba63-fd14eff8ad13 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:37:51.025315 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-8a953eac-d643-4109-ba63-fd14eff8ad13 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:37:51.026083 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-8a953eac-d643-4109-ba63-fd14eff8ad13 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:37:51.026516 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-8a953eac-d643-4109-ba63-fd14eff8ad13 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:37:51.084470 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-8a953eac-d643-4109-ba63-fd14eff8ad13 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:37:51.091976 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-8a953eac-d643-4109-ba63-fd14eff8ad13 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.078396 Nov 09 20:37:51.092536 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1172/2313] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:37:51 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:37:52.109317 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-31adcca3-8de0-4345-8539-b1deccd203a4 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:37:52.109903 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-31adcca3-8de0-4345-8539-b1deccd203a4 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:37:52.116683 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-31adcca3-8de0-4345-8539-b1deccd203a4 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:37:52.117127 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-31adcca3-8de0-4345-8539-b1deccd203a4 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:37:52.117886 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-31adcca3-8de0-4345-8539-b1deccd203a4 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:37:52.118313 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-31adcca3-8de0-4345-8539-b1deccd203a4 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:37:52.181630 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-31adcca3-8de0-4345-8539-b1deccd203a4 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:37:52.189604 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-31adcca3-8de0-4345-8539-b1deccd203a4 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.083573 Nov 09 20:37:52.190168 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1142/2314] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:37:52 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:37:52.270417 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 09 20:37:52.270644 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: Tue Nov 9 20:37:52 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 09 20:37:53.206930 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-3fba2112-ea59-42df-846d-76b53ed9fade tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:37:53.207529 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-3fba2112-ea59-42df-846d-76b53ed9fade tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:37:53.213925 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-3fba2112-ea59-42df-846d-76b53ed9fade tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:37:53.214363 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-3fba2112-ea59-42df-846d-76b53ed9fade tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:37:53.215122 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-3fba2112-ea59-42df-846d-76b53ed9fade tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:37:53.215547 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-3fba2112-ea59-42df-846d-76b53ed9fade tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:37:53.274103 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-3fba2112-ea59-42df-846d-76b53ed9fade tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:37:53.281846 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-3fba2112-ea59-42df-846d-76b53ed9fade tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.079568 Nov 09 20:37:53.282407 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1173/2315] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:37:53 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:37:54.298340 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-5203839c-8b2f-4672-8330-4f1f91a74974 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:37:54.299010 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-5203839c-8b2f-4672-8330-4f1f91a74974 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:37:54.305460 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5203839c-8b2f-4672-8330-4f1f91a74974 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:37:54.305906 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5203839c-8b2f-4672-8330-4f1f91a74974 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:37:54.306682 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5203839c-8b2f-4672-8330-4f1f91a74974 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:37:54.307117 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5203839c-8b2f-4672-8330-4f1f91a74974 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:37:54.368707 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-5203839c-8b2f-4672-8330-4f1f91a74974 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:37:54.376934 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-5203839c-8b2f-4672-8330-4f1f91a74974 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.081729 Nov 09 20:37:54.377818 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1143/2316] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:37:54 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:37:55.527061 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-d418fcef-045f-4e6b-893e-c41d504bfb2a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:37:55.527668 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-d418fcef-045f-4e6b-893e-c41d504bfb2a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:37:55.534131 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d418fcef-045f-4e6b-893e-c41d504bfb2a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:37:55.534568 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d418fcef-045f-4e6b-893e-c41d504bfb2a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:37:55.535329 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d418fcef-045f-4e6b-893e-c41d504bfb2a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:37:55.535803 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d418fcef-045f-4e6b-893e-c41d504bfb2a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:37:55.593019 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-d418fcef-045f-4e6b-893e-c41d504bfb2a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:37:55.601479 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-d418fcef-045f-4e6b-893e-c41d504bfb2a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.211316 Nov 09 20:37:55.602030 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1174/2317] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:37:55 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:37:56.617626 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-70f8fca9-40d5-45c4-b297-47e126290c76 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:37:56.618227 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-70f8fca9-40d5-45c4-b297-47e126290c76 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:37:56.624161 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-70f8fca9-40d5-45c4-b297-47e126290c76 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:37:56.624633 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-70f8fca9-40d5-45c4-b297-47e126290c76 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:37:56.625397 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-70f8fca9-40d5-45c4-b297-47e126290c76 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:37:56.625823 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-70f8fca9-40d5-45c4-b297-47e126290c76 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:37:56.685314 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-70f8fca9-40d5-45c4-b297-47e126290c76 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:37:56.692962 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-70f8fca9-40d5-45c4-b297-47e126290c76 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.078971 Nov 09 20:37:56.693511 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1144/2318] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:37:56 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:37:57.710014 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-cd83f5d0-8a3e-4129-8153-9a5938079a3e tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:37:57.710717 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-cd83f5d0-8a3e-4129-8153-9a5938079a3e tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:37:57.716931 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-cd83f5d0-8a3e-4129-8153-9a5938079a3e tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:37:57.717380 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-cd83f5d0-8a3e-4129-8153-9a5938079a3e tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:37:57.718150 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-cd83f5d0-8a3e-4129-8153-9a5938079a3e tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:37:57.718579 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-cd83f5d0-8a3e-4129-8153-9a5938079a3e tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:37:57.777009 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-cd83f5d0-8a3e-4129-8153-9a5938079a3e tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:37:57.784625 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-cd83f5d0-8a3e-4129-8153-9a5938079a3e tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.078205 Nov 09 20:37:57.785185 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1175/2319] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:37:57 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:37:58.801485 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-c7910edc-366e-466c-be15-6c48cb572219 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:37:58.802087 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-c7910edc-366e-466c-be15-6c48cb572219 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:37:58.808339 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c7910edc-366e-466c-be15-6c48cb572219 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:37:58.808815 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c7910edc-366e-466c-be15-6c48cb572219 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:37:58.809578 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c7910edc-366e-466c-be15-6c48cb572219 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:37:58.810007 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c7910edc-366e-466c-be15-6c48cb572219 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:37:58.871512 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-c7910edc-366e-466c-be15-6c48cb572219 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:37:58.880254 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-c7910edc-366e-466c-be15-6c48cb572219 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.082670 Nov 09 20:37:58.880841 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1145/2320] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:37:58 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:37:59.896003 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-8e56d8c3-fd7a-41a5-8197-7424ce0fa97c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:37:59.896653 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-8e56d8c3-fd7a-41a5-8197-7424ce0fa97c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:37:59.902833 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-8e56d8c3-fd7a-41a5-8197-7424ce0fa97c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:37:59.903277 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-8e56d8c3-fd7a-41a5-8197-7424ce0fa97c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:37:59.904040 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-8e56d8c3-fd7a-41a5-8197-7424ce0fa97c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:37:59.904503 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-8e56d8c3-fd7a-41a5-8197-7424ce0fa97c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:37:59.963820 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-8e56d8c3-fd7a-41a5-8197-7424ce0fa97c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:37:59.972018 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-8e56d8c3-fd7a-41a5-8197-7424ce0fa97c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.079800 Nov 09 20:37:59.972594 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1176/2321] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:37:59 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:38:00.988795 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-9c28d7a9-070a-43d1-a4c0-6af60e05858b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:38:00.989430 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-9c28d7a9-070a-43d1-a4c0-6af60e05858b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:38:00.995654 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9c28d7a9-070a-43d1-a4c0-6af60e05858b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:38:00.996102 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9c28d7a9-070a-43d1-a4c0-6af60e05858b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:38:00.996895 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9c28d7a9-070a-43d1-a4c0-6af60e05858b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:38:00.997326 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9c28d7a9-070a-43d1-a4c0-6af60e05858b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:38:01.056092 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-9c28d7a9-070a-43d1-a4c0-6af60e05858b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:38:01.064923 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-9c28d7a9-070a-43d1-a4c0-6af60e05858b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.079629 Nov 09 20:38:01.065523 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1146/2322] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:38:00 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:38:02.082150 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-6afbfc88-f96e-4dfb-b881-01dd3b97be97 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:38:02.082747 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-6afbfc88-f96e-4dfb-b881-01dd3b97be97 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:38:02.088988 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6afbfc88-f96e-4dfb-b881-01dd3b97be97 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:38:02.089439 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6afbfc88-f96e-4dfb-b881-01dd3b97be97 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:38:02.090211 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6afbfc88-f96e-4dfb-b881-01dd3b97be97 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:38:02.090644 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6afbfc88-f96e-4dfb-b881-01dd3b97be97 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:38:02.149310 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-6afbfc88-f96e-4dfb-b881-01dd3b97be97 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:38:02.156994 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-6afbfc88-f96e-4dfb-b881-01dd3b97be97 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.079336 Nov 09 20:38:02.157597 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1177/2323] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:38:02 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:38:03.174165 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-4e3cab1c-8849-4caa-a3ca-b1f49f2ad4ae tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:38:03.174816 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-4e3cab1c-8849-4caa-a3ca-b1f49f2ad4ae tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:38:03.181859 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4e3cab1c-8849-4caa-a3ca-b1f49f2ad4ae tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:38:03.182285 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4e3cab1c-8849-4caa-a3ca-b1f49f2ad4ae tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:38:03.183061 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4e3cab1c-8849-4caa-a3ca-b1f49f2ad4ae tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:38:03.183497 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4e3cab1c-8849-4caa-a3ca-b1f49f2ad4ae tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:38:03.252258 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-4e3cab1c-8849-4caa-a3ca-b1f49f2ad4ae tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:38:03.260079 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-4e3cab1c-8849-4caa-a3ca-b1f49f2ad4ae tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.090210 Nov 09 20:38:03.260688 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1147/2324] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:38:03 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:38:04.277544 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-a1b30d33-6766-42fe-9d20-6a50acc0630c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:38:04.278172 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-a1b30d33-6766-42fe-9d20-6a50acc0630c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:38:04.285049 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a1b30d33-6766-42fe-9d20-6a50acc0630c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:38:04.285496 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a1b30d33-6766-42fe-9d20-6a50acc0630c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:38:04.286267 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a1b30d33-6766-42fe-9d20-6a50acc0630c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:38:04.286697 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a1b30d33-6766-42fe-9d20-6a50acc0630c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:38:04.349480 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-a1b30d33-6766-42fe-9d20-6a50acc0630c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:38:04.357108 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-a1b30d33-6766-42fe-9d20-6a50acc0630c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.083257 Nov 09 20:38:04.357664 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1178/2325] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:38:04 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:38:05.373525 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-b5f1d45b-fa8a-4822-b7d0-264d67c09e99 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:38:05.374154 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-b5f1d45b-fa8a-4822-b7d0-264d67c09e99 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:38:05.381330 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b5f1d45b-fa8a-4822-b7d0-264d67c09e99 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:38:05.381797 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b5f1d45b-fa8a-4822-b7d0-264d67c09e99 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:38:05.382554 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b5f1d45b-fa8a-4822-b7d0-264d67c09e99 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:38:05.382981 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b5f1d45b-fa8a-4822-b7d0-264d67c09e99 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:38:05.444615 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-b5f1d45b-fa8a-4822-b7d0-264d67c09e99 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:38:05.452219 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-b5f1d45b-fa8a-4822-b7d0-264d67c09e99 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.082343 Nov 09 20:38:05.452817 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1148/2326] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:38:05 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:38:06.468699 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-d68efffb-e392-427d-a568-4d3c4a11a6d2 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:38:06.469304 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-d68efffb-e392-427d-a568-4d3c4a11a6d2 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:38:06.475946 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d68efffb-e392-427d-a568-4d3c4a11a6d2 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:38:06.476383 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d68efffb-e392-427d-a568-4d3c4a11a6d2 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:38:06.477175 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d68efffb-e392-427d-a568-4d3c4a11a6d2 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:38:06.477600 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d68efffb-e392-427d-a568-4d3c4a11a6d2 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:38:06.535682 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-d68efffb-e392-427d-a568-4d3c4a11a6d2 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:38:06.543117 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-d68efffb-e392-427d-a568-4d3c4a11a6d2 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.078062 Nov 09 20:38:06.543674 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1179/2327] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:38:06 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:38:07.559309 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-8106825a-687c-45c8-88e1-6fec6d83580c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:38:07.559858 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-8106825a-687c-45c8-88e1-6fec6d83580c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:38:07.566701 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8106825a-687c-45c8-88e1-6fec6d83580c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:38:07.567151 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8106825a-687c-45c8-88e1-6fec6d83580c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:38:07.567923 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8106825a-687c-45c8-88e1-6fec6d83580c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:38:07.568359 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8106825a-687c-45c8-88e1-6fec6d83580c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:38:07.626064 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-8106825a-687c-45c8-88e1-6fec6d83580c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:38:07.629469 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 09 20:38:07.630591 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: Tue Nov 9 20:38:07 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df (ip 10.222.0.25) !!! Nov 09 20:38:07.645834 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-8106825a-687c-45c8-88e1-6fec6d83580c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.090296 Nov 09 20:38:07.652357 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1149/2328] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:38:07 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:38:08.663263 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-caf6e600-a3d8-4240-94f2-99be33b52060 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:38:08.663865 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-caf6e600-a3d8-4240-94f2-99be33b52060 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:38:08.670082 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-caf6e600-a3d8-4240-94f2-99be33b52060 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:38:08.670526 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-caf6e600-a3d8-4240-94f2-99be33b52060 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:38:08.671288 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-caf6e600-a3d8-4240-94f2-99be33b52060 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:38:08.671719 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-caf6e600-a3d8-4240-94f2-99be33b52060 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:38:08.729956 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-caf6e600-a3d8-4240-94f2-99be33b52060 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:38:08.737525 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-caf6e600-a3d8-4240-94f2-99be33b52060 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.077954 Nov 09 20:38:08.738082 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1180/2329] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:38:08 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:38:09.754827 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-89177b27-5180-4462-982a-0aed4639a1f3 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:38:09.755429 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-89177b27-5180-4462-982a-0aed4639a1f3 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:38:09.761592 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-89177b27-5180-4462-982a-0aed4639a1f3 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:38:09.762031 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-89177b27-5180-4462-982a-0aed4639a1f3 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:38:09.762783 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-89177b27-5180-4462-982a-0aed4639a1f3 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:38:09.763206 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-89177b27-5180-4462-982a-0aed4639a1f3 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:38:09.823714 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-89177b27-5180-4462-982a-0aed4639a1f3 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:38:09.831553 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-89177b27-5180-4462-982a-0aed4639a1f3 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.081384 Nov 09 20:38:09.832110 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1150/2330] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:38:09 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:38:10.849303 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-a12f8255-d94e-4df1-903e-c05a425db284 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:38:10.849903 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-a12f8255-d94e-4df1-903e-c05a425db284 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:38:10.856064 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a12f8255-d94e-4df1-903e-c05a425db284 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:38:10.856544 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a12f8255-d94e-4df1-903e-c05a425db284 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:38:10.857315 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a12f8255-d94e-4df1-903e-c05a425db284 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:38:10.857749 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a12f8255-d94e-4df1-903e-c05a425db284 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:38:10.916346 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-a12f8255-d94e-4df1-903e-c05a425db284 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:38:10.923992 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-a12f8255-d94e-4df1-903e-c05a425db284 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.079519 Nov 09 20:38:10.924577 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1181/2331] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:38:10 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:38:11.940927 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-c2fb47b6-6ba0-4989-ab3e-e40ec4e8373d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:38:11.941515 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-c2fb47b6-6ba0-4989-ab3e-e40ec4e8373d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:38:11.947773 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c2fb47b6-6ba0-4989-ab3e-e40ec4e8373d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:38:11.948219 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c2fb47b6-6ba0-4989-ab3e-e40ec4e8373d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:38:11.949019 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c2fb47b6-6ba0-4989-ab3e-e40ec4e8373d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:38:11.949452 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c2fb47b6-6ba0-4989-ab3e-e40ec4e8373d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:38:12.011186 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-c2fb47b6-6ba0-4989-ab3e-e40ec4e8373d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:38:12.019434 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-c2fb47b6-6ba0-4989-ab3e-e40ec4e8373d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.082753 Nov 09 20:38:12.020112 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1151/2332] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:38:11 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:38:13.038700 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-c96fa889-9903-483d-aea3-564c0fb439c2 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:38:13.039285 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-c96fa889-9903-483d-aea3-564c0fb439c2 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:38:13.045457 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c96fa889-9903-483d-aea3-564c0fb439c2 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:38:13.045883 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c96fa889-9903-483d-aea3-564c0fb439c2 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:38:13.046677 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c96fa889-9903-483d-aea3-564c0fb439c2 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:38:13.047103 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c96fa889-9903-483d-aea3-564c0fb439c2 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:38:13.352131 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-c96fa889-9903-483d-aea3-564c0fb439c2 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:38:13.359882 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-c96fa889-9903-483d-aea3-564c0fb439c2 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.324824 Nov 09 20:38:13.361081 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1182/2333] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:38:13 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:38:14.377582 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-f756ef44-a637-4db3-a399-e017f43f4107 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:38:14.378232 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-f756ef44-a637-4db3-a399-e017f43f4107 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:38:14.384388 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f756ef44-a637-4db3-a399-e017f43f4107 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:38:14.384851 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f756ef44-a637-4db3-a399-e017f43f4107 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:38:14.385605 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f756ef44-a637-4db3-a399-e017f43f4107 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:38:14.386030 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f756ef44-a637-4db3-a399-e017f43f4107 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:38:14.444752 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-f756ef44-a637-4db3-a399-e017f43f4107 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:38:14.452375 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-f756ef44-a637-4db3-a399-e017f43f4107 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.078805 Nov 09 20:38:14.452949 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1152/2334] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:38:14 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 20:38:15.468983 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-3fd74725-6416-4609-aaf9-a250344f6747 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:38:15.469603 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-3fd74725-6416-4609-aaf9-a250344f6747 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:38:15.476039 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-3fd74725-6416-4609-aaf9-a250344f6747 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:38:15.476504 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-3fd74725-6416-4609-aaf9-a250344f6747 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:38:15.477263 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-3fd74725-6416-4609-aaf9-a250344f6747 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:38:15.477687 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-3fd74725-6416-4609-aaf9-a250344f6747 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:38:15.537055 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-3fd74725-6416-4609-aaf9-a250344f6747 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:38:15.544490 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-3fd74725-6416-4609-aaf9-a250344f6747 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.079289 Nov 09 20:38:15.545037 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1183/2335] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:38:15 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:38:16.561798 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-781fb1a0-5b42-4530-a541-23abaa3bbdf2 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:38:16.562343 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-781fb1a0-5b42-4530-a541-23abaa3bbdf2 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:38:16.569435 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-781fb1a0-5b42-4530-a541-23abaa3bbdf2 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:38:16.569883 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-781fb1a0-5b42-4530-a541-23abaa3bbdf2 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:38:16.570639 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-781fb1a0-5b42-4530-a541-23abaa3bbdf2 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:38:16.571070 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-781fb1a0-5b42-4530-a541-23abaa3bbdf2 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:38:16.629752 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-781fb1a0-5b42-4530-a541-23abaa3bbdf2 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:38:16.637349 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-781fb1a0-5b42-4530-a541-23abaa3bbdf2 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.079268 Nov 09 20:38:16.637910 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1153/2336] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:38:16 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:38:17.653816 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-08385bad-94b0-46da-a511-a7bf4c74814c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:38:17.654412 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-08385bad-94b0-46da-a511-a7bf4c74814c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:38:17.660903 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-08385bad-94b0-46da-a511-a7bf4c74814c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:38:17.661381 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-08385bad-94b0-46da-a511-a7bf4c74814c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:38:17.662187 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-08385bad-94b0-46da-a511-a7bf4c74814c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:38:17.662621 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-08385bad-94b0-46da-a511-a7bf4c74814c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:38:17.723517 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-08385bad-94b0-46da-a511-a7bf4c74814c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:38:17.731128 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-08385bad-94b0-46da-a511-a7bf4c74814c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.080950 Nov 09 20:38:17.731680 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1184/2337] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:38:17 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:38:18.747412 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-4e64bda8-5215-44bc-8c9a-fae822153e48 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:38:18.748005 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-4e64bda8-5215-44bc-8c9a-fae822153e48 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:38:18.755415 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4e64bda8-5215-44bc-8c9a-fae822153e48 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:38:18.755853 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4e64bda8-5215-44bc-8c9a-fae822153e48 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:38:18.756648 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4e64bda8-5215-44bc-8c9a-fae822153e48 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:38:18.757075 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4e64bda8-5215-44bc-8c9a-fae822153e48 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:38:18.813735 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-4e64bda8-5215-44bc-8c9a-fae822153e48 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:38:18.822047 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-4e64bda8-5215-44bc-8c9a-fae822153e48 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.078379 Nov 09 20:38:18.822606 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1154/2338] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:38:18 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:38:19.838978 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-726ae88c-7ac4-400c-a4de-33f05aac47e6 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:38:19.839562 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-726ae88c-7ac4-400c-a4de-33f05aac47e6 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:38:19.846703 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-726ae88c-7ac4-400c-a4de-33f05aac47e6 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:38:19.847408 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-726ae88c-7ac4-400c-a4de-33f05aac47e6 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:38:19.848176 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-726ae88c-7ac4-400c-a4de-33f05aac47e6 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:38:19.848632 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-726ae88c-7ac4-400c-a4de-33f05aac47e6 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:38:19.906850 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-726ae88c-7ac4-400c-a4de-33f05aac47e6 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:38:19.914526 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-726ae88c-7ac4-400c-a4de-33f05aac47e6 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.079464 Nov 09 20:38:19.915079 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1185/2339] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:38:19 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:38:20.930787 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-e92dd3d9-cec6-4bb4-9d09-dae5354be7a9 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:38:20.931387 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-e92dd3d9-cec6-4bb4-9d09-dae5354be7a9 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:38:20.937601 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e92dd3d9-cec6-4bb4-9d09-dae5354be7a9 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:38:20.938047 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e92dd3d9-cec6-4bb4-9d09-dae5354be7a9 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:38:20.938804 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e92dd3d9-cec6-4bb4-9d09-dae5354be7a9 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:38:20.939259 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e92dd3d9-cec6-4bb4-9d09-dae5354be7a9 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:38:20.997649 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-e92dd3d9-cec6-4bb4-9d09-dae5354be7a9 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:38:21.005448 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-e92dd3d9-cec6-4bb4-9d09-dae5354be7a9 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.078490 Nov 09 20:38:21.006011 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1155/2340] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:38:20 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:38:22.021201 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-b011dd75-ce65-4257-a0cf-94b2ecd3dff9 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:38:22.021791 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-b011dd75-ce65-4257-a0cf-94b2ecd3dff9 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:38:22.027943 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b011dd75-ce65-4257-a0cf-94b2ecd3dff9 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:38:22.028386 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b011dd75-ce65-4257-a0cf-94b2ecd3dff9 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:38:22.029175 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b011dd75-ce65-4257-a0cf-94b2ecd3dff9 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:38:22.029605 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b011dd75-ce65-4257-a0cf-94b2ecd3dff9 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:38:22.087686 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-b011dd75-ce65-4257-a0cf-94b2ecd3dff9 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:38:22.095295 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-b011dd75-ce65-4257-a0cf-94b2ecd3dff9 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.077678 Nov 09 20:38:22.095862 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1186/2341] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:38:22 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:38:23.112148 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-abe1d86c-75d8-4080-9bcc-77e1a3353610 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:38:23.112764 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-abe1d86c-75d8-4080-9bcc-77e1a3353610 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:38:23.119557 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-abe1d86c-75d8-4080-9bcc-77e1a3353610 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:38:23.120039 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-abe1d86c-75d8-4080-9bcc-77e1a3353610 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:38:23.120878 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-abe1d86c-75d8-4080-9bcc-77e1a3353610 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:38:23.121341 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-abe1d86c-75d8-4080-9bcc-77e1a3353610 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:38:23.184612 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-abe1d86c-75d8-4080-9bcc-77e1a3353610 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:38:23.193610 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-abe1d86c-75d8-4080-9bcc-77e1a3353610 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.085086 Nov 09 20:38:23.194182 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1156/2342] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:38:23 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:38:24.210778 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-8f532bde-4031-4a65-96ce-c229d09c6f76 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:38:24.211374 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-8f532bde-4031-4a65-96ce-c229d09c6f76 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:38:24.217574 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-8f532bde-4031-4a65-96ce-c229d09c6f76 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:38:24.218019 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-8f532bde-4031-4a65-96ce-c229d09c6f76 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:38:24.218784 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-8f532bde-4031-4a65-96ce-c229d09c6f76 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:38:24.219212 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-8f532bde-4031-4a65-96ce-c229d09c6f76 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:38:24.280701 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-8f532bde-4031-4a65-96ce-c229d09c6f76 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:38:24.289184 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-8f532bde-4031-4a65-96ce-c229d09c6f76 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.082072 Nov 09 20:38:24.289746 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1187/2343] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:38:24 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:38:25.305260 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-9074e726-5a12-4802-a37c-f8f5f9f16d06 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:38:25.305855 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-9074e726-5a12-4802-a37c-f8f5f9f16d06 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:38:25.311944 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9074e726-5a12-4802-a37c-f8f5f9f16d06 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:38:25.312381 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9074e726-5a12-4802-a37c-f8f5f9f16d06 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:38:25.313153 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9074e726-5a12-4802-a37c-f8f5f9f16d06 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:38:25.313577 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9074e726-5a12-4802-a37c-f8f5f9f16d06 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:38:25.372101 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-9074e726-5a12-4802-a37c-f8f5f9f16d06 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:38:25.380024 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-9074e726-5a12-4802-a37c-f8f5f9f16d06 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.078429 Nov 09 20:38:25.380605 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1157/2344] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:38:25 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:38:26.396861 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-aab62837-8fa6-4f4e-ab6e-7ec109228f37 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:38:26.397456 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-aab62837-8fa6-4f4e-ab6e-7ec109228f37 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:38:26.403645 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-aab62837-8fa6-4f4e-ab6e-7ec109228f37 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:38:26.404028 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-aab62837-8fa6-4f4e-ab6e-7ec109228f37 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:38:26.404817 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-aab62837-8fa6-4f4e-ab6e-7ec109228f37 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:38:26.405242 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-aab62837-8fa6-4f4e-ab6e-7ec109228f37 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:38:26.463656 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-aab62837-8fa6-4f4e-ab6e-7ec109228f37 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:38:26.471540 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-aab62837-8fa6-4f4e-ab6e-7ec109228f37 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.078313 Nov 09 20:38:26.472106 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1188/2345] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:38:26 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:38:27.488597 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-6efab5b4-3ba7-4ec7-9b83-4f1e716e9112 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:38:27.489179 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-6efab5b4-3ba7-4ec7-9b83-4f1e716e9112 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:38:27.495019 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6efab5b4-3ba7-4ec7-9b83-4f1e716e9112 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:38:27.495457 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6efab5b4-3ba7-4ec7-9b83-4f1e716e9112 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:38:27.496205 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6efab5b4-3ba7-4ec7-9b83-4f1e716e9112 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:38:27.496651 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6efab5b4-3ba7-4ec7-9b83-4f1e716e9112 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:38:27.556339 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-6efab5b4-3ba7-4ec7-9b83-4f1e716e9112 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:38:27.564656 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-6efab5b4-3ba7-4ec7-9b83-4f1e716e9112 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.079335 Nov 09 20:38:27.565208 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1158/2346] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:38:27 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:38:28.581337 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-8847a9d4-84f2-474c-94a7-5ec078f4f9ac tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:38:28.581851 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-8847a9d4-84f2-474c-94a7-5ec078f4f9ac tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:38:28.587954 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-8847a9d4-84f2-474c-94a7-5ec078f4f9ac tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:38:28.588392 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-8847a9d4-84f2-474c-94a7-5ec078f4f9ac tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:38:28.589212 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-8847a9d4-84f2-474c-94a7-5ec078f4f9ac tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:38:28.589634 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-8847a9d4-84f2-474c-94a7-5ec078f4f9ac tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:38:28.648910 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-8847a9d4-84f2-474c-94a7-5ec078f4f9ac tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:38:28.656423 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-8847a9d4-84f2-474c-94a7-5ec078f4f9ac tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.079299 Nov 09 20:38:28.656986 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1189/2347] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:38:28 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:38:29.674224 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-f6f8dde6-8e7d-4602-aef7-f761df8a1b89 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:38:29.674825 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-f6f8dde6-8e7d-4602-aef7-f761df8a1b89 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:38:29.681063 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f6f8dde6-8e7d-4602-aef7-f761df8a1b89 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:38:29.681504 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f6f8dde6-8e7d-4602-aef7-f761df8a1b89 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:38:29.682259 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f6f8dde6-8e7d-4602-aef7-f761df8a1b89 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:38:29.682685 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f6f8dde6-8e7d-4602-aef7-f761df8a1b89 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:38:29.741111 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-f6f8dde6-8e7d-4602-aef7-f761df8a1b89 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:38:29.749071 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-f6f8dde6-8e7d-4602-aef7-f761df8a1b89 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.079306 Nov 09 20:38:29.749671 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1159/2348] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:38:29 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:38:30.766469 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-ed581f1a-e9c7-4a9c-85ce-f2b014d92e21 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:38:30.767146 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-ed581f1a-e9c7-4a9c-85ce-f2b014d92e21 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:38:30.773299 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ed581f1a-e9c7-4a9c-85ce-f2b014d92e21 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:38:30.773745 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ed581f1a-e9c7-4a9c-85ce-f2b014d92e21 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:38:30.774516 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ed581f1a-e9c7-4a9c-85ce-f2b014d92e21 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:38:30.774947 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ed581f1a-e9c7-4a9c-85ce-f2b014d92e21 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:38:30.837149 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-ed581f1a-e9c7-4a9c-85ce-f2b014d92e21 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:38:30.844826 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-ed581f1a-e9c7-4a9c-85ce-f2b014d92e21 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.081943 Nov 09 20:38:30.845689 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1190/2349] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:38:30 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:38:31.861251 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-5eb90be5-1782-4909-ae87-a09dd3da1600 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:38:31.861840 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-5eb90be5-1782-4909-ae87-a09dd3da1600 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:38:31.868024 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5eb90be5-1782-4909-ae87-a09dd3da1600 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:38:31.868498 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5eb90be5-1782-4909-ae87-a09dd3da1600 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:38:31.869256 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5eb90be5-1782-4909-ae87-a09dd3da1600 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:38:31.869679 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5eb90be5-1782-4909-ae87-a09dd3da1600 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:38:31.928266 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-5eb90be5-1782-4909-ae87-a09dd3da1600 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:38:31.935791 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-5eb90be5-1782-4909-ae87-a09dd3da1600 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.078219 Nov 09 20:38:31.936340 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1160/2350] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:38:31 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:38:32.953011 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-fa50e616-e826-4323-b0a0-e13c1b853f2c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:38:32.953718 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-fa50e616-e826-4323-b0a0-e13c1b853f2c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:38:32.959873 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-fa50e616-e826-4323-b0a0-e13c1b853f2c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:38:32.960311 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-fa50e616-e826-4323-b0a0-e13c1b853f2c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:38:32.961104 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-fa50e616-e826-4323-b0a0-e13c1b853f2c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:38:32.961530 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-fa50e616-e826-4323-b0a0-e13c1b853f2c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:38:33.020752 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-fa50e616-e826-4323-b0a0-e13c1b853f2c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:38:33.028446 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-fa50e616-e826-4323-b0a0-e13c1b853f2c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.079108 Nov 09 20:38:33.029002 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1191/2351] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:38:32 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:38:34.045267 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-c3997142-4885-4ec1-a38f-99170c0af813 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:38:34.045866 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-c3997142-4885-4ec1-a38f-99170c0af813 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:38:34.052694 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c3997142-4885-4ec1-a38f-99170c0af813 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:38:34.053136 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c3997142-4885-4ec1-a38f-99170c0af813 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:38:34.053889 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c3997142-4885-4ec1-a38f-99170c0af813 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:38:34.054314 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c3997142-4885-4ec1-a38f-99170c0af813 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:38:34.112153 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-c3997142-4885-4ec1-a38f-99170c0af813 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:38:34.119752 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-c3997142-4885-4ec1-a38f-99170c0af813 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.078097 Nov 09 20:38:34.120301 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1161/2352] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:38:34 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:38:35.137138 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-6891080c-e035-4507-a9c9-27bc37167201 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:38:35.137764 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-6891080c-e035-4507-a9c9-27bc37167201 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:38:35.145355 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6891080c-e035-4507-a9c9-27bc37167201 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:38:35.145797 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6891080c-e035-4507-a9c9-27bc37167201 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:38:35.146576 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6891080c-e035-4507-a9c9-27bc37167201 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:38:35.147010 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6891080c-e035-4507-a9c9-27bc37167201 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:38:35.207169 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-6891080c-e035-4507-a9c9-27bc37167201 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:38:35.214783 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-6891080c-e035-4507-a9c9-27bc37167201 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.081305 Nov 09 20:38:35.215338 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1192/2353] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:38:35 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:38:36.231700 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-cc0d6093-22bd-4c19-8606-3dcbe5b28f6e tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:38:36.232301 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-cc0d6093-22bd-4c19-8606-3dcbe5b28f6e tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:38:36.238590 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cc0d6093-22bd-4c19-8606-3dcbe5b28f6e tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:38:36.239308 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cc0d6093-22bd-4c19-8606-3dcbe5b28f6e tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:38:36.239802 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cc0d6093-22bd-4c19-8606-3dcbe5b28f6e tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:38:36.240236 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cc0d6093-22bd-4c19-8606-3dcbe5b28f6e tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:38:36.300749 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-cc0d6093-22bd-4c19-8606-3dcbe5b28f6e tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:38:36.308625 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-cc0d6093-22bd-4c19-8606-3dcbe5b28f6e tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.080502 Nov 09 20:38:36.309262 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1162/2354] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:38:36 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:38:37.325279 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-c7baee41-fb19-448f-99ba-c631dfa17b79 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:38:37.325883 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-c7baee41-fb19-448f-99ba-c631dfa17b79 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:38:37.332877 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c7baee41-fb19-448f-99ba-c631dfa17b79 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:38:37.333325 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c7baee41-fb19-448f-99ba-c631dfa17b79 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:38:37.334095 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c7baee41-fb19-448f-99ba-c631dfa17b79 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:38:37.334532 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c7baee41-fb19-448f-99ba-c631dfa17b79 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:38:37.396437 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-c7baee41-fb19-448f-99ba-c631dfa17b79 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:38:37.404189 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-c7baee41-fb19-448f-99ba-c631dfa17b79 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.082551 Nov 09 20:38:37.404776 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1193/2355] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:38:37 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:38:38.420923 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-cd584a6a-b90e-4a14-b1bf-3d8514142b28 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:38:38.421521 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-cd584a6a-b90e-4a14-b1bf-3d8514142b28 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:38:38.428021 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cd584a6a-b90e-4a14-b1bf-3d8514142b28 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:38:38.428494 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cd584a6a-b90e-4a14-b1bf-3d8514142b28 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:38:38.429254 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cd584a6a-b90e-4a14-b1bf-3d8514142b28 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:38:38.429679 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cd584a6a-b90e-4a14-b1bf-3d8514142b28 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:38:38.490078 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-cd584a6a-b90e-4a14-b1bf-3d8514142b28 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:38:38.497734 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-cd584a6a-b90e-4a14-b1bf-3d8514142b28 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.080401 Nov 09 20:38:38.498287 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1163/2356] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:38:38 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:38:39.514322 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-3ac8ea82-56ec-4494-833e-0fd9adc53a59 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:38:39.514958 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-3ac8ea82-56ec-4494-833e-0fd9adc53a59 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:38:39.521235 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-3ac8ea82-56ec-4494-833e-0fd9adc53a59 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:38:39.521684 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-3ac8ea82-56ec-4494-833e-0fd9adc53a59 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:38:39.522454 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-3ac8ea82-56ec-4494-833e-0fd9adc53a59 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:38:39.522886 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-3ac8ea82-56ec-4494-833e-0fd9adc53a59 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:38:39.581230 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-3ac8ea82-56ec-4494-833e-0fd9adc53a59 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:38:39.588813 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-3ac8ea82-56ec-4494-833e-0fd9adc53a59 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.078123 Nov 09 20:38:39.589368 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1194/2357] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:38:39 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:38:40.605834 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-33820e66-d67b-44ef-a68f-e158fcf59515 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:38:40.606436 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-33820e66-d67b-44ef-a68f-e158fcf59515 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:38:40.613367 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-33820e66-d67b-44ef-a68f-e158fcf59515 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:38:40.613808 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-33820e66-d67b-44ef-a68f-e158fcf59515 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:38:40.614569 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-33820e66-d67b-44ef-a68f-e158fcf59515 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:38:40.614994 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-33820e66-d67b-44ef-a68f-e158fcf59515 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:38:40.674467 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-33820e66-d67b-44ef-a68f-e158fcf59515 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:38:40.682154 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-33820e66-d67b-44ef-a68f-e158fcf59515 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.079990 Nov 09 20:38:40.682713 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1164/2358] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:38:40 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:38:41.699354 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-5e39635b-efd8-49e1-b826-d45d005b3d74 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:38:41.699962 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-5e39635b-efd8-49e1-b826-d45d005b3d74 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:38:41.706837 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-5e39635b-efd8-49e1-b826-d45d005b3d74 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:38:41.707284 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-5e39635b-efd8-49e1-b826-d45d005b3d74 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:38:41.708050 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-5e39635b-efd8-49e1-b826-d45d005b3d74 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:38:41.708516 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-5e39635b-efd8-49e1-b826-d45d005b3d74 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:38:41.765860 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-5e39635b-efd8-49e1-b826-d45d005b3d74 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:38:41.774121 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-5e39635b-efd8-49e1-b826-d45d005b3d74 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.078440 Nov 09 20:38:41.774682 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1195/2359] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:38:41 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:38:42.790642 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-04d13cdc-45ef-47d0-a40c-9fd1fc74ffed tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:38:42.791256 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-04d13cdc-45ef-47d0-a40c-9fd1fc74ffed tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:38:42.797538 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-04d13cdc-45ef-47d0-a40c-9fd1fc74ffed tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:38:42.798024 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-04d13cdc-45ef-47d0-a40c-9fd1fc74ffed tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:38:42.799001 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-04d13cdc-45ef-47d0-a40c-9fd1fc74ffed tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:38:42.799434 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-04d13cdc-45ef-47d0-a40c-9fd1fc74ffed tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:38:42.858060 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-04d13cdc-45ef-47d0-a40c-9fd1fc74ffed tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:38:42.865975 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-04d13cdc-45ef-47d0-a40c-9fd1fc74ffed tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.079011 Nov 09 20:38:42.866533 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1165/2360] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:38:42 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:38:43.882802 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-23435466-98d8-436c-b5e2-e4d8d50df16d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:38:43.883398 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-23435466-98d8-436c-b5e2-e4d8d50df16d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:38:43.889568 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-23435466-98d8-436c-b5e2-e4d8d50df16d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:38:43.890008 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-23435466-98d8-436c-b5e2-e4d8d50df16d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:38:43.891086 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-23435466-98d8-436c-b5e2-e4d8d50df16d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:38:43.891513 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-23435466-98d8-436c-b5e2-e4d8d50df16d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:38:43.954841 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-23435466-98d8-436c-b5e2-e4d8d50df16d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:38:43.962494 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-23435466-98d8-436c-b5e2-e4d8d50df16d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.083388 Nov 09 20:38:43.963055 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1196/2361] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:38:43 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:38:44.978844 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-07195fc9-c002-4d4f-9f70-187bd0eb4140 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:38:44.979470 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-07195fc9-c002-4d4f-9f70-187bd0eb4140 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:38:44.985914 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-07195fc9-c002-4d4f-9f70-187bd0eb4140 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:38:44.987186 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-07195fc9-c002-4d4f-9f70-187bd0eb4140 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:38:44.987954 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-07195fc9-c002-4d4f-9f70-187bd0eb4140 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:38:44.988381 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-07195fc9-c002-4d4f-9f70-187bd0eb4140 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:38:45.047465 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-07195fc9-c002-4d4f-9f70-187bd0eb4140 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:38:45.055205 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-07195fc9-c002-4d4f-9f70-187bd0eb4140 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.080073 Nov 09 20:38:45.055765 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1166/2362] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:38:44 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:38:46.072293 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-be7c3e1d-d5eb-44aa-a9bf-1283f7271a9d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:38:46.072933 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-be7c3e1d-d5eb-44aa-a9bf-1283f7271a9d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:38:46.078693 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-be7c3e1d-d5eb-44aa-a9bf-1283f7271a9d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:38:46.079144 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-be7c3e1d-d5eb-44aa-a9bf-1283f7271a9d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:38:46.079943 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-be7c3e1d-d5eb-44aa-a9bf-1283f7271a9d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:38:46.080530 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-be7c3e1d-d5eb-44aa-a9bf-1283f7271a9d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:38:46.142265 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-be7c3e1d-d5eb-44aa-a9bf-1283f7271a9d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:38:46.151496 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-be7c3e1d-d5eb-44aa-a9bf-1283f7271a9d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.082909 Nov 09 20:38:46.152062 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1197/2363] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:38:46 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:38:47.169320 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-81e9d568-5173-4c51-99e0-89facbf858ba tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:38:47.170012 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-81e9d568-5173-4c51-99e0-89facbf858ba tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:38:47.176156 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-81e9d568-5173-4c51-99e0-89facbf858ba tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:38:47.176642 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-81e9d568-5173-4c51-99e0-89facbf858ba tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:38:47.177450 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-81e9d568-5173-4c51-99e0-89facbf858ba tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:38:47.177884 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-81e9d568-5173-4c51-99e0-89facbf858ba tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:38:47.235696 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-81e9d568-5173-4c51-99e0-89facbf858ba tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:38:47.243932 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-81e9d568-5173-4c51-99e0-89facbf858ba tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.078296 Nov 09 20:38:47.244519 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1167/2364] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:38:47 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:38:48.261064 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-f3e91965-5bb9-4ab9-82ec-e69fadcfa6e1 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:38:48.261666 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-f3e91965-5bb9-4ab9-82ec-e69fadcfa6e1 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:38:48.268307 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f3e91965-5bb9-4ab9-82ec-e69fadcfa6e1 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:38:48.268781 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f3e91965-5bb9-4ab9-82ec-e69fadcfa6e1 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:38:48.269537 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f3e91965-5bb9-4ab9-82ec-e69fadcfa6e1 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:38:48.269962 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f3e91965-5bb9-4ab9-82ec-e69fadcfa6e1 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:38:48.327751 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-f3e91965-5bb9-4ab9-82ec-e69fadcfa6e1 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:38:48.335989 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-f3e91965-5bb9-4ab9-82ec-e69fadcfa6e1 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.078554 Nov 09 20:38:48.336564 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1198/2365] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:38:48 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:38:49.351651 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-aa4279bc-2fc7-4699-b5c4-ca533a14eb27 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:38:49.352261 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-aa4279bc-2fc7-4699-b5c4-ca533a14eb27 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:38:49.358528 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-aa4279bc-2fc7-4699-b5c4-ca533a14eb27 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:38:49.358974 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-aa4279bc-2fc7-4699-b5c4-ca533a14eb27 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:38:49.359740 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-aa4279bc-2fc7-4699-b5c4-ca533a14eb27 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:38:49.360174 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-aa4279bc-2fc7-4699-b5c4-ca533a14eb27 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:38:49.419168 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-aa4279bc-2fc7-4699-b5c4-ca533a14eb27 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:38:49.426671 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-aa4279bc-2fc7-4699-b5c4-ca533a14eb27 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.078756 Nov 09 20:38:49.427229 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1168/2366] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:38:49 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:38:50.443535 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-e55e6fa7-97d6-486f-a7dd-13679689b4df tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:38:50.444055 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-e55e6fa7-97d6-486f-a7dd-13679689b4df tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:38:50.450225 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e55e6fa7-97d6-486f-a7dd-13679689b4df tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:38:50.450665 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e55e6fa7-97d6-486f-a7dd-13679689b4df tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:38:50.451425 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e55e6fa7-97d6-486f-a7dd-13679689b4df tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:38:50.451856 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e55e6fa7-97d6-486f-a7dd-13679689b4df tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:38:50.514207 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-e55e6fa7-97d6-486f-a7dd-13679689b4df tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:38:50.521917 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-e55e6fa7-97d6-486f-a7dd-13679689b4df tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.082722 Nov 09 20:38:50.522469 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1199/2367] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:38:50 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:38:51.538286 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-0113d1ca-5371-4bef-99dd-dc2aae280376 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:38:51.538821 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-0113d1ca-5371-4bef-99dd-dc2aae280376 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:38:51.545073 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0113d1ca-5371-4bef-99dd-dc2aae280376 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:38:51.545510 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0113d1ca-5371-4bef-99dd-dc2aae280376 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:38:51.546260 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0113d1ca-5371-4bef-99dd-dc2aae280376 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:38:51.546683 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0113d1ca-5371-4bef-99dd-dc2aae280376 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:38:51.604559 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-0113d1ca-5371-4bef-99dd-dc2aae280376 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:38:51.612274 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-0113d1ca-5371-4bef-99dd-dc2aae280376 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.077654 Nov 09 20:38:51.612874 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1169/2368] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:38:51 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 20:38:52.628886 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-4503bdc1-867f-4069-b575-e1774f6dfbb5 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:38:52.629525 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-4503bdc1-867f-4069-b575-e1774f6dfbb5 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:38:52.635780 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-4503bdc1-867f-4069-b575-e1774f6dfbb5 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:38:52.636227 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-4503bdc1-867f-4069-b575-e1774f6dfbb5 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:38:52.637042 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-4503bdc1-867f-4069-b575-e1774f6dfbb5 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:38:52.637475 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-4503bdc1-867f-4069-b575-e1774f6dfbb5 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:38:52.696450 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-4503bdc1-867f-4069-b575-e1774f6dfbb5 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:38:52.704064 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-4503bdc1-867f-4069-b575-e1774f6dfbb5 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.079066 Nov 09 20:38:52.704663 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1200/2369] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:38:52 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:38:53.721676 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-fdd74930-d50a-4a47-8f0c-700fb3ec0bc9 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:38:53.722271 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-fdd74930-d50a-4a47-8f0c-700fb3ec0bc9 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:38:53.728373 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fdd74930-d50a-4a47-8f0c-700fb3ec0bc9 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:38:53.728870 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fdd74930-d50a-4a47-8f0c-700fb3ec0bc9 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:38:53.729655 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fdd74930-d50a-4a47-8f0c-700fb3ec0bc9 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:38:53.730078 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fdd74930-d50a-4a47-8f0c-700fb3ec0bc9 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:38:53.789843 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-fdd74930-d50a-4a47-8f0c-700fb3ec0bc9 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:38:53.797456 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-fdd74930-d50a-4a47-8f0c-700fb3ec0bc9 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.079975 Nov 09 20:38:53.798016 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1170/2370] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:38:53 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:38:54.815068 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-7da716b1-8dff-449a-95e0-9b8a0d0a6bcf tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:38:54.815693 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-7da716b1-8dff-449a-95e0-9b8a0d0a6bcf tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:38:54.821908 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-7da716b1-8dff-449a-95e0-9b8a0d0a6bcf tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:38:54.822347 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-7da716b1-8dff-449a-95e0-9b8a0d0a6bcf tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:38:54.823104 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-7da716b1-8dff-449a-95e0-9b8a0d0a6bcf tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:38:54.823528 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-7da716b1-8dff-449a-95e0-9b8a0d0a6bcf tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:38:54.881855 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-7da716b1-8dff-449a-95e0-9b8a0d0a6bcf tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:38:54.889382 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-7da716b1-8dff-449a-95e0-9b8a0d0a6bcf tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.078588 Nov 09 20:38:54.889937 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1201/2371] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:38:54 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:38:55.906055 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-9bd6d4b9-af71-44c9-a20d-c3194a78c0f5 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:38:55.906671 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-9bd6d4b9-af71-44c9-a20d-c3194a78c0f5 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:38:55.912680 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9bd6d4b9-af71-44c9-a20d-c3194a78c0f5 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:38:55.913132 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9bd6d4b9-af71-44c9-a20d-c3194a78c0f5 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:38:55.913934 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9bd6d4b9-af71-44c9-a20d-c3194a78c0f5 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:38:55.914369 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9bd6d4b9-af71-44c9-a20d-c3194a78c0f5 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:38:55.972950 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-9bd6d4b9-af71-44c9-a20d-c3194a78c0f5 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:38:55.980502 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-9bd6d4b9-af71-44c9-a20d-c3194a78c0f5 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.078195 Nov 09 20:38:55.981065 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1171/2372] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:38:55 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:38:56.997047 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-a333f552-d095-46e5-947c-87a6651d74df tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:38:56.997654 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-a333f552-d095-46e5-947c-87a6651d74df tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:38:57.004541 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a333f552-d095-46e5-947c-87a6651d74df tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:38:57.004989 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a333f552-d095-46e5-947c-87a6651d74df tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:38:57.005755 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a333f552-d095-46e5-947c-87a6651d74df tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:38:57.006190 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a333f552-d095-46e5-947c-87a6651d74df tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:38:57.068748 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-a333f552-d095-46e5-947c-87a6651d74df tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:38:57.076342 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-a333f552-d095-46e5-947c-87a6651d74df tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.082938 Nov 09 20:38:57.076919 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1202/2373] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:38:56 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:38:58.093469 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-d29fb829-71f3-465a-b1a1-d7ca09c7f3e1 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:38:58.094079 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-d29fb829-71f3-465a-b1a1-d7ca09c7f3e1 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:38:58.100686 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d29fb829-71f3-465a-b1a1-d7ca09c7f3e1 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:38:58.101202 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d29fb829-71f3-465a-b1a1-d7ca09c7f3e1 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:38:58.103658 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d29fb829-71f3-465a-b1a1-d7ca09c7f3e1 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:38:58.103658 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d29fb829-71f3-465a-b1a1-d7ca09c7f3e1 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:38:58.161197 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-d29fb829-71f3-465a-b1a1-d7ca09c7f3e1 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:38:58.168843 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-d29fb829-71f3-465a-b1a1-d7ca09c7f3e1 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.079039 Nov 09 20:38:58.169403 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1172/2374] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:38:58 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:38:59.186039 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-a630e44b-64cc-4d65-8f0e-c026a22291a4 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:38:59.186644 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-a630e44b-64cc-4d65-8f0e-c026a22291a4 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:38:59.193246 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a630e44b-64cc-4d65-8f0e-c026a22291a4 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:38:59.193715 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a630e44b-64cc-4d65-8f0e-c026a22291a4 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:38:59.194520 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a630e44b-64cc-4d65-8f0e-c026a22291a4 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:38:59.194943 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a630e44b-64cc-4d65-8f0e-c026a22291a4 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:38:59.254981 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-a630e44b-64cc-4d65-8f0e-c026a22291a4 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:38:59.262946 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-a630e44b-64cc-4d65-8f0e-c026a22291a4 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.080597 Nov 09 20:38:59.263504 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1203/2375] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:38:59 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:39:00.278731 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-14374889-0022-46a1-87d0-56393e34212d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:39:00.279315 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-14374889-0022-46a1-87d0-56393e34212d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:39:00.286688 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-14374889-0022-46a1-87d0-56393e34212d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:39:00.287166 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-14374889-0022-46a1-87d0-56393e34212d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:39:00.287939 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-14374889-0022-46a1-87d0-56393e34212d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:39:00.288370 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-14374889-0022-46a1-87d0-56393e34212d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:39:00.347201 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-14374889-0022-46a1-87d0-56393e34212d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:39:00.354743 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-14374889-0022-46a1-87d0-56393e34212d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.079680 Nov 09 20:39:00.355293 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1173/2376] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:39:00 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:39:01.370989 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-a7fc202b-be4a-48b0-8d19-ec6a45d81808 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:39:01.371590 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-a7fc202b-be4a-48b0-8d19-ec6a45d81808 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:39:01.379107 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a7fc202b-be4a-48b0-8d19-ec6a45d81808 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:39:01.379596 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a7fc202b-be4a-48b0-8d19-ec6a45d81808 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:39:01.380347 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a7fc202b-be4a-48b0-8d19-ec6a45d81808 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:39:01.380805 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a7fc202b-be4a-48b0-8d19-ec6a45d81808 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:39:01.439938 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-a7fc202b-be4a-48b0-8d19-ec6a45d81808 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:39:01.447740 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-a7fc202b-be4a-48b0-8d19-ec6a45d81808 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.080278 Nov 09 20:39:01.448296 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1204/2377] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:39:01 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 20:39:02.464830 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-95cc7b54-8cfd-4fba-8bd9-d0806ed0d6e4 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:39:02.465437 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-95cc7b54-8cfd-4fba-8bd9-d0806ed0d6e4 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:39:02.472440 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-95cc7b54-8cfd-4fba-8bd9-d0806ed0d6e4 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:39:02.472886 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-95cc7b54-8cfd-4fba-8bd9-d0806ed0d6e4 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:39:02.473647 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-95cc7b54-8cfd-4fba-8bd9-d0806ed0d6e4 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:39:02.474075 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-95cc7b54-8cfd-4fba-8bd9-d0806ed0d6e4 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:39:02.532339 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-95cc7b54-8cfd-4fba-8bd9-d0806ed0d6e4 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:39:02.540695 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-95cc7b54-8cfd-4fba-8bd9-d0806ed0d6e4 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.079340 Nov 09 20:39:02.541193 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1174/2378] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:39:02 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:39:03.557568 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-4d8bf955-a1ef-4b60-a132-4a02769d573f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:39:03.558077 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-4d8bf955-a1ef-4b60-a132-4a02769d573f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:39:03.564546 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-4d8bf955-a1ef-4b60-a132-4a02769d573f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:39:03.565033 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-4d8bf955-a1ef-4b60-a132-4a02769d573f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:39:03.565808 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-4d8bf955-a1ef-4b60-a132-4a02769d573f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:39:03.566244 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-4d8bf955-a1ef-4b60-a132-4a02769d573f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:39:03.628239 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-4d8bf955-a1ef-4b60-a132-4a02769d573f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:39:03.637319 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-4d8bf955-a1ef-4b60-a132-4a02769d573f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.083438 Nov 09 20:39:03.637899 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1205/2379] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:39:03 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:39:04.654432 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-ccb93337-26aa-43dd-8fdd-3f88f08c1a0d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:39:04.655032 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-ccb93337-26aa-43dd-8fdd-3f88f08c1a0d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:39:04.663742 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ccb93337-26aa-43dd-8fdd-3f88f08c1a0d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:39:04.664657 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ccb93337-26aa-43dd-8fdd-3f88f08c1a0d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:39:04.665435 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ccb93337-26aa-43dd-8fdd-3f88f08c1a0d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:39:04.665864 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ccb93337-26aa-43dd-8fdd-3f88f08c1a0d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:39:04.733359 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-ccb93337-26aa-43dd-8fdd-3f88f08c1a0d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:39:04.743241 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-ccb93337-26aa-43dd-8fdd-3f88f08c1a0d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.091766 Nov 09 20:39:04.743842 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1175/2380] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:39:04 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:39:05.760968 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-e963edd5-6f2b-4f29-af52-0f73848f49f8 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:39:05.761581 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-e963edd5-6f2b-4f29-af52-0f73848f49f8 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:39:05.768348 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e963edd5-6f2b-4f29-af52-0f73848f49f8 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:39:05.768808 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e963edd5-6f2b-4f29-af52-0f73848f49f8 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:39:05.769564 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e963edd5-6f2b-4f29-af52-0f73848f49f8 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:39:05.769987 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e963edd5-6f2b-4f29-af52-0f73848f49f8 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:39:05.827610 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-e963edd5-6f2b-4f29-af52-0f73848f49f8 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:39:05.836236 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-e963edd5-6f2b-4f29-af52-0f73848f49f8 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.078949 Nov 09 20:39:05.836830 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1206/2381] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:39:05 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:39:06.852783 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-a6592ab1-7211-4b58-a64b-dfe42a1d8dee tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:39:06.853384 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-a6592ab1-7211-4b58-a64b-dfe42a1d8dee tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:39:06.859520 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a6592ab1-7211-4b58-a64b-dfe42a1d8dee tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:39:06.860151 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a6592ab1-7211-4b58-a64b-dfe42a1d8dee tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:39:06.860980 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a6592ab1-7211-4b58-a64b-dfe42a1d8dee tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:39:06.861468 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a6592ab1-7211-4b58-a64b-dfe42a1d8dee tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:39:06.919622 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-a6592ab1-7211-4b58-a64b-dfe42a1d8dee tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:39:06.927589 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-a6592ab1-7211-4b58-a64b-dfe42a1d8dee tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.078441 Nov 09 20:39:06.928165 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1176/2382] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:39:06 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:39:07.944200 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-9f7c8d03-9348-422c-a579-bc44efebcd1e tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:39:07.944831 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-9f7c8d03-9348-422c-a579-bc44efebcd1e tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:39:07.950999 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-9f7c8d03-9348-422c-a579-bc44efebcd1e tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:39:07.951481 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-9f7c8d03-9348-422c-a579-bc44efebcd1e tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:39:07.952251 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-9f7c8d03-9348-422c-a579-bc44efebcd1e tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:39:07.952715 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-9f7c8d03-9348-422c-a579-bc44efebcd1e tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:39:08.012005 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-9f7c8d03-9348-422c-a579-bc44efebcd1e tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:39:08.019747 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-9f7c8d03-9348-422c-a579-bc44efebcd1e tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.079223 Nov 09 20:39:08.020297 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1207/2383] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:39:07 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 20:39:09.036054 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-ba93b529-9c2c-41dc-88ee-72c64c7bda5b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:39:09.036671 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-ba93b529-9c2c-41dc-88ee-72c64c7bda5b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:39:09.042862 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ba93b529-9c2c-41dc-88ee-72c64c7bda5b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:39:09.043299 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ba93b529-9c2c-41dc-88ee-72c64c7bda5b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:39:09.044049 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ba93b529-9c2c-41dc-88ee-72c64c7bda5b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:39:09.044573 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ba93b529-9c2c-41dc-88ee-72c64c7bda5b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:39:09.104609 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-ba93b529-9c2c-41dc-88ee-72c64c7bda5b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:39:09.112936 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-ba93b529-9c2c-41dc-88ee-72c64c7bda5b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.080613 Nov 09 20:39:09.113496 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1177/2384] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:39:09 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:39:10.129701 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-a7900f77-109d-4cd1-8374-d7db9f18db81 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:39:10.130314 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-a7900f77-109d-4cd1-8374-d7db9f18db81 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:39:10.136519 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a7900f77-109d-4cd1-8374-d7db9f18db81 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:39:10.136957 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a7900f77-109d-4cd1-8374-d7db9f18db81 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:39:10.137715 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a7900f77-109d-4cd1-8374-d7db9f18db81 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:39:10.138139 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a7900f77-109d-4cd1-8374-d7db9f18db81 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:39:10.200200 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-a7900f77-109d-4cd1-8374-d7db9f18db81 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:39:10.208040 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-a7900f77-109d-4cd1-8374-d7db9f18db81 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.082279 Nov 09 20:39:10.208621 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1208/2385] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:39:10 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:39:11.224968 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-7a8452b7-5397-4c77-a136-8663d1277a7d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:39:11.225595 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-7a8452b7-5397-4c77-a136-8663d1277a7d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:39:11.231674 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7a8452b7-5397-4c77-a136-8663d1277a7d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:39:11.232116 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7a8452b7-5397-4c77-a136-8663d1277a7d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:39:11.232900 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7a8452b7-5397-4c77-a136-8663d1277a7d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:39:11.233324 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7a8452b7-5397-4c77-a136-8663d1277a7d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:39:11.293232 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-7a8452b7-5397-4c77-a136-8663d1277a7d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:39:11.301190 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-7a8452b7-5397-4c77-a136-8663d1277a7d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.079923 Nov 09 20:39:11.301752 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1178/2386] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:39:11 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:39:12.318261 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-cdb833d5-c236-4e95-b4c1-a3bf7cb92efb tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:39:12.318865 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-cdb833d5-c236-4e95-b4c1-a3bf7cb92efb tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:39:12.325108 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-cdb833d5-c236-4e95-b4c1-a3bf7cb92efb tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:39:12.325550 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-cdb833d5-c236-4e95-b4c1-a3bf7cb92efb tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:39:12.326313 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-cdb833d5-c236-4e95-b4c1-a3bf7cb92efb tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:39:12.326752 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-cdb833d5-c236-4e95-b4c1-a3bf7cb92efb tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:39:12.386806 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-cdb833d5-c236-4e95-b4c1-a3bf7cb92efb tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:39:12.394569 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-cdb833d5-c236-4e95-b4c1-a3bf7cb92efb tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.080702 Nov 09 20:39:12.395122 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1209/2387] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:39:12 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:39:13.411042 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-3022b541-9225-43de-9cb5-5e9cf23b212e tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:39:13.411641 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-3022b541-9225-43de-9cb5-5e9cf23b212e tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:39:13.417864 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3022b541-9225-43de-9cb5-5e9cf23b212e tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:39:13.418304 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3022b541-9225-43de-9cb5-5e9cf23b212e tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:39:13.419088 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3022b541-9225-43de-9cb5-5e9cf23b212e tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:39:13.419513 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3022b541-9225-43de-9cb5-5e9cf23b212e tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:39:13.481589 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-3022b541-9225-43de-9cb5-5e9cf23b212e tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:39:13.489748 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-3022b541-9225-43de-9cb5-5e9cf23b212e tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.082574 Nov 09 20:39:13.490301 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1179/2388] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:39:13 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:39:14.506444 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-2e9c26df-e2a2-449d-8bf5-1f30600ecc48 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:39:14.507040 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-2e9c26df-e2a2-449d-8bf5-1f30600ecc48 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:39:14.513370 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-2e9c26df-e2a2-449d-8bf5-1f30600ecc48 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:39:14.513809 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-2e9c26df-e2a2-449d-8bf5-1f30600ecc48 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:39:14.514570 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-2e9c26df-e2a2-449d-8bf5-1f30600ecc48 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:39:14.514996 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-2e9c26df-e2a2-449d-8bf5-1f30600ecc48 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:39:14.572729 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-2e9c26df-e2a2-449d-8bf5-1f30600ecc48 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:39:14.581197 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-2e9c26df-e2a2-449d-8bf5-1f30600ecc48 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.078809 Nov 09 20:39:14.581751 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1210/2389] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:39:14 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:39:15.597570 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-c6ed1920-a00d-4e3d-a521-81532dd89bdb tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:39:15.598178 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-c6ed1920-a00d-4e3d-a521-81532dd89bdb tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:39:15.605031 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c6ed1920-a00d-4e3d-a521-81532dd89bdb tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:39:15.605631 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c6ed1920-a00d-4e3d-a521-81532dd89bdb tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:39:15.606405 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c6ed1920-a00d-4e3d-a521-81532dd89bdb tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:39:15.606835 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c6ed1920-a00d-4e3d-a521-81532dd89bdb tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:39:15.665505 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-c6ed1920-a00d-4e3d-a521-81532dd89bdb tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:39:15.673079 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-c6ed1920-a00d-4e3d-a521-81532dd89bdb tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.079266 Nov 09 20:39:15.673816 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1180/2390] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:39:15 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:39:16.689993 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-af236d30-bc76-4e64-a9a6-588a0ab2c2a0 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:39:16.690603 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-af236d30-bc76-4e64-a9a6-588a0ab2c2a0 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:39:16.696571 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-af236d30-bc76-4e64-a9a6-588a0ab2c2a0 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:39:16.697054 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-af236d30-bc76-4e64-a9a6-588a0ab2c2a0 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:39:16.697858 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-af236d30-bc76-4e64-a9a6-588a0ab2c2a0 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:39:16.698288 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-af236d30-bc76-4e64-a9a6-588a0ab2c2a0 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:39:16.761070 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-af236d30-bc76-4e64-a9a6-588a0ab2c2a0 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:39:16.769580 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-af236d30-bc76-4e64-a9a6-588a0ab2c2a0 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.083555 Nov 09 20:39:16.770138 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1211/2391] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:39:16 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:39:17.786525 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-b6f85806-8ec9-4bcb-8074-2efec0a983a1 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:39:17.787210 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-b6f85806-8ec9-4bcb-8074-2efec0a983a1 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:39:17.793441 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b6f85806-8ec9-4bcb-8074-2efec0a983a1 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:39:17.793889 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b6f85806-8ec9-4bcb-8074-2efec0a983a1 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:39:17.794656 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b6f85806-8ec9-4bcb-8074-2efec0a983a1 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:39:17.795104 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b6f85806-8ec9-4bcb-8074-2efec0a983a1 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:39:17.853564 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-b6f85806-8ec9-4bcb-8074-2efec0a983a1 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:39:17.861915 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-b6f85806-8ec9-4bcb-8074-2efec0a983a1 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.079089 Nov 09 20:39:17.862477 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1181/2392] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:39:17 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:39:18.879076 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-8868d9e4-be47-4b42-98a8-83f4f40e96fe tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:39:18.879684 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-8868d9e4-be47-4b42-98a8-83f4f40e96fe tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:39:18.885925 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-8868d9e4-be47-4b42-98a8-83f4f40e96fe tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:39:18.886367 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-8868d9e4-be47-4b42-98a8-83f4f40e96fe tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:39:18.887132 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-8868d9e4-be47-4b42-98a8-83f4f40e96fe tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:39:18.887568 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-8868d9e4-be47-4b42-98a8-83f4f40e96fe tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:39:18.946498 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-8868d9e4-be47-4b42-98a8-83f4f40e96fe tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:39:18.954074 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-8868d9e4-be47-4b42-98a8-83f4f40e96fe tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.079272 Nov 09 20:39:18.955493 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1212/2393] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:39:18 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:39:19.971853 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-0b5ed74f-2daa-4411-bcdf-271c7934edda tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:39:19.972574 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-0b5ed74f-2daa-4411-bcdf-271c7934edda tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:39:19.978806 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0b5ed74f-2daa-4411-bcdf-271c7934edda tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:39:19.979251 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0b5ed74f-2daa-4411-bcdf-271c7934edda tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:39:19.980013 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0b5ed74f-2daa-4411-bcdf-271c7934edda tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:39:19.980465 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0b5ed74f-2daa-4411-bcdf-271c7934edda tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:39:20.039816 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-0b5ed74f-2daa-4411-bcdf-271c7934edda tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:39:20.047651 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-0b5ed74f-2daa-4411-bcdf-271c7934edda tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.079921 Nov 09 20:39:20.048876 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1182/2394] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:39:19 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:39:21.065951 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-c9231383-78bf-45f7-a421-5c605a3736d1 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:39:21.066506 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-c9231383-78bf-45f7-a421-5c605a3736d1 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:39:21.072684 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c9231383-78bf-45f7-a421-5c605a3736d1 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:39:21.073129 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c9231383-78bf-45f7-a421-5c605a3736d1 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:39:21.073895 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c9231383-78bf-45f7-a421-5c605a3736d1 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:39:21.074327 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c9231383-78bf-45f7-a421-5c605a3736d1 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:39:21.133822 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-c9231383-78bf-45f7-a421-5c605a3736d1 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:39:21.141688 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-c9231383-78bf-45f7-a421-5c605a3736d1 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.080454 Nov 09 20:39:21.142265 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1213/2395] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:39:21 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:39:22.158839 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-aab5f700-9922-48d5-a8dc-5b0371c11daa tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:39:22.159428 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-aab5f700-9922-48d5-a8dc-5b0371c11daa tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:39:22.165572 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-aab5f700-9922-48d5-a8dc-5b0371c11daa tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:39:22.166011 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-aab5f700-9922-48d5-a8dc-5b0371c11daa tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:39:22.166767 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-aab5f700-9922-48d5-a8dc-5b0371c11daa tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:39:22.167191 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-aab5f700-9922-48d5-a8dc-5b0371c11daa tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:39:22.226842 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-aab5f700-9922-48d5-a8dc-5b0371c11daa tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:39:22.234483 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-aab5f700-9922-48d5-a8dc-5b0371c11daa tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.079326 Nov 09 20:39:22.235041 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1183/2396] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:39:22 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:39:23.254174 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-7647dde0-1e5c-4c5c-930a-9a8f00a1ad67 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:39:23.254851 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-7647dde0-1e5c-4c5c-930a-9a8f00a1ad67 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:39:23.261123 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-7647dde0-1e5c-4c5c-930a-9a8f00a1ad67 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:39:23.261575 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-7647dde0-1e5c-4c5c-930a-9a8f00a1ad67 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:39:23.262355 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-7647dde0-1e5c-4c5c-930a-9a8f00a1ad67 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:39:23.262792 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-7647dde0-1e5c-4c5c-930a-9a8f00a1ad67 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:39:23.326322 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-7647dde0-1e5c-4c5c-930a-9a8f00a1ad67 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:39:23.333980 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-7647dde0-1e5c-4c5c-930a-9a8f00a1ad67 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.084398 Nov 09 20:39:23.334566 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1214/2397] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:39:23 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:39:24.351150 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-8a76a058-bba3-4b62-b744-f19ac06da8db tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:39:24.351742 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-8a76a058-bba3-4b62-b744-f19ac06da8db tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:39:24.357872 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8a76a058-bba3-4b62-b744-f19ac06da8db tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:39:24.358318 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8a76a058-bba3-4b62-b744-f19ac06da8db tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:39:24.359068 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8a76a058-bba3-4b62-b744-f19ac06da8db tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:39:24.359491 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8a76a058-bba3-4b62-b744-f19ac06da8db tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:39:24.418475 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-8a76a058-bba3-4b62-b744-f19ac06da8db tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:39:24.426028 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-8a76a058-bba3-4b62-b744-f19ac06da8db tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.078497 Nov 09 20:39:24.426587 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1184/2398] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:39:24 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:39:25.442768 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-c2d9904b-5dcd-439f-b8cc-39440e463c96 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:39:25.443386 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-c2d9904b-5dcd-439f-b8cc-39440e463c96 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:39:25.449627 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c2d9904b-5dcd-439f-b8cc-39440e463c96 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:39:25.450075 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c2d9904b-5dcd-439f-b8cc-39440e463c96 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:39:25.451024 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c2d9904b-5dcd-439f-b8cc-39440e463c96 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:39:25.451337 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c2d9904b-5dcd-439f-b8cc-39440e463c96 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:39:25.511412 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-c2d9904b-5dcd-439f-b8cc-39440e463c96 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:39:25.519561 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-c2d9904b-5dcd-439f-b8cc-39440e463c96 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.080922 Nov 09 20:39:25.520123 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1215/2399] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:39:25 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:39:25.669700 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 09 20:39:25.669972 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: Tue Nov 9 20:39:25 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 09 20:39:26.536442 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-cbccb1dd-7298-44e8-b71d-e40d52d199eb tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:39:26.537051 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-cbccb1dd-7298-44e8-b71d-e40d52d199eb tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:39:26.543182 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cbccb1dd-7298-44e8-b71d-e40d52d199eb tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:39:26.543635 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cbccb1dd-7298-44e8-b71d-e40d52d199eb tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:39:26.544410 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cbccb1dd-7298-44e8-b71d-e40d52d199eb tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:39:26.544850 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cbccb1dd-7298-44e8-b71d-e40d52d199eb tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:39:26.604335 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-cbccb1dd-7298-44e8-b71d-e40d52d199eb tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:39:26.612925 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-cbccb1dd-7298-44e8-b71d-e40d52d199eb tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.080562 Nov 09 20:39:26.613503 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1185/2400] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:39:26 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:39:27.631324 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-b20ca273-1b2c-454f-86df-f5e2bc8ab2ee tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:39:27.631927 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-b20ca273-1b2c-454f-86df-f5e2bc8ab2ee tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:39:27.638193 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b20ca273-1b2c-454f-86df-f5e2bc8ab2ee tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:39:27.638646 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b20ca273-1b2c-454f-86df-f5e2bc8ab2ee tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:39:27.639412 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b20ca273-1b2c-454f-86df-f5e2bc8ab2ee tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:39:27.639841 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b20ca273-1b2c-454f-86df-f5e2bc8ab2ee tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:39:27.700610 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-b20ca273-1b2c-454f-86df-f5e2bc8ab2ee tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:39:27.708893 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-b20ca273-1b2c-454f-86df-f5e2bc8ab2ee tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.082637 Nov 09 20:39:27.709452 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1216/2401] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:39:27 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:39:28.725395 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-ec0ddd1f-155d-4987-9c5c-dfc8ef6357e8 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:39:28.725993 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-ec0ddd1f-155d-4987-9c5c-dfc8ef6357e8 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:39:28.732136 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ec0ddd1f-155d-4987-9c5c-dfc8ef6357e8 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:39:28.732612 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ec0ddd1f-155d-4987-9c5c-dfc8ef6357e8 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:39:28.733372 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ec0ddd1f-155d-4987-9c5c-dfc8ef6357e8 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:39:28.733798 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ec0ddd1f-155d-4987-9c5c-dfc8ef6357e8 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:39:28.792282 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-ec0ddd1f-155d-4987-9c5c-dfc8ef6357e8 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:39:28.800062 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-ec0ddd1f-155d-4987-9c5c-dfc8ef6357e8 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.078263 Nov 09 20:39:28.800645 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1186/2402] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:39:28 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:39:29.816852 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-8ee65aab-7cf5-43a8-968c-215a66fd069c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:39:29.817459 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-8ee65aab-7cf5-43a8-968c-215a66fd069c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:39:29.823699 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-8ee65aab-7cf5-43a8-968c-215a66fd069c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:39:29.824138 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-8ee65aab-7cf5-43a8-968c-215a66fd069c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:39:29.824931 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-8ee65aab-7cf5-43a8-968c-215a66fd069c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:39:29.825362 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-8ee65aab-7cf5-43a8-968c-215a66fd069c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:39:29.887967 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-8ee65aab-7cf5-43a8-968c-215a66fd069c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:39:29.895720 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-8ee65aab-7cf5-43a8-968c-215a66fd069c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.083074 Nov 09 20:39:29.896277 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1217/2403] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:39:29 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:39:30.911999 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-d1101605-c3a0-4ba0-85ce-91fb19896101 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:39:30.912633 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-d1101605-c3a0-4ba0-85ce-91fb19896101 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:39:30.918819 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d1101605-c3a0-4ba0-85ce-91fb19896101 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:39:30.919257 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d1101605-c3a0-4ba0-85ce-91fb19896101 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:39:30.920006 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d1101605-c3a0-4ba0-85ce-91fb19896101 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:39:30.920457 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d1101605-c3a0-4ba0-85ce-91fb19896101 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:39:30.978752 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-d1101605-c3a0-4ba0-85ce-91fb19896101 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:39:30.988250 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-d1101605-c3a0-4ba0-85ce-91fb19896101 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.079875 Nov 09 20:39:30.988843 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1187/2404] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:39:30 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:39:32.005628 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-38be104c-3fa7-40d2-9eee-1563e08f2310 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:39:32.006259 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-38be104c-3fa7-40d2-9eee-1563e08f2310 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:39:32.012452 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-38be104c-3fa7-40d2-9eee-1563e08f2310 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:39:32.012901 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-38be104c-3fa7-40d2-9eee-1563e08f2310 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:39:32.013659 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-38be104c-3fa7-40d2-9eee-1563e08f2310 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:39:32.014090 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-38be104c-3fa7-40d2-9eee-1563e08f2310 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:39:32.072946 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-38be104c-3fa7-40d2-9eee-1563e08f2310 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:39:32.081335 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-38be104c-3fa7-40d2-9eee-1563e08f2310 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.080354 Nov 09 20:39:32.081895 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1218/2405] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:39:31 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:39:33.097908 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-93bdf3ec-3392-4e1c-97a3-0259f4915074 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:39:33.098521 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-93bdf3ec-3392-4e1c-97a3-0259f4915074 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:39:33.104787 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-93bdf3ec-3392-4e1c-97a3-0259f4915074 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:39:33.105236 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-93bdf3ec-3392-4e1c-97a3-0259f4915074 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:39:33.106007 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-93bdf3ec-3392-4e1c-97a3-0259f4915074 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:39:33.106439 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-93bdf3ec-3392-4e1c-97a3-0259f4915074 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:39:33.167274 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-93bdf3ec-3392-4e1c-97a3-0259f4915074 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:39:33.175672 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-93bdf3ec-3392-4e1c-97a3-0259f4915074 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.081389 Nov 09 20:39:33.176238 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1188/2406] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:39:33 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:39:34.191815 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-6e9aa0b4-f306-4b32-8635-5272017c4861 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:39:34.192427 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-6e9aa0b4-f306-4b32-8635-5272017c4861 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:39:34.198601 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6e9aa0b4-f306-4b32-8635-5272017c4861 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:39:34.199075 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6e9aa0b4-f306-4b32-8635-5272017c4861 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:39:34.199831 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6e9aa0b4-f306-4b32-8635-5272017c4861 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:39:34.200263 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6e9aa0b4-f306-4b32-8635-5272017c4861 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:39:34.258834 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-6e9aa0b4-f306-4b32-8635-5272017c4861 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:39:34.266522 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-6e9aa0b4-f306-4b32-8635-5272017c4861 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.079045 Nov 09 20:39:34.267068 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1219/2407] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:39:34 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:39:35.284121 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-7b2549c3-de19-49e1-918a-d93b40331ee0 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:39:35.284831 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-7b2549c3-de19-49e1-918a-d93b40331ee0 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:39:35.290780 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7b2549c3-de19-49e1-918a-d93b40331ee0 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:39:35.291230 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7b2549c3-de19-49e1-918a-d93b40331ee0 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:39:35.292006 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7b2549c3-de19-49e1-918a-d93b40331ee0 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:39:35.292476 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7b2549c3-de19-49e1-918a-d93b40331ee0 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:39:35.351016 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-7b2549c3-de19-49e1-918a-d93b40331ee0 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:39:35.358663 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-7b2549c3-de19-49e1-918a-d93b40331ee0 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.078951 Nov 09 20:39:35.359218 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1189/2408] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:39:35 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:39:36.374756 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-affe11e7-8b1f-4e5d-8b6c-10f127dee5cc tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:39:36.375358 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-affe11e7-8b1f-4e5d-8b6c-10f127dee5cc tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:39:36.382419 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-affe11e7-8b1f-4e5d-8b6c-10f127dee5cc tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:39:36.382861 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-affe11e7-8b1f-4e5d-8b6c-10f127dee5cc tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:39:36.383621 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-affe11e7-8b1f-4e5d-8b6c-10f127dee5cc tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:39:36.384048 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-affe11e7-8b1f-4e5d-8b6c-10f127dee5cc tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:39:36.446758 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-affe11e7-8b1f-4e5d-8b6c-10f127dee5cc tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:39:36.454331 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-affe11e7-8b1f-4e5d-8b6c-10f127dee5cc tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.083210 Nov 09 20:39:36.455439 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1220/2409] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:39:36 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:39:37.280982 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 09 20:39:37.281639 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: Tue Nov 9 20:39:37 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 09 20:39:37.470536 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-63cced2e-f60d-4473-bd73-90b748739213 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:39:37.471159 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-63cced2e-f60d-4473-bd73-90b748739213 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:39:37.477319 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-63cced2e-f60d-4473-bd73-90b748739213 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:39:37.477758 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-63cced2e-f60d-4473-bd73-90b748739213 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:39:37.478509 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-63cced2e-f60d-4473-bd73-90b748739213 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:39:37.478935 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-63cced2e-f60d-4473-bd73-90b748739213 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:39:37.538539 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-63cced2e-f60d-4473-bd73-90b748739213 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:39:37.546090 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-63cced2e-f60d-4473-bd73-90b748739213 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.079086 Nov 09 20:39:37.546658 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1190/2410] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:39:37 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:39:38.562783 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-5536fc29-fada-4b5a-b05e-591361cc43b0 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:39:38.563322 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-5536fc29-fada-4b5a-b05e-591361cc43b0 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:39:38.569785 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-5536fc29-fada-4b5a-b05e-591361cc43b0 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:39:38.570229 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-5536fc29-fada-4b5a-b05e-591361cc43b0 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:39:38.570994 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-5536fc29-fada-4b5a-b05e-591361cc43b0 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:39:38.571422 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-5536fc29-fada-4b5a-b05e-591361cc43b0 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:39:38.630648 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-5536fc29-fada-4b5a-b05e-591361cc43b0 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:39:38.638257 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-5536fc29-fada-4b5a-b05e-591361cc43b0 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.079201 Nov 09 20:39:38.638812 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1221/2411] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:39:38 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:39:39.654815 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-0e770d34-5f0c-4dd5-8b03-055d139d6abe tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:39:39.655447 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-0e770d34-5f0c-4dd5-8b03-055d139d6abe tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:39:39.662531 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0e770d34-5f0c-4dd5-8b03-055d139d6abe tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:39:39.662981 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0e770d34-5f0c-4dd5-8b03-055d139d6abe tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:39:39.663747 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0e770d34-5f0c-4dd5-8b03-055d139d6abe tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:39:39.664182 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0e770d34-5f0c-4dd5-8b03-055d139d6abe tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:39:39.722784 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-0e770d34-5f0c-4dd5-8b03-055d139d6abe tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:39:39.730550 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-0e770d34-5f0c-4dd5-8b03-055d139d6abe tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.079466 Nov 09 20:39:39.731110 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1191/2412] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:39:39 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:39:40.746993 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-3b373449-7a50-40cc-823c-45ddf55ef403 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:39:40.747591 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-3b373449-7a50-40cc-823c-45ddf55ef403 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:39:40.754767 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-3b373449-7a50-40cc-823c-45ddf55ef403 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:39:40.755208 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-3b373449-7a50-40cc-823c-45ddf55ef403 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:39:40.755965 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-3b373449-7a50-40cc-823c-45ddf55ef403 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:39:40.756391 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-3b373449-7a50-40cc-823c-45ddf55ef403 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:39:40.813599 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-3b373449-7a50-40cc-823c-45ddf55ef403 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:39:40.821812 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-3b373449-7a50-40cc-823c-45ddf55ef403 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.078436 Nov 09 20:39:40.822358 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1222/2413] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:39:40 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:39:41.837959 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-3e3ca18c-5cc2-4081-b952-fbbba5b73ebd tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:39:41.838541 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-3e3ca18c-5cc2-4081-b952-fbbba5b73ebd tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:39:41.845068 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3e3ca18c-5cc2-4081-b952-fbbba5b73ebd tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:39:41.845632 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3e3ca18c-5cc2-4081-b952-fbbba5b73ebd tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:39:41.846390 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3e3ca18c-5cc2-4081-b952-fbbba5b73ebd tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:39:41.846814 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3e3ca18c-5cc2-4081-b952-fbbba5b73ebd tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:39:41.905888 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-3e3ca18c-5cc2-4081-b952-fbbba5b73ebd tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:39:41.914067 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-3e3ca18c-5cc2-4081-b952-fbbba5b73ebd tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.079772 Nov 09 20:39:41.914630 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1192/2414] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:39:41 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:39:42.930531 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-c24b2583-0745-4def-a355-b337f65cd16c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:39:42.931129 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-c24b2583-0745-4def-a355-b337f65cd16c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:39:42.937361 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c24b2583-0745-4def-a355-b337f65cd16c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:39:42.937796 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c24b2583-0745-4def-a355-b337f65cd16c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:39:42.938555 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c24b2583-0745-4def-a355-b337f65cd16c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:39:42.938990 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c24b2583-0745-4def-a355-b337f65cd16c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:39:43.003301 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-c24b2583-0745-4def-a355-b337f65cd16c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:39:43.011367 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-c24b2583-0745-4def-a355-b337f65cd16c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.084466 Nov 09 20:39:43.011957 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1223/2415] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:39:42 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:39:44.028612 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-b504869c-085b-4970-b70d-f6cb88f2359b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:39:44.029206 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-b504869c-085b-4970-b70d-f6cb88f2359b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:39:44.035928 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b504869c-085b-4970-b70d-f6cb88f2359b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:39:44.036367 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b504869c-085b-4970-b70d-f6cb88f2359b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:39:44.037142 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b504869c-085b-4970-b70d-f6cb88f2359b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:39:44.037569 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b504869c-085b-4970-b70d-f6cb88f2359b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:39:44.094952 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-b504869c-085b-4970-b70d-f6cb88f2359b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:39:44.103353 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-b504869c-085b-4970-b70d-f6cb88f2359b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.078407 Nov 09 20:39:44.103902 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1193/2416] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:39:44 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:39:45.120744 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-5d51aa52-34f1-4de3-bdc1-6548319fbeea tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:39:45.121349 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-5d51aa52-34f1-4de3-bdc1-6548319fbeea tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:39:45.128427 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-5d51aa52-34f1-4de3-bdc1-6548319fbeea tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:39:45.128884 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-5d51aa52-34f1-4de3-bdc1-6548319fbeea tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:39:45.129659 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-5d51aa52-34f1-4de3-bdc1-6548319fbeea tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:39:45.130094 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-5d51aa52-34f1-4de3-bdc1-6548319fbeea tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:39:45.189740 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-5d51aa52-34f1-4de3-bdc1-6548319fbeea tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:39:45.197428 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-5d51aa52-34f1-4de3-bdc1-6548319fbeea tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.080449 Nov 09 20:39:45.197991 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1224/2417] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:39:45 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:39:46.213823 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-f884c4ab-1085-447c-b415-1a4b186e8c2c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:39:46.214430 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-f884c4ab-1085-447c-b415-1a4b186e8c2c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:39:46.220618 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f884c4ab-1085-447c-b415-1a4b186e8c2c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:39:46.221244 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f884c4ab-1085-447c-b415-1a4b186e8c2c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:39:46.221867 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f884c4ab-1085-447c-b415-1a4b186e8c2c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:39:46.222299 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f884c4ab-1085-447c-b415-1a4b186e8c2c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:39:46.275429 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 09 20:39:46.276060 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: Tue Nov 9 20:39:46 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 09 20:39:46.283836 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-f884c4ab-1085-447c-b415-1a4b186e8c2c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:39:46.292469 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-f884c4ab-1085-447c-b415-1a4b186e8c2c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.082193 Nov 09 20:39:46.293308 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1194/2418] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:39:46 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:39:47.312273 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-17b8d0bd-fdc0-4b47-bcc7-3fe9fbfbde1d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:39:47.313217 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-17b8d0bd-fdc0-4b47-bcc7-3fe9fbfbde1d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:39:47.319947 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-17b8d0bd-fdc0-4b47-bcc7-3fe9fbfbde1d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:39:47.320444 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-17b8d0bd-fdc0-4b47-bcc7-3fe9fbfbde1d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:39:47.321219 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-17b8d0bd-fdc0-4b47-bcc7-3fe9fbfbde1d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:39:47.321650 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-17b8d0bd-fdc0-4b47-bcc7-3fe9fbfbde1d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:39:47.381473 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-17b8d0bd-fdc0-4b47-bcc7-3fe9fbfbde1d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:39:47.389097 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-17b8d0bd-fdc0-4b47-bcc7-3fe9fbfbde1d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.082042 Nov 09 20:39:47.389657 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1225/2419] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:39:47 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:39:48.405844 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-d4dd2c89-3248-4d5a-a528-d1355a04f07c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:39:48.406477 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-d4dd2c89-3248-4d5a-a528-d1355a04f07c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:39:48.413247 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d4dd2c89-3248-4d5a-a528-d1355a04f07c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:39:48.413698 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d4dd2c89-3248-4d5a-a528-d1355a04f07c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:39:48.414457 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d4dd2c89-3248-4d5a-a528-d1355a04f07c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:39:48.414889 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d4dd2c89-3248-4d5a-a528-d1355a04f07c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:39:48.472886 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-d4dd2c89-3248-4d5a-a528-d1355a04f07c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:39:48.480470 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-d4dd2c89-3248-4d5a-a528-d1355a04f07c tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.078254 Nov 09 20:39:48.481029 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1195/2420] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:39:48 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:39:49.497817 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-b7cba5ef-0c10-4d66-9094-65345a708cbb tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:39:49.498444 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-b7cba5ef-0c10-4d66-9094-65345a708cbb tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:39:49.505563 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b7cba5ef-0c10-4d66-9094-65345a708cbb tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:39:49.506012 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b7cba5ef-0c10-4d66-9094-65345a708cbb tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:39:49.506784 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b7cba5ef-0c10-4d66-9094-65345a708cbb tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:39:49.507219 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b7cba5ef-0c10-4d66-9094-65345a708cbb tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:39:49.569101 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-b7cba5ef-0c10-4d66-9094-65345a708cbb tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:39:49.576831 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-b7cba5ef-0c10-4d66-9094-65345a708cbb tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.082723 Nov 09 20:39:49.577392 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1226/2421] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:39:49 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:39:50.593816 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-f8e792b6-cb6d-4665-a9dd-1d922172bdbf tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:39:50.594419 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-f8e792b6-cb6d-4665-a9dd-1d922172bdbf tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:39:50.600439 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f8e792b6-cb6d-4665-a9dd-1d922172bdbf tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:39:50.600889 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f8e792b6-cb6d-4665-a9dd-1d922172bdbf tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:39:50.601655 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f8e792b6-cb6d-4665-a9dd-1d922172bdbf tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:39:50.602088 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f8e792b6-cb6d-4665-a9dd-1d922172bdbf tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:39:50.660769 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-f8e792b6-cb6d-4665-a9dd-1d922172bdbf tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:39:50.668486 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-f8e792b6-cb6d-4665-a9dd-1d922172bdbf tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.078294 Nov 09 20:39:50.669049 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1196/2422] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:39:50 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:39:51.685000 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-4850cb27-7a62-4661-b77f-0cd645da1b9d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:39:51.685622 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-4850cb27-7a62-4661-b77f-0cd645da1b9d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:39:51.691908 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-4850cb27-7a62-4661-b77f-0cd645da1b9d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:39:51.692351 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-4850cb27-7a62-4661-b77f-0cd645da1b9d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:39:51.693138 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-4850cb27-7a62-4661-b77f-0cd645da1b9d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:39:51.693564 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-4850cb27-7a62-4661-b77f-0cd645da1b9d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:39:51.751626 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-4850cb27-7a62-4661-b77f-0cd645da1b9d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:39:51.759749 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-4850cb27-7a62-4661-b77f-0cd645da1b9d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.078390 Nov 09 20:39:51.760295 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1227/2423] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:39:51 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:39:52.776511 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-6ed1ee6f-a300-404f-a731-7bf662a0073f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:39:52.777110 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-6ed1ee6f-a300-404f-a731-7bf662a0073f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:39:52.783474 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6ed1ee6f-a300-404f-a731-7bf662a0073f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:39:52.783918 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6ed1ee6f-a300-404f-a731-7bf662a0073f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:39:52.784708 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6ed1ee6f-a300-404f-a731-7bf662a0073f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:39:52.785309 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6ed1ee6f-a300-404f-a731-7bf662a0073f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:39:52.844427 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-6ed1ee6f-a300-404f-a731-7bf662a0073f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:39:52.852741 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-6ed1ee6f-a300-404f-a731-7bf662a0073f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.079756 Nov 09 20:39:52.853296 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1197/2424] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:39:52 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:39:53.869902 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-f3808d62-cc9e-4aa3-9760-ecdada0865fd tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:39:53.870497 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-f3808d62-cc9e-4aa3-9760-ecdada0865fd tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:39:53.876748 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f3808d62-cc9e-4aa3-9760-ecdada0865fd tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:39:53.877192 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f3808d62-cc9e-4aa3-9760-ecdada0865fd tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:39:53.878885 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f3808d62-cc9e-4aa3-9760-ecdada0865fd tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:39:53.879314 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f3808d62-cc9e-4aa3-9760-ecdada0865fd tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:39:53.938032 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-f3808d62-cc9e-4aa3-9760-ecdada0865fd tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:39:53.946508 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-f3808d62-cc9e-4aa3-9760-ecdada0865fd tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.080229 Nov 09 20:39:53.947062 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1228/2425] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:39:53 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:39:54.962805 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-fde588fa-237b-4a86-9756-9bf7683e9b81 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:39:54.963391 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-fde588fa-237b-4a86-9756-9bf7683e9b81 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:39:54.969551 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fde588fa-237b-4a86-9756-9bf7683e9b81 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:39:54.969990 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fde588fa-237b-4a86-9756-9bf7683e9b81 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:39:54.970738 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fde588fa-237b-4a86-9756-9bf7683e9b81 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:39:54.971161 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fde588fa-237b-4a86-9756-9bf7683e9b81 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:39:55.031063 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-fde588fa-237b-4a86-9756-9bf7683e9b81 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:39:55.039453 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-fde588fa-237b-4a86-9756-9bf7683e9b81 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.080333 Nov 09 20:39:55.040029 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1198/2426] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:39:54 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:39:56.056032 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-14c55a19-fe9e-4943-bfea-5c459d8ecbad tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:39:56.056663 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-14c55a19-fe9e-4943-bfea-5c459d8ecbad tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:39:56.062793 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-14c55a19-fe9e-4943-bfea-5c459d8ecbad tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:39:56.063243 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-14c55a19-fe9e-4943-bfea-5c459d8ecbad tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:39:56.064001 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-14c55a19-fe9e-4943-bfea-5c459d8ecbad tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:39:56.064450 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-14c55a19-fe9e-4943-bfea-5c459d8ecbad tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:39:56.127624 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-14c55a19-fe9e-4943-bfea-5c459d8ecbad tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:39:56.136144 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-14c55a19-fe9e-4943-bfea-5c459d8ecbad tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.083825 Nov 09 20:39:56.136737 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1229/2427] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:39:56 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:39:57.153895 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-acfab4f2-e6ce-4671-aace-c4db089ca84f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:39:57.154485 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-acfab4f2-e6ce-4671-aace-c4db089ca84f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:39:57.161029 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-acfab4f2-e6ce-4671-aace-c4db089ca84f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:39:57.161472 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-acfab4f2-e6ce-4671-aace-c4db089ca84f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:39:57.162274 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-acfab4f2-e6ce-4671-aace-c4db089ca84f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:39:57.162739 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-acfab4f2-e6ce-4671-aace-c4db089ca84f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:39:57.219761 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-acfab4f2-e6ce-4671-aace-c4db089ca84f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:39:57.228230 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-acfab4f2-e6ce-4671-aace-c4db089ca84f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.078237 Nov 09 20:39:57.228835 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1199/2428] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:39:57 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:39:58.244819 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-0cdf2b63-7a0c-48f0-ac3d-2bcff47bd2f7 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:39:58.245453 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-0cdf2b63-7a0c-48f0-ac3d-2bcff47bd2f7 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:39:58.251580 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-0cdf2b63-7a0c-48f0-ac3d-2bcff47bd2f7 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:39:58.252023 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-0cdf2b63-7a0c-48f0-ac3d-2bcff47bd2f7 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:39:58.252810 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-0cdf2b63-7a0c-48f0-ac3d-2bcff47bd2f7 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:39:58.253633 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-0cdf2b63-7a0c-48f0-ac3d-2bcff47bd2f7 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:39:58.311773 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-0cdf2b63-7a0c-48f0-ac3d-2bcff47bd2f7 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:39:58.319676 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-0cdf2b63-7a0c-48f0-ac3d-2bcff47bd2f7 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.078511 Nov 09 20:39:58.320224 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1230/2429] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:39:58 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:39:59.335525 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-904b6a58-a635-46e0-aae1-c7adc32806c7 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:39:59.336122 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-904b6a58-a635-46e0-aae1-c7adc32806c7 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:39:59.342302 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-904b6a58-a635-46e0-aae1-c7adc32806c7 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:39:59.342742 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-904b6a58-a635-46e0-aae1-c7adc32806c7 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:39:59.343495 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-904b6a58-a635-46e0-aae1-c7adc32806c7 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:39:59.343920 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-904b6a58-a635-46e0-aae1-c7adc32806c7 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:39:59.401975 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-904b6a58-a635-46e0-aae1-c7adc32806c7 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:39:59.409480 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-904b6a58-a635-46e0-aae1-c7adc32806c7 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.077665 Nov 09 20:39:59.410068 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1200/2430] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:39:59 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:40:00.426489 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-1c596d01-9537-499b-ad0f-64e25052c7e4 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:40:00.427102 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-1c596d01-9537-499b-ad0f-64e25052c7e4 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:40:00.433344 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-1c596d01-9537-499b-ad0f-64e25052c7e4 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:40:00.433789 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-1c596d01-9537-499b-ad0f-64e25052c7e4 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:40:00.434559 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-1c596d01-9537-499b-ad0f-64e25052c7e4 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:40:00.434993 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-1c596d01-9537-499b-ad0f-64e25052c7e4 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:40:00.493751 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-1c596d01-9537-499b-ad0f-64e25052c7e4 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:40:00.501362 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-1c596d01-9537-499b-ad0f-64e25052c7e4 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.078642 Nov 09 20:40:00.501917 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1231/2431] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:40:00 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:40:01.518436 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-375eac95-d069-4fd7-9b21-43ad52c1f6ab tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:40:01.519065 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-375eac95-d069-4fd7-9b21-43ad52c1f6ab tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:40:01.525917 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-375eac95-d069-4fd7-9b21-43ad52c1f6ab tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:40:01.526359 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-375eac95-d069-4fd7-9b21-43ad52c1f6ab tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:40:01.527116 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-375eac95-d069-4fd7-9b21-43ad52c1f6ab tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:40:01.527549 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-375eac95-d069-4fd7-9b21-43ad52c1f6ab tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:40:01.585430 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-375eac95-d069-4fd7-9b21-43ad52c1f6ab tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:40:01.592997 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-375eac95-d069-4fd7-9b21-43ad52c1f6ab tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.078198 Nov 09 20:40:01.593558 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1201/2432] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:40:01 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:40:02.609362 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-7393ce89-72ff-4fc6-a897-615c195dd05d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:40:02.609961 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-7393ce89-72ff-4fc6-a897-615c195dd05d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:40:02.616822 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-7393ce89-72ff-4fc6-a897-615c195dd05d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:40:02.617262 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-7393ce89-72ff-4fc6-a897-615c195dd05d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:40:02.618023 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-7393ce89-72ff-4fc6-a897-615c195dd05d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:40:02.618448 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-7393ce89-72ff-4fc6-a897-615c195dd05d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:40:02.679976 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-7393ce89-72ff-4fc6-a897-615c195dd05d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:40:02.687874 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-7393ce89-72ff-4fc6-a897-615c195dd05d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.082180 Nov 09 20:40:02.688460 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1232/2433] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:40:02 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:40:03.704831 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-3e389b36-8dcc-46d4-ba77-8f29380572e3 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:40:03.705458 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-3e389b36-8dcc-46d4-ba77-8f29380572e3 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:40:03.711757 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3e389b36-8dcc-46d4-ba77-8f29380572e3 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:40:03.712195 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3e389b36-8dcc-46d4-ba77-8f29380572e3 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:40:03.712994 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3e389b36-8dcc-46d4-ba77-8f29380572e3 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:40:03.713419 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3e389b36-8dcc-46d4-ba77-8f29380572e3 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:40:03.773033 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-3e389b36-8dcc-46d4-ba77-8f29380572e3 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:40:03.780720 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-3e389b36-8dcc-46d4-ba77-8f29380572e3 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.079548 Nov 09 20:40:03.781272 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1202/2434] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:40:03 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:40:04.797104 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-75063ead-0dec-4d73-830e-dd94b559d530 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:40:04.797646 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-75063ead-0dec-4d73-830e-dd94b559d530 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:40:04.803809 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-75063ead-0dec-4d73-830e-dd94b559d530 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:40:04.804245 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-75063ead-0dec-4d73-830e-dd94b559d530 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:40:04.805031 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-75063ead-0dec-4d73-830e-dd94b559d530 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:40:04.805466 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-75063ead-0dec-4d73-830e-dd94b559d530 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:40:04.863929 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-75063ead-0dec-4d73-830e-dd94b559d530 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:40:04.871713 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-75063ead-0dec-4d73-830e-dd94b559d530 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.078339 Nov 09 20:40:04.872264 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1233/2435] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:40:04 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:40:05.889312 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-78c3c7a3-e3b4-4984-a66d-1cabddf79d65 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:40:05.889925 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-78c3c7a3-e3b4-4984-a66d-1cabddf79d65 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:40:05.896655 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-78c3c7a3-e3b4-4984-a66d-1cabddf79d65 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:40:05.897103 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-78c3c7a3-e3b4-4984-a66d-1cabddf79d65 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:40:05.897986 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-78c3c7a3-e3b4-4984-a66d-1cabddf79d65 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:40:05.898416 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-78c3c7a3-e3b4-4984-a66d-1cabddf79d65 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:40:05.958243 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-78c3c7a3-e3b4-4984-a66d-1cabddf79d65 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:40:05.966246 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-78c3c7a3-e3b4-4984-a66d-1cabddf79d65 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.080654 Nov 09 20:40:05.966895 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1203/2436] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:40:05 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:40:06.983424 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-fb81ca77-430b-4850-872c-446188a20909 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:40:06.984030 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-fb81ca77-430b-4850-872c-446188a20909 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:40:06.990702 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-fb81ca77-430b-4850-872c-446188a20909 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:40:06.991145 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-fb81ca77-430b-4850-872c-446188a20909 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:40:06.991912 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-fb81ca77-430b-4850-872c-446188a20909 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:40:06.992345 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-fb81ca77-430b-4850-872c-446188a20909 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:40:07.050938 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-fb81ca77-430b-4850-872c-446188a20909 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:40:07.058859 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-fb81ca77-430b-4850-872c-446188a20909 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.079112 Nov 09 20:40:07.059421 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1234/2437] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:40:06 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:40:08.075951 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-18e6dcf7-5c4b-4830-961c-861307e1e574 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:40:08.076578 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-18e6dcf7-5c4b-4830-961c-861307e1e574 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:40:08.082886 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-18e6dcf7-5c4b-4830-961c-861307e1e574 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:40:08.083327 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-18e6dcf7-5c4b-4830-961c-861307e1e574 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:40:08.084090 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-18e6dcf7-5c4b-4830-961c-861307e1e574 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:40:08.084550 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-18e6dcf7-5c4b-4830-961c-861307e1e574 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:40:08.145408 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-18e6dcf7-5c4b-4830-961c-861307e1e574 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:40:08.152964 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-18e6dcf7-5c4b-4830-961c-861307e1e574 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.080669 Nov 09 20:40:08.153561 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1204/2438] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:40:08 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:40:09.171129 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-d64cc5cb-8938-4f67-9ef7-5aced5263efc tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:40:09.171837 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-d64cc5cb-8938-4f67-9ef7-5aced5263efc tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:40:09.178805 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d64cc5cb-8938-4f67-9ef7-5aced5263efc tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:40:09.179258 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d64cc5cb-8938-4f67-9ef7-5aced5263efc tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:40:09.180027 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d64cc5cb-8938-4f67-9ef7-5aced5263efc tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:40:09.180487 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d64cc5cb-8938-4f67-9ef7-5aced5263efc tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:40:09.241775 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-d64cc5cb-8938-4f67-9ef7-5aced5263efc tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:40:09.249448 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-d64cc5cb-8938-4f67-9ef7-5aced5263efc tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.081985 Nov 09 20:40:09.250004 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1235/2439] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:40:09 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:40:10.266693 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-5fc0845f-8d6a-4498-8ae3-54b459e53e6a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:40:10.267406 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-5fc0845f-8d6a-4498-8ae3-54b459e53e6a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:40:10.275253 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5fc0845f-8d6a-4498-8ae3-54b459e53e6a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:40:10.275691 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5fc0845f-8d6a-4498-8ae3-54b459e53e6a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:40:10.276471 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5fc0845f-8d6a-4498-8ae3-54b459e53e6a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:40:10.276903 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5fc0845f-8d6a-4498-8ae3-54b459e53e6a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:40:10.336244 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-5fc0845f-8d6a-4498-8ae3-54b459e53e6a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:40:10.343919 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-5fc0845f-8d6a-4498-8ae3-54b459e53e6a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.080842 Nov 09 20:40:10.344490 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1205/2440] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:40:10 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:40:11.360432 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-9f1e1431-7611-4c3b-9f5a-52761b62b656 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:40:11.361048 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-9f1e1431-7611-4c3b-9f5a-52761b62b656 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:40:11.367587 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-9f1e1431-7611-4c3b-9f5a-52761b62b656 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:40:11.368034 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-9f1e1431-7611-4c3b-9f5a-52761b62b656 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:40:11.368830 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-9f1e1431-7611-4c3b-9f5a-52761b62b656 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:40:11.369264 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-9f1e1431-7611-4c3b-9f5a-52761b62b656 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:40:11.430262 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-9f1e1431-7611-4c3b-9f5a-52761b62b656 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:40:11.437814 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-9f1e1431-7611-4c3b-9f5a-52761b62b656 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.081090 Nov 09 20:40:11.438375 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1236/2441] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:40:11 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:40:12.454546 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-0e4cc393-d200-4866-a887-1f5a0b6cc3c4 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:40:12.455152 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-0e4cc393-d200-4866-a887-1f5a0b6cc3c4 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:40:12.461438 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0e4cc393-d200-4866-a887-1f5a0b6cc3c4 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:40:12.462028 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0e4cc393-d200-4866-a887-1f5a0b6cc3c4 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:40:12.462794 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0e4cc393-d200-4866-a887-1f5a0b6cc3c4 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:40:12.463224 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0e4cc393-d200-4866-a887-1f5a0b6cc3c4 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:40:12.522872 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-0e4cc393-d200-4866-a887-1f5a0b6cc3c4 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:40:12.530515 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-0e4cc393-d200-4866-a887-1f5a0b6cc3c4 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.079736 Nov 09 20:40:12.531068 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1206/2442] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:40:12 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:40:13.546871 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-6714d91a-34bf-4c6b-b8e5-7ee3d9ecfe11 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:40:13.547405 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-6714d91a-34bf-4c6b-b8e5-7ee3d9ecfe11 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:40:13.554183 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6714d91a-34bf-4c6b-b8e5-7ee3d9ecfe11 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:40:13.554621 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6714d91a-34bf-4c6b-b8e5-7ee3d9ecfe11 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:40:13.555376 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6714d91a-34bf-4c6b-b8e5-7ee3d9ecfe11 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:40:13.555803 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6714d91a-34bf-4c6b-b8e5-7ee3d9ecfe11 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:40:13.614696 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-6714d91a-34bf-4c6b-b8e5-7ee3d9ecfe11 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:40:13.622301 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-6714d91a-34bf-4c6b-b8e5-7ee3d9ecfe11 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.079126 Nov 09 20:40:13.622860 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1237/2443] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:40:13 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:40:14.639033 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-32d1db05-5400-4f27-b559-2e80a58e62b5 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:40:14.639629 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-32d1db05-5400-4f27-b559-2e80a58e62b5 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:40:14.645960 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-32d1db05-5400-4f27-b559-2e80a58e62b5 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:40:14.646398 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-32d1db05-5400-4f27-b559-2e80a58e62b5 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:40:14.647155 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-32d1db05-5400-4f27-b559-2e80a58e62b5 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:40:14.647580 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-32d1db05-5400-4f27-b559-2e80a58e62b5 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:40:14.705861 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-32d1db05-5400-4f27-b559-2e80a58e62b5 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:40:14.713680 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-32d1db05-5400-4f27-b559-2e80a58e62b5 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.078265 Nov 09 20:40:14.714238 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1207/2444] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:40:14 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:40:15.730260 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-f92ea475-b060-415d-9155-7ac7e3397b48 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:40:15.730839 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-f92ea475-b060-415d-9155-7ac7e3397b48 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:40:15.736718 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f92ea475-b060-415d-9155-7ac7e3397b48 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:40:15.737161 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f92ea475-b060-415d-9155-7ac7e3397b48 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:40:15.737914 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f92ea475-b060-415d-9155-7ac7e3397b48 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:40:15.738335 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f92ea475-b060-415d-9155-7ac7e3397b48 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:40:15.800024 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-f92ea475-b060-415d-9155-7ac7e3397b48 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:40:15.807858 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-f92ea475-b060-415d-9155-7ac7e3397b48 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.081291 Nov 09 20:40:15.808428 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1238/2445] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:40:15 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 20:40:16.823992 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-e9e87d9f-1617-43ba-a06c-455852c9e0fb tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:40:16.824547 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-e9e87d9f-1617-43ba-a06c-455852c9e0fb tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:40:16.830687 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e9e87d9f-1617-43ba-a06c-455852c9e0fb tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:40:16.831128 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e9e87d9f-1617-43ba-a06c-455852c9e0fb tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:40:16.831879 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e9e87d9f-1617-43ba-a06c-455852c9e0fb tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:40:16.832300 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e9e87d9f-1617-43ba-a06c-455852c9e0fb tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:40:16.891270 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-e9e87d9f-1617-43ba-a06c-455852c9e0fb tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:40:16.899659 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-e9e87d9f-1617-43ba-a06c-455852c9e0fb tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.079342 Nov 09 20:40:16.900216 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1208/2446] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:40:16 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:40:17.916755 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-d6522a22-00b4-4936-973e-7f54bba7798d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:40:17.917365 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-d6522a22-00b4-4936-973e-7f54bba7798d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:40:17.923605 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d6522a22-00b4-4936-973e-7f54bba7798d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:40:17.924052 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d6522a22-00b4-4936-973e-7f54bba7798d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:40:17.924844 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d6522a22-00b4-4936-973e-7f54bba7798d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:40:17.925279 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d6522a22-00b4-4936-973e-7f54bba7798d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:40:17.984037 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-d6522a22-00b4-4936-973e-7f54bba7798d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:40:17.991795 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-d6522a22-00b4-4936-973e-7f54bba7798d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.079540 Nov 09 20:40:17.992347 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1239/2447] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:40:17 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:40:19.009150 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-2e8b188f-4f4f-4bef-969e-34ee28c167f1 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:40:19.009815 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-2e8b188f-4f4f-4bef-969e-34ee28c167f1 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:40:19.016244 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2e8b188f-4f4f-4bef-969e-34ee28c167f1 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:40:19.016718 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2e8b188f-4f4f-4bef-969e-34ee28c167f1 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:40:19.017476 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2e8b188f-4f4f-4bef-969e-34ee28c167f1 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:40:19.017903 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2e8b188f-4f4f-4bef-969e-34ee28c167f1 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:40:19.076832 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-2e8b188f-4f4f-4bef-969e-34ee28c167f1 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:40:19.085573 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-2e8b188f-4f4f-4bef-969e-34ee28c167f1 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.080122 Nov 09 20:40:19.086130 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1209/2448] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:40:19 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:40:20.102721 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-a7489a96-2da0-438d-81a0-bfb10f5d7505 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:40:20.103349 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-a7489a96-2da0-438d-81a0-bfb10f5d7505 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:40:20.109566 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a7489a96-2da0-438d-81a0-bfb10f5d7505 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:40:20.110019 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a7489a96-2da0-438d-81a0-bfb10f5d7505 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:40:20.110789 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a7489a96-2da0-438d-81a0-bfb10f5d7505 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:40:20.111226 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a7489a96-2da0-438d-81a0-bfb10f5d7505 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:40:20.171821 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-a7489a96-2da0-438d-81a0-bfb10f5d7505 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:40:20.179470 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-a7489a96-2da0-438d-81a0-bfb10f5d7505 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.081267 Nov 09 20:40:20.180022 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1240/2449] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:40:20 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:40:21.196830 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-046f4505-ba5a-4627-bb5a-36f086c6b0df tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:40:21.197382 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-046f4505-ba5a-4627-bb5a-36f086c6b0df tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:40:21.203426 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-046f4505-ba5a-4627-bb5a-36f086c6b0df tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:40:21.203864 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-046f4505-ba5a-4627-bb5a-36f086c6b0df tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:40:21.204719 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-046f4505-ba5a-4627-bb5a-36f086c6b0df tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:40:21.205144 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-046f4505-ba5a-4627-bb5a-36f086c6b0df tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:40:21.266513 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-046f4505-ba5a-4627-bb5a-36f086c6b0df tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:40:21.278732 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-046f4505-ba5a-4627-bb5a-36f086c6b0df tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.086453 Nov 09 20:40:21.279289 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1210/2450] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:40:21 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:40:22.295994 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-d6c18f1a-5eb5-43a7-a756-7d02a779a9dc tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:40:22.296621 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-d6c18f1a-5eb5-43a7-a756-7d02a779a9dc tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:40:22.302959 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d6c18f1a-5eb5-43a7-a756-7d02a779a9dc tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:40:22.303452 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d6c18f1a-5eb5-43a7-a756-7d02a779a9dc tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:40:22.304220 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d6c18f1a-5eb5-43a7-a756-7d02a779a9dc tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:40:22.304706 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d6c18f1a-5eb5-43a7-a756-7d02a779a9dc tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:40:22.367442 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-d6c18f1a-5eb5-43a7-a756-7d02a779a9dc tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:40:22.375051 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-d6c18f1a-5eb5-43a7-a756-7d02a779a9dc tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.082733 Nov 09 20:40:22.375602 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1241/2451] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:40:22 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:40:23.392333 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-5b26cc3b-4bee-48bd-a908-e8de290eb24a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:40:23.392961 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-5b26cc3b-4bee-48bd-a908-e8de290eb24a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:40:23.399331 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5b26cc3b-4bee-48bd-a908-e8de290eb24a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:40:23.399769 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5b26cc3b-4bee-48bd-a908-e8de290eb24a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:40:23.400564 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5b26cc3b-4bee-48bd-a908-e8de290eb24a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:40:23.400991 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5b26cc3b-4bee-48bd-a908-e8de290eb24a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:40:23.459243 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-5b26cc3b-4bee-48bd-a908-e8de290eb24a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:40:23.466905 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-5b26cc3b-4bee-48bd-a908-e8de290eb24a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.078266 Nov 09 20:40:23.467465 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1211/2452] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:40:23 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:40:24.483711 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-5117e3e0-3ecd-4ed3-bdd7-832090f5904a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:40:24.484313 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-5117e3e0-3ecd-4ed3-bdd7-832090f5904a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:40:24.491171 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-5117e3e0-3ecd-4ed3-bdd7-832090f5904a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:40:24.491594 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-5117e3e0-3ecd-4ed3-bdd7-832090f5904a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:40:24.492353 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-5117e3e0-3ecd-4ed3-bdd7-832090f5904a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:40:24.492805 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-5117e3e0-3ecd-4ed3-bdd7-832090f5904a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:40:24.550226 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-5117e3e0-3ecd-4ed3-bdd7-832090f5904a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:40:24.558563 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-5117e3e0-3ecd-4ed3-bdd7-832090f5904a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.078488 Nov 09 20:40:24.559125 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1242/2453] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:40:24 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:40:25.575587 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-77a67642-b62e-4a31-b7ab-6b8ee3c87981 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:40:25.576222 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-77a67642-b62e-4a31-b7ab-6b8ee3c87981 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:40:25.582307 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-77a67642-b62e-4a31-b7ab-6b8ee3c87981 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:40:25.582753 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-77a67642-b62e-4a31-b7ab-6b8ee3c87981 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:40:25.583518 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-77a67642-b62e-4a31-b7ab-6b8ee3c87981 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:40:25.583949 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-77a67642-b62e-4a31-b7ab-6b8ee3c87981 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:40:25.642959 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-77a67642-b62e-4a31-b7ab-6b8ee3c87981 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:40:25.650697 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-77a67642-b62e-4a31-b7ab-6b8ee3c87981 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.078926 Nov 09 20:40:25.651261 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1212/2454] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:40:25 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:40:26.666815 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-66fa1f5c-1b45-43ae-859e-a1848b5427a6 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:40:26.667425 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-66fa1f5c-1b45-43ae-859e-a1848b5427a6 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:40:26.673837 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-66fa1f5c-1b45-43ae-859e-a1848b5427a6 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:40:26.674276 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-66fa1f5c-1b45-43ae-859e-a1848b5427a6 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:40:26.675034 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-66fa1f5c-1b45-43ae-859e-a1848b5427a6 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:40:26.675456 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-66fa1f5c-1b45-43ae-859e-a1848b5427a6 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:40:26.735960 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-66fa1f5c-1b45-43ae-859e-a1848b5427a6 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:40:26.743759 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-66fa1f5c-1b45-43ae-859e-a1848b5427a6 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.080568 Nov 09 20:40:26.744308 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1243/2455] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:40:26 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:40:27.760342 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-8e1d2184-cfb5-4b45-b8d4-848fb691e0af tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:40:27.760991 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-8e1d2184-cfb5-4b45-b8d4-848fb691e0af tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:40:27.766674 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8e1d2184-cfb5-4b45-b8d4-848fb691e0af tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:40:27.767127 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8e1d2184-cfb5-4b45-b8d4-848fb691e0af tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:40:27.767896 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8e1d2184-cfb5-4b45-b8d4-848fb691e0af tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:40:27.768329 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8e1d2184-cfb5-4b45-b8d4-848fb691e0af tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:40:27.826885 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-8e1d2184-cfb5-4b45-b8d4-848fb691e0af tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:40:27.835174 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-8e1d2184-cfb5-4b45-b8d4-848fb691e0af tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.078690 Nov 09 20:40:27.835735 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1213/2456] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:40:27 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:40:28.851465 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-0367da0e-d7ae-4aff-8b1d-25750de9100e tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:40:28.852060 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-0367da0e-d7ae-4aff-8b1d-25750de9100e tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:40:28.858289 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-0367da0e-d7ae-4aff-8b1d-25750de9100e tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:40:28.858725 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-0367da0e-d7ae-4aff-8b1d-25750de9100e tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:40:28.859482 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-0367da0e-d7ae-4aff-8b1d-25750de9100e tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:40:28.859908 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-0367da0e-d7ae-4aff-8b1d-25750de9100e tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:40:28.922161 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-0367da0e-d7ae-4aff-8b1d-25750de9100e tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:40:28.930564 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-0367da0e-d7ae-4aff-8b1d-25750de9100e tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.083500 Nov 09 20:40:28.931115 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1244/2457] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:40:28 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:40:29.947282 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-9fa3ac21-e239-48e4-aa24-8bdd4628165f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:40:29.947871 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-9fa3ac21-e239-48e4-aa24-8bdd4628165f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:40:29.954071 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9fa3ac21-e239-48e4-aa24-8bdd4628165f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:40:29.954513 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9fa3ac21-e239-48e4-aa24-8bdd4628165f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:40:29.955273 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9fa3ac21-e239-48e4-aa24-8bdd4628165f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:40:29.955701 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9fa3ac21-e239-48e4-aa24-8bdd4628165f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:40:30.014533 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-9fa3ac21-e239-48e4-aa24-8bdd4628165f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:40:30.022321 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-9fa3ac21-e239-48e4-aa24-8bdd4628165f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.079285 Nov 09 20:40:30.022911 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1214/2458] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:40:29 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:40:31.039057 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-f2daecd3-d47f-40ac-ac2b-5588ec09aefb tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:40:31.039658 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-f2daecd3-d47f-40ac-ac2b-5588ec09aefb tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:40:31.045827 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f2daecd3-d47f-40ac-ac2b-5588ec09aefb tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:40:31.046270 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f2daecd3-d47f-40ac-ac2b-5588ec09aefb tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:40:31.047030 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f2daecd3-d47f-40ac-ac2b-5588ec09aefb tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:40:31.047457 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f2daecd3-d47f-40ac-ac2b-5588ec09aefb tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:40:31.105830 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-f2daecd3-d47f-40ac-ac2b-5588ec09aefb tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:40:31.113323 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-f2daecd3-d47f-40ac-ac2b-5588ec09aefb tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.078276 Nov 09 20:40:31.113876 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1245/2459] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:40:31 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:40:32.130201 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-fa8ffb11-0c23-46cc-a315-d86fb11f8cb5 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:40:32.130880 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-fa8ffb11-0c23-46cc-a315-d86fb11f8cb5 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:40:32.137133 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fa8ffb11-0c23-46cc-a315-d86fb11f8cb5 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:40:32.137577 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fa8ffb11-0c23-46cc-a315-d86fb11f8cb5 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:40:32.138342 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fa8ffb11-0c23-46cc-a315-d86fb11f8cb5 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:40:32.138772 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-fa8ffb11-0c23-46cc-a315-d86fb11f8cb5 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:40:32.198278 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-fa8ffb11-0c23-46cc-a315-d86fb11f8cb5 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:40:32.205918 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-fa8ffb11-0c23-46cc-a315-d86fb11f8cb5 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.079623 Nov 09 20:40:32.206470 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1215/2460] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:40:32 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:40:33.222529 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-922d6ccc-98ef-4525-a11b-0e6e4e36b65e tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:40:33.223123 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-922d6ccc-98ef-4525-a11b-0e6e4e36b65e tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:40:33.229395 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-922d6ccc-98ef-4525-a11b-0e6e4e36b65e tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:40:33.229839 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-922d6ccc-98ef-4525-a11b-0e6e4e36b65e tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:40:33.230601 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-922d6ccc-98ef-4525-a11b-0e6e4e36b65e tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:40:33.231030 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-922d6ccc-98ef-4525-a11b-0e6e4e36b65e tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:40:33.290726 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-922d6ccc-98ef-4525-a11b-0e6e4e36b65e tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:40:33.298442 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-922d6ccc-98ef-4525-a11b-0e6e4e36b65e tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.079640 Nov 09 20:40:33.299002 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1246/2461] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:40:33 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:40:34.315069 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-d9835c85-b51d-4192-a242-e5a247a58ddc tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:40:34.315960 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-d9835c85-b51d-4192-a242-e5a247a58ddc tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:40:34.325181 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d9835c85-b51d-4192-a242-e5a247a58ddc tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:40:34.325711 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d9835c85-b51d-4192-a242-e5a247a58ddc tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:40:34.326491 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d9835c85-b51d-4192-a242-e5a247a58ddc tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:40:34.326927 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-d9835c85-b51d-4192-a242-e5a247a58ddc tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:40:34.386012 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-d9835c85-b51d-4192-a242-e5a247a58ddc tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:40:34.393700 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-d9835c85-b51d-4192-a242-e5a247a58ddc tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.082974 Nov 09 20:40:34.394261 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1216/2462] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:40:34 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:40:35.410728 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-cab4bb72-1ce8-4ffd-9792-a5fbe2de26f4 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:40:35.411320 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-cab4bb72-1ce8-4ffd-9792-a5fbe2de26f4 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:40:35.417961 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-cab4bb72-1ce8-4ffd-9792-a5fbe2de26f4 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:40:35.418400 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-cab4bb72-1ce8-4ffd-9792-a5fbe2de26f4 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:40:35.419156 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-cab4bb72-1ce8-4ffd-9792-a5fbe2de26f4 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:40:35.419580 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-cab4bb72-1ce8-4ffd-9792-a5fbe2de26f4 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:40:35.480651 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-cab4bb72-1ce8-4ffd-9792-a5fbe2de26f4 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:40:35.488273 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-cab4bb72-1ce8-4ffd-9792-a5fbe2de26f4 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.081232 Nov 09 20:40:35.488861 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1247/2463] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:40:35 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:40:36.505689 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-deaa7861-97a1-44b8-bd07-a4254f03dfa8 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:40:36.506323 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-deaa7861-97a1-44b8-bd07-a4254f03dfa8 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:40:36.513067 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-deaa7861-97a1-44b8-bd07-a4254f03dfa8 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:40:36.513541 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-deaa7861-97a1-44b8-bd07-a4254f03dfa8 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:40:36.514310 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-deaa7861-97a1-44b8-bd07-a4254f03dfa8 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:40:36.514740 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-deaa7861-97a1-44b8-bd07-a4254f03dfa8 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:40:36.575265 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-deaa7861-97a1-44b8-bd07-a4254f03dfa8 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:40:36.583015 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-deaa7861-97a1-44b8-bd07-a4254f03dfa8 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.081270 Nov 09 20:40:36.583575 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1217/2464] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:40:36 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:40:37.599570 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-2c96ac46-e49f-4ae6-8836-08ee782bf85b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:40:37.600176 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-2c96ac46-e49f-4ae6-8836-08ee782bf85b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:40:37.606967 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-2c96ac46-e49f-4ae6-8836-08ee782bf85b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:40:37.607413 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-2c96ac46-e49f-4ae6-8836-08ee782bf85b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:40:37.608174 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-2c96ac46-e49f-4ae6-8836-08ee782bf85b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:40:37.608631 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-2c96ac46-e49f-4ae6-8836-08ee782bf85b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:40:37.671803 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-2c96ac46-e49f-4ae6-8836-08ee782bf85b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:40:37.679648 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-2c96ac46-e49f-4ae6-8836-08ee782bf85b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.083557 Nov 09 20:40:37.680211 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1248/2465] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:40:37 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:40:38.696656 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-f08b47da-06a3-44dd-9975-06c931f427fb tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:40:38.697276 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-f08b47da-06a3-44dd-9975-06c931f427fb tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:40:38.703438 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f08b47da-06a3-44dd-9975-06c931f427fb tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:40:38.703882 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f08b47da-06a3-44dd-9975-06c931f427fb tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:40:38.704665 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f08b47da-06a3-44dd-9975-06c931f427fb tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:40:38.705088 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f08b47da-06a3-44dd-9975-06c931f427fb tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:40:38.763188 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-f08b47da-06a3-44dd-9975-06c931f427fb tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:40:38.770773 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-f08b47da-06a3-44dd-9975-06c931f427fb tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.078541 Nov 09 20:40:38.771322 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1218/2466] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:40:38 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:40:39.787967 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-6c5054b1-5054-42b4-9ac7-5845d959b81b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:40:39.789469 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-6c5054b1-5054-42b4-9ac7-5845d959b81b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:40:39.795791 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6c5054b1-5054-42b4-9ac7-5845d959b81b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:40:39.796235 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6c5054b1-5054-42b4-9ac7-5845d959b81b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:40:39.797039 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6c5054b1-5054-42b4-9ac7-5845d959b81b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:40:39.797471 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6c5054b1-5054-42b4-9ac7-5845d959b81b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:40:39.858172 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-6c5054b1-5054-42b4-9ac7-5845d959b81b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:40:39.865801 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-6c5054b1-5054-42b4-9ac7-5845d959b81b tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.081478 Nov 09 20:40:39.866352 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1249/2467] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:40:39 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:40:40.882508 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-16ed42e9-6dae-42d3-9c7e-2c9c068e463f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:40:40.883122 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-16ed42e9-6dae-42d3-9c7e-2c9c068e463f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:40:40.889786 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-16ed42e9-6dae-42d3-9c7e-2c9c068e463f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:40:40.890211 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-16ed42e9-6dae-42d3-9c7e-2c9c068e463f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:40:40.890981 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-16ed42e9-6dae-42d3-9c7e-2c9c068e463f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:40:40.891496 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-16ed42e9-6dae-42d3-9c7e-2c9c068e463f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:40:40.950123 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-16ed42e9-6dae-42d3-9c7e-2c9c068e463f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:40:40.957848 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-16ed42e9-6dae-42d3-9c7e-2c9c068e463f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.079316 Nov 09 20:40:40.958407 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1219/2468] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:40:40 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:40:41.974219 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-04fa092c-7902-46ed-bb00-269790ee4339 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:40:41.974806 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-04fa092c-7902-46ed-bb00-269790ee4339 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:40:41.980961 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-04fa092c-7902-46ed-bb00-269790ee4339 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:40:41.981403 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-04fa092c-7902-46ed-bb00-269790ee4339 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:40:41.982157 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-04fa092c-7902-46ed-bb00-269790ee4339 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:40:41.982580 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-04fa092c-7902-46ed-bb00-269790ee4339 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:40:42.044725 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-04fa092c-7902-46ed-bb00-269790ee4339 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:40:42.052236 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-04fa092c-7902-46ed-bb00-269790ee4339 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.081675 Nov 09 20:40:42.052827 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1250/2469] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:40:41 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:40:43.069071 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-bcdee89e-533c-43bb-917b-675eb142c04d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:40:43.070280 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-bcdee89e-533c-43bb-917b-675eb142c04d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:40:43.076583 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bcdee89e-533c-43bb-917b-675eb142c04d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:40:43.077026 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bcdee89e-533c-43bb-917b-675eb142c04d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:40:43.077803 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bcdee89e-533c-43bb-917b-675eb142c04d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:40:43.078226 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bcdee89e-533c-43bb-917b-675eb142c04d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:40:43.136723 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-bcdee89e-533c-43bb-917b-675eb142c04d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:40:43.144290 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-bcdee89e-533c-43bb-917b-675eb142c04d tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.078875 Nov 09 20:40:43.144875 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1220/2470] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:40:43 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:40:44.161813 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-406a9e1b-134d-4d02-b8ff-45ccc1e19d6e tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:40:44.162403 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-406a9e1b-134d-4d02-b8ff-45ccc1e19d6e tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:40:44.169947 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-406a9e1b-134d-4d02-b8ff-45ccc1e19d6e tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:40:44.170390 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-406a9e1b-134d-4d02-b8ff-45ccc1e19d6e tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:40:44.171151 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-406a9e1b-134d-4d02-b8ff-45ccc1e19d6e tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:40:44.171583 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-406a9e1b-134d-4d02-b8ff-45ccc1e19d6e tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:40:44.230594 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-406a9e1b-134d-4d02-b8ff-45ccc1e19d6e tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:40:44.238108 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-406a9e1b-134d-4d02-b8ff-45ccc1e19d6e tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.080378 Nov 09 20:40:44.238670 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1251/2471] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:40:44 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:40:45.254701 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-36d94382-1781-45be-9d4d-eeccae3acf01 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:40:45.255296 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-36d94382-1781-45be-9d4d-eeccae3acf01 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:40:45.261929 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-36d94382-1781-45be-9d4d-eeccae3acf01 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:40:45.262366 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-36d94382-1781-45be-9d4d-eeccae3acf01 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:40:45.263156 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-36d94382-1781-45be-9d4d-eeccae3acf01 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:40:45.263580 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-36d94382-1781-45be-9d4d-eeccae3acf01 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:40:45.322531 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-36d94382-1781-45be-9d4d-eeccae3acf01 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:40:45.330067 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-36d94382-1781-45be-9d4d-eeccae3acf01 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.079283 Nov 09 20:40:45.330621 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1221/2472] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:40:45 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:40:46.346716 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-09037a54-1759-42fb-ab99-141f073c6b1a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:40:46.347344 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-09037a54-1759-42fb-ab99-141f073c6b1a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:40:46.353363 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-09037a54-1759-42fb-ab99-141f073c6b1a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:40:46.353810 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-09037a54-1759-42fb-ab99-141f073c6b1a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:40:46.354569 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-09037a54-1759-42fb-ab99-141f073c6b1a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:40:46.354998 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-09037a54-1759-42fb-ab99-141f073c6b1a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:40:46.414662 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-09037a54-1759-42fb-ab99-141f073c6b1a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:40:46.422268 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-09037a54-1759-42fb-ab99-141f073c6b1a tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.079357 Nov 09 20:40:46.422819 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1252/2473] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:40:46 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:40:47.438653 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-cbbc165e-7533-438c-98fc-eb9c3a0072de tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:40:47.439259 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-cbbc165e-7533-438c-98fc-eb9c3a0072de tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:40:47.446096 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cbbc165e-7533-438c-98fc-eb9c3a0072de tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:40:47.446540 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cbbc165e-7533-438c-98fc-eb9c3a0072de tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:40:47.447304 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cbbc165e-7533-438c-98fc-eb9c3a0072de tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:40:47.447737 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cbbc165e-7533-438c-98fc-eb9c3a0072de tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:40:47.505015 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-cbbc165e-7533-438c-98fc-eb9c3a0072de tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:40:47.513169 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-cbbc165e-7533-438c-98fc-eb9c3a0072de tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.078151 Nov 09 20:40:47.513735 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1222/2474] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:40:47 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:40:48.530105 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-cb34d1ec-ced2-4ed9-816c-9ce4f848abcf tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:40:48.530704 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-cb34d1ec-ced2-4ed9-816c-9ce4f848abcf tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:40:48.536910 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-cb34d1ec-ced2-4ed9-816c-9ce4f848abcf tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:40:48.537293 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-cb34d1ec-ced2-4ed9-816c-9ce4f848abcf tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:40:48.538044 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-cb34d1ec-ced2-4ed9-816c-9ce4f848abcf tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:40:48.538469 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-cb34d1ec-ced2-4ed9-816c-9ce4f848abcf tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:40:48.600326 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-cb34d1ec-ced2-4ed9-816c-9ce4f848abcf tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:40:48.608278 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-cb34d1ec-ced2-4ed9-816c-9ce4f848abcf tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.081867 Nov 09 20:40:48.608862 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1253/2475] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:40:48 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:40:49.625460 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-bc50b39d-bc59-423b-b607-49eafb2c3820 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:40:49.626106 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-bc50b39d-bc59-423b-b607-49eafb2c3820 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:40:49.633208 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bc50b39d-bc59-423b-b607-49eafb2c3820 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:40:49.633723 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bc50b39d-bc59-423b-b607-49eafb2c3820 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:40:49.634491 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bc50b39d-bc59-423b-b607-49eafb2c3820 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:40:49.634915 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bc50b39d-bc59-423b-b607-49eafb2c3820 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:40:49.693509 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-bc50b39d-bc59-423b-b607-49eafb2c3820 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:40:49.701486 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-bc50b39d-bc59-423b-b607-49eafb2c3820 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.079793 Nov 09 20:40:49.702050 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1223/2476] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:40:49 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:40:50.717879 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-9fc6b92f-3ed6-4dc2-859b-dbdd585191c9 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:40:50.718481 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-9fc6b92f-3ed6-4dc2-859b-dbdd585191c9 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:40:50.724673 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-9fc6b92f-3ed6-4dc2-859b-dbdd585191c9 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:40:50.725122 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-9fc6b92f-3ed6-4dc2-859b-dbdd585191c9 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:40:50.725902 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-9fc6b92f-3ed6-4dc2-859b-dbdd585191c9 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:40:50.726418 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-9fc6b92f-3ed6-4dc2-859b-dbdd585191c9 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:40:50.784912 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-9fc6b92f-3ed6-4dc2-859b-dbdd585191c9 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:40:50.792752 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-9fc6b92f-3ed6-4dc2-859b-dbdd585191c9 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.078568 Nov 09 20:40:50.793349 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1254/2477] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:40:50 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:40:51.809356 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-4053997f-c112-4f37-94b1-06e8fdcdfc98 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:40:51.809954 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-4053997f-c112-4f37-94b1-06e8fdcdfc98 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:40:51.816037 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4053997f-c112-4f37-94b1-06e8fdcdfc98 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:40:51.816506 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4053997f-c112-4f37-94b1-06e8fdcdfc98 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:40:51.817264 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4053997f-c112-4f37-94b1-06e8fdcdfc98 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:40:51.817692 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4053997f-c112-4f37-94b1-06e8fdcdfc98 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:40:51.877065 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-4053997f-c112-4f37-94b1-06e8fdcdfc98 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:40:51.884891 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-4053997f-c112-4f37-94b1-06e8fdcdfc98 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.079123 Nov 09 20:40:51.885445 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1224/2478] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:40:51 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:40:52.901200 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-9c8f074f-5c06-4b03-9bb7-e9292e977bea tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:40:52.901806 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-9c8f074f-5c06-4b03-9bb7-e9292e977bea tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:40:52.907956 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-9c8f074f-5c06-4b03-9bb7-e9292e977bea tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:40:52.908420 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-9c8f074f-5c06-4b03-9bb7-e9292e977bea tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:40:52.909188 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-9c8f074f-5c06-4b03-9bb7-e9292e977bea tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:40:52.909619 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-9c8f074f-5c06-4b03-9bb7-e9292e977bea tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:40:52.968451 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-9c8f074f-5c06-4b03-9bb7-e9292e977bea tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:40:52.976667 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-9c8f074f-5c06-4b03-9bb7-e9292e977bea tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.078753 Nov 09 20:40:52.977227 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1255/2479] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:40:52 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:40:53.993605 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-a443b8f4-3547-4743-8351-9855f257bec1 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:40:53.994233 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-a443b8f4-3547-4743-8351-9855f257bec1 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:40:54.000318 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a443b8f4-3547-4743-8351-9855f257bec1 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:40:54.000793 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a443b8f4-3547-4743-8351-9855f257bec1 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:40:54.001545 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a443b8f4-3547-4743-8351-9855f257bec1 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:40:54.001969 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a443b8f4-3547-4743-8351-9855f257bec1 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:40:54.060118 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-a443b8f4-3547-4743-8351-9855f257bec1 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:40:54.067648 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-a443b8f4-3547-4743-8351-9855f257bec1 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.078274 Nov 09 20:40:54.068200 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1225/2480] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:40:53 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:40:55.084049 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-cae3b4c7-e5e7-48ea-bfe8-9bd6c20e98c9 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:40:55.084711 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-cae3b4c7-e5e7-48ea-bfe8-9bd6c20e98c9 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:40:55.091752 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-cae3b4c7-e5e7-48ea-bfe8-9bd6c20e98c9 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:40:55.092195 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-cae3b4c7-e5e7-48ea-bfe8-9bd6c20e98c9 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:40:55.092991 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-cae3b4c7-e5e7-48ea-bfe8-9bd6c20e98c9 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:40:55.093421 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-cae3b4c7-e5e7-48ea-bfe8-9bd6c20e98c9 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:40:55.158309 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-cae3b4c7-e5e7-48ea-bfe8-9bd6c20e98c9 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:40:55.166334 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-cae3b4c7-e5e7-48ea-bfe8-9bd6c20e98c9 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.085924 Nov 09 20:40:55.166898 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1256/2481] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:40:55 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:40:56.182910 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-227c031e-5ce8-48b1-9e79-14adae7f49d8 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:40:56.183521 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-227c031e-5ce8-48b1-9e79-14adae7f49d8 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:40:56.190469 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-227c031e-5ce8-48b1-9e79-14adae7f49d8 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:40:56.190921 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-227c031e-5ce8-48b1-9e79-14adae7f49d8 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:40:56.191695 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-227c031e-5ce8-48b1-9e79-14adae7f49d8 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:40:56.192130 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-227c031e-5ce8-48b1-9e79-14adae7f49d8 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:40:56.249927 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-227c031e-5ce8-48b1-9e79-14adae7f49d8 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:40:56.258223 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-227c031e-5ce8-48b1-9e79-14adae7f49d8 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.079033 Nov 09 20:40:56.258876 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1226/2482] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:40:56 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:40:57.275297 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-7dfa07ce-a53a-4f5c-b283-220da9aa06fd tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:40:57.275884 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-7dfa07ce-a53a-4f5c-b283-220da9aa06fd tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:40:57.282218 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-7dfa07ce-a53a-4f5c-b283-220da9aa06fd tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:40:57.282658 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-7dfa07ce-a53a-4f5c-b283-220da9aa06fd tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:40:57.283675 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-7dfa07ce-a53a-4f5c-b283-220da9aa06fd tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:40:57.284104 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-7dfa07ce-a53a-4f5c-b283-220da9aa06fd tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:40:57.342240 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-7dfa07ce-a53a-4f5c-b283-220da9aa06fd tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:40:57.349867 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-7dfa07ce-a53a-4f5c-b283-220da9aa06fd tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.078479 Nov 09 20:40:57.350420 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1257/2483] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:40:57 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:40:58.367353 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-8e693995-63fe-4398-afd7-53c8fc7ec192 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:40:58.368046 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-8e693995-63fe-4398-afd7-53c8fc7ec192 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:40:58.374565 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8e693995-63fe-4398-afd7-53c8fc7ec192 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:40:58.375008 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8e693995-63fe-4398-afd7-53c8fc7ec192 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:40:58.375771 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8e693995-63fe-4398-afd7-53c8fc7ec192 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:40:58.376195 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8e693995-63fe-4398-afd7-53c8fc7ec192 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:40:58.434762 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-8e693995-63fe-4398-afd7-53c8fc7ec192 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:40:58.442278 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-8e693995-63fe-4398-afd7-53c8fc7ec192 tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.079182 Nov 09 20:40:58.442836 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1227/2484] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:40:58 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:40:59.179780 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 09 20:40:59.180373 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: Tue Nov 9 20:40:59 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 09 20:40:59.459455 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-a8f602bf-37f5-4d69-b9c9-2cee2852027f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:40:59.459982 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-a8f602bf-37f5-4d69-b9c9-2cee2852027f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:40:59.466940 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a8f602bf-37f5-4d69-b9c9-2cee2852027f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:40:59.467322 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a8f602bf-37f5-4d69-b9c9-2cee2852027f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:40:59.468089 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a8f602bf-37f5-4d69-b9c9-2cee2852027f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:40:59.468543 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a8f602bf-37f5-4d69-b9c9-2cee2852027f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:40:59.530475 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-a8f602bf-37f5-4d69-b9c9-2cee2852027f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:40:59.538100 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-a8f602bf-37f5-4d69-b9c9-2cee2852027f tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1352 microversion: 2.1 time: 0.082362 Nov 09 20:40:59.538654 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1258/2485] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:40:59 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:41:00.546212 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-abac957e-06a7-49cf-9f85-96bf20d9b233 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-210273284", "imageRef": "109ded43-8c19-4f17-afac-7625dcfef942", "flavorRef": "452", "networks": [{"uuid": "32873de2-bb5b-4ab8-8b44-11a0a374ab76"}]}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:41:00.555528 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-be821572-f159-4e35-a822-e16827ee24aa tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:41:00.556142 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-be821572-f159-4e35-a822-e16827ee24aa tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:41:00.562432 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-be821572-f159-4e35-a822-e16827ee24aa tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:41:00.562884 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-be821572-f159-4e35-a822-e16827ee24aa tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:41:00.564064 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-be821572-f159-4e35-a822-e16827ee24aa tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:41:00.564178 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-be821572-f159-4e35-a822-e16827ee24aa tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:41:00.608798 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.network.neutron [None req-abac957e-06a7-49cf-9f85-96bf20d9b233 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] validate_networks() for [('32873de2-bb5b-4ab8-8b44-11a0a374ab76', None, None, None, None, None)] {{(pid=116103) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 09 20:41:00.610037 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-be821572-f159-4e35-a822-e16827ee24aa tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:41:00.610559 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-be821572-f159-4e35-a822-e16827ee24aa tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:41:00.611105 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.objects.instance [None req-be821572-f159-4e35-a822-e16827ee24aa tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lazy-loading 'fault' on Instance uuid 80ce5722-8f51-457b-9f9b-ff4b63b103df {{(pid=116102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 09 20:41:00.683461 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-be821572-f159-4e35-a822-e16827ee24aa tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9eba07a4d664c80a55e05a82a791bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3e835ea4424a88bb80e940a61aff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:41:00.690430 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-be821572-f159-4e35-a822-e16827ee24aa tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 200 len: 1311 microversion: 2.1 time: 0.139088 Nov 09 20:41:00.691247 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1259/2486] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:41:00 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 1311 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:41:01.062101 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.virt.hardware [None req-abac957e-06a7-49cf-9f85-96bf20d9b233 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Flavor limits 0:0:0 {{(pid=116103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 09 20:41:01.062532 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.virt.hardware [None req-abac957e-06a7-49cf-9f85-96bf20d9b233 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Image limits 0:0:0 {{(pid=116103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 09 20:41:01.063024 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.virt.hardware [None req-abac957e-06a7-49cf-9f85-96bf20d9b233 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Flavor pref 0:0:0 {{(pid=116103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 09 20:41:01.063434 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.virt.hardware [None req-abac957e-06a7-49cf-9f85-96bf20d9b233 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Image pref 0:0:0 {{(pid=116103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 09 20:41:01.063843 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.virt.hardware [None req-abac957e-06a7-49cf-9f85-96bf20d9b233 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 09 20:41:01.072454 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-abac957e-06a7-49cf-9f85-96bf20d9b233 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:41:01.072907 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-abac957e-06a7-49cf-9f85-96bf20d9b233 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:41:01.073711 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-abac957e-06a7-49cf-9f85-96bf20d9b233 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:41:01.074144 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-abac957e-06a7-49cf-9f85-96bf20d9b233 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:41:01.090155 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.quota [None req-abac957e-06a7-49cf-9f85-96bf20d9b233 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Getting quotas for project bb677ce693194a32b39358f5b613069f. Resources: {'cores', 'instances', 'ram'} {{(pid=116103) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 09 20:41:01.093937 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.quota [None req-abac957e-06a7-49cf-9f85-96bf20d9b233 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Getting quotas for user d7370bcbf19947a7bb00ab954a6f2d95 and project bb677ce693194a32b39358f5b613069f. Resources: {'cores', 'instances', 'ram'} {{(pid=116103) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 09 20:41:01.104835 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-abac957e-06a7-49cf-9f85-96bf20d9b233 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Going to run 1 instances... {{(pid=116103) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 09 20:41:01.107023 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-abac957e-06a7-49cf-9f85-96bf20d9b233 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 15eeef62-ce91-49c8-a1fc-3ba3d6d83ef7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='109ded43-8c19-4f17-afac-7625dcfef942',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116103) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 09 20:41:01.151057 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-abac957e-06a7-49cf-9f85-96bf20d9b233 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.608572 Nov 09 20:41:01.151699 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1228/2487] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Nov 9 20:41:00 2021] POST /compute/v2.1/servers => generated 380 bytes in 610 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 09 20:41:01.162232 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-f9aff694-031f-49c4-8c34-f0bb4c71111e tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:41:01.162844 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-f9aff694-031f-49c4-8c34-f0bb4c71111e tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 15eeef62-ce91-49c8-a1fc-3ba3d6d83ef7] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:41:01.215169 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-f9aff694-031f-49c4-8c34-f0bb4c71111e tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:41:01.221657 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-f9aff694-031f-49c4-8c34-f0bb4c71111e tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/15eeef62-ce91-49c8-a1fc-3ba3d6d83ef7" status: 200 len: 1218 microversion: 2.1 time: 0.063953 Nov 09 20:41:01.222214 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1260/2488] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:41:01 2021] GET /compute/v2.1/servers/15eeef62-ce91-49c8-a1fc-3ba3d6d83ef7 => generated 1218 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:41:01.710085 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-b3bb867f-c83f-4803-a50e-fac5147712ad tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:41:01.710624 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-b3bb867f-c83f-4803-a50e-fac5147712ad tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] [instance: 80ce5722-8f51-457b-9f9b-ff4b63b103df] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:41:01.718235 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b3bb867f-c83f-4803-a50e-fac5147712ad tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:41:01.718955 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b3bb867f-c83f-4803-a50e-fac5147712ad tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:41:01.719931 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b3bb867f-c83f-4803-a50e-fac5147712ad tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:41:01.722442 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b3bb867f-c83f-4803-a50e-fac5147712ad tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:41:01.743359 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.wsgi [None req-b3bb867f-c83f-4803-a50e-fac5147712ad tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] HTTP exception thrown: Instance 80ce5722-8f51-457b-9f9b-ff4b63b103df could not be found. Nov 09 20:41:01.744179 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-b3bb867f-c83f-4803-a50e-fac5147712ad tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] Returning 404 to user: Instance 80ce5722-8f51-457b-9f9b-ff4b63b103df could not be found. {{(pid=116103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 09 20:41:01.745053 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-b3bb867f-c83f-4803-a50e-fac5147712ad tempest-ServerRescueNegativeTestJSON-60289670 tempest-ServerRescueNegativeTestJSON-60289670-project] 10.222.0.25 "GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df" status: 404 len: 111 microversion: 2.1 time: 0.040462 Nov 09 20:41:01.749345 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1229/2489] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:41:01 2021] GET /compute/v2.1/servers/80ce5722-8f51-457b-9f9b-ff4b63b103df => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 09 20:41:01.919271 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [req-593f070f-0883-4b4c-89a5-3f49c7f9f604 req-3406b7b1-b0a4-440e-93e4-4c1b8475e033 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75e5847b-18ff-4332-be8a-f77ffae72997", "name": "network-vif-deleted", "tag": "444d6d36-0a3d-4e0d-8c9a-cf6c03c32d1f"}]} {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:41:01.920866 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 20:41:01.920866 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: warnings.warn(msg) Nov 09 20:41:01.944453 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [req-593f070f-0883-4b4c-89a5-3f49c7f9f604 req-3406b7b1-b0a4-440e-93e4-4c1b8475e033 service nova] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:41:01.945796 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [req-593f070f-0883-4b4c-89a5-3f49c7f9f604 req-3406b7b1-b0a4-440e-93e4-4c1b8475e033 service nova] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:41:01.968148 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.compute.server_external_events [req-593f070f-0883-4b4c-89a5-3f49c7f9f604 req-3406b7b1-b0a4-440e-93e4-4c1b8475e033 service nova] Creating event network-vif-deleted:444d6d36-0a3d-4e0d-8c9a-cf6c03c32d1f for instance 75e5847b-18ff-4332-be8a-f77ffae72997 on hv-cinder-80135 Nov 09 20:41:01.975255 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [req-593f070f-0883-4b4c-89a5-3f49c7f9f604 req-3406b7b1-b0a4-440e-93e4-4c1b8475e033 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.168988 Nov 09 20:41:01.975976 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1261/2490] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Nov 9 20:41:01 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:41:02.238903 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-8caf8b39-caca-4e03-bc2b-8c587a22236b tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:41:02.239500 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-8caf8b39-caca-4e03-bc2b-8c587a22236b tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 15eeef62-ce91-49c8-a1fc-3ba3d6d83ef7] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:41:02.246264 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8caf8b39-caca-4e03-bc2b-8c587a22236b tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:41:02.247118 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8caf8b39-caca-4e03-bc2b-8c587a22236b tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:41:02.248620 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8caf8b39-caca-4e03-bc2b-8c587a22236b tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:41:02.249376 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8caf8b39-caca-4e03-bc2b-8c587a22236b tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:41:02.327856 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-8caf8b39-caca-4e03-bc2b-8c587a22236b tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:41:02.337196 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-8caf8b39-caca-4e03-bc2b-8c587a22236b tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/15eeef62-ce91-49c8-a1fc-3ba3d6d83ef7" status: 200 len: 1270 microversion: 2.1 time: 0.101758 Nov 09 20:41:02.337780 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1230/2491] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:41:02 2021] GET /compute/v2.1/servers/15eeef62-ce91-49c8-a1fc-3ba3d6d83ef7 => generated 1270 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:41:03.355643 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-426a3376-6874-4922-9f9e-7a78b41a31cb tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:41:03.356608 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-426a3376-6874-4922-9f9e-7a78b41a31cb tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 15eeef62-ce91-49c8-a1fc-3ba3d6d83ef7] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:41:03.363129 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-426a3376-6874-4922-9f9e-7a78b41a31cb tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:41:03.363741 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-426a3376-6874-4922-9f9e-7a78b41a31cb tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:41:03.364798 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-426a3376-6874-4922-9f9e-7a78b41a31cb tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:41:03.365320 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-426a3376-6874-4922-9f9e-7a78b41a31cb tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:41:03.696265 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-426a3376-6874-4922-9f9e-7a78b41a31cb tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:41:03.705389 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-426a3376-6874-4922-9f9e-7a78b41a31cb tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/15eeef62-ce91-49c8-a1fc-3ba3d6d83ef7" status: 200 len: 1318 microversion: 2.1 time: 0.354970 Nov 09 20:41:03.705978 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1262/2492] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:41:03 2021] GET /compute/v2.1/servers/15eeef62-ce91-49c8-a1fc-3ba3d6d83ef7 => generated 1318 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 20:41:03.992544 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [req-1c84dec3-440d-4d53-8929-53ba0bce3716 req-e279fc09-6011-4a00-86e7-8ea44d1b8c55 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15eeef62-ce91-49c8-a1fc-3ba3d6d83ef7", "tag": "de952cf6-304c-4bd3-9829-b2a76fee9329"}]} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:41:03.994767 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 20:41:03.994767 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: warnings.warn(msg) Nov 09 20:41:04.001901 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-1c84dec3-440d-4d53-8929-53ba0bce3716 req-e279fc09-6011-4a00-86e7-8ea44d1b8c55 service nova] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:41:04.002338 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-1c84dec3-440d-4d53-8929-53ba0bce3716 req-e279fc09-6011-4a00-86e7-8ea44d1b8c55 service nova] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:41:04.013548 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.compute.server_external_events [req-1c84dec3-440d-4d53-8929-53ba0bce3716 req-e279fc09-6011-4a00-86e7-8ea44d1b8c55 service nova] Creating event network-changed:de952cf6-304c-4bd3-9829-b2a76fee9329 for instance 15eeef62-ce91-49c8-a1fc-3ba3d6d83ef7 on hv-cinder-80135 Nov 09 20:41:04.019383 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [req-1c84dec3-440d-4d53-8929-53ba0bce3716 req-e279fc09-6011-4a00-86e7-8ea44d1b8c55 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031033 Nov 09 20:41:04.020129 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1231/2493] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Nov 9 20:41:03 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:41:04.725435 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-65a14fd3-cefa-473b-ab7d-f00b6b57102d tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:41:04.727144 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-65a14fd3-cefa-473b-ab7d-f00b6b57102d tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 15eeef62-ce91-49c8-a1fc-3ba3d6d83ef7] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:41:04.733809 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-65a14fd3-cefa-473b-ab7d-f00b6b57102d tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:41:04.734183 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-65a14fd3-cefa-473b-ab7d-f00b6b57102d tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:41:04.734977 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-65a14fd3-cefa-473b-ab7d-f00b6b57102d tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:41:04.735410 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-65a14fd3-cefa-473b-ab7d-f00b6b57102d tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:41:04.987676 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-65a14fd3-cefa-473b-ab7d-f00b6b57102d tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:41:04.995743 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-65a14fd3-cefa-473b-ab7d-f00b6b57102d tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/15eeef62-ce91-49c8-a1fc-3ba3d6d83ef7" status: 200 len: 1318 microversion: 2.1 time: 0.276009 Nov 09 20:41:04.996614 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1263/2494] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:41:04 2021] GET /compute/v2.1/servers/15eeef62-ce91-49c8-a1fc-3ba3d6d83ef7 => generated 1318 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:41:06.014409 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-285e04c7-081a-4ad4-982f-5976f832579a tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:41:06.015104 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-285e04c7-081a-4ad4-982f-5976f832579a tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 15eeef62-ce91-49c8-a1fc-3ba3d6d83ef7] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:41:06.021996 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-285e04c7-081a-4ad4-982f-5976f832579a tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:41:06.022449 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-285e04c7-081a-4ad4-982f-5976f832579a tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:41:06.023831 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-285e04c7-081a-4ad4-982f-5976f832579a tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:41:06.024454 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-285e04c7-081a-4ad4-982f-5976f832579a tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:41:06.170334 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-285e04c7-081a-4ad4-982f-5976f832579a tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:41:06.180782 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-285e04c7-081a-4ad4-982f-5976f832579a tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/15eeef62-ce91-49c8-a1fc-3ba3d6d83ef7" status: 200 len: 1318 microversion: 2.1 time: 0.169998 Nov 09 20:41:06.181737 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1232/2495] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:41:06 2021] GET /compute/v2.1/servers/15eeef62-ce91-49c8-a1fc-3ba3d6d83ef7 => generated 1318 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:41:07.198740 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-916d99f6-3ee7-41b9-b9cb-ec0785097586 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:41:07.199689 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-916d99f6-3ee7-41b9-b9cb-ec0785097586 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 15eeef62-ce91-49c8-a1fc-3ba3d6d83ef7] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:41:07.206052 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-916d99f6-3ee7-41b9-b9cb-ec0785097586 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:41:07.206618 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-916d99f6-3ee7-41b9-b9cb-ec0785097586 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:41:07.207525 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-916d99f6-3ee7-41b9-b9cb-ec0785097586 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:41:07.208062 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-916d99f6-3ee7-41b9-b9cb-ec0785097586 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:41:07.248374 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-2f499182-1396-400a-8ae7-ee8c32d760e2 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-721697495", "imageRef": "109ded43-8c19-4f17-afac-7625dcfef942", "flavorRef": "452", "networks": [{"uuid": "b06c7dbf-1a90-4fd3-b488-da69f3621cb9"}]}} {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:41:07.304883 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.network.neutron [None req-2f499182-1396-400a-8ae7-ee8c32d760e2 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] validate_networks() for [('b06c7dbf-1a90-4fd3-b488-da69f3621cb9', None, None, None, None, None)] {{(pid=116102) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 09 20:41:07.413565 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-916d99f6-3ee7-41b9-b9cb-ec0785097586 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:41:07.418974 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-916d99f6-3ee7-41b9-b9cb-ec0785097586 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/15eeef62-ce91-49c8-a1fc-3ba3d6d83ef7" status: 200 len: 1318 microversion: 2.1 time: 0.223758 Nov 09 20:41:07.426021 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1233/2496] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:41:07 2021] GET /compute/v2.1/servers/15eeef62-ce91-49c8-a1fc-3ba3d6d83ef7 => generated 1318 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:41:07.751372 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.virt.hardware [None req-2f499182-1396-400a-8ae7-ee8c32d760e2 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Flavor limits 0:0:0 {{(pid=116102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 09 20:41:07.751798 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.virt.hardware [None req-2f499182-1396-400a-8ae7-ee8c32d760e2 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Image limits 0:0:0 {{(pid=116102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 09 20:41:07.752285 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.virt.hardware [None req-2f499182-1396-400a-8ae7-ee8c32d760e2 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Flavor pref 0:0:0 {{(pid=116102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 09 20:41:07.752729 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.virt.hardware [None req-2f499182-1396-400a-8ae7-ee8c32d760e2 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Image pref 0:0:0 {{(pid=116102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 09 20:41:07.753213 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.virt.hardware [None req-2f499182-1396-400a-8ae7-ee8c32d760e2 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 09 20:41:07.762392 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-2f499182-1396-400a-8ae7-ee8c32d760e2 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:41:07.762887 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-2f499182-1396-400a-8ae7-ee8c32d760e2 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:41:07.763738 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-2f499182-1396-400a-8ae7-ee8c32d760e2 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:41:07.764181 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-2f499182-1396-400a-8ae7-ee8c32d760e2 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:41:07.780137 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.quota [None req-2f499182-1396-400a-8ae7-ee8c32d760e2 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Getting quotas for project 4a7db7a0f06b4371a79629e21c8d4bdf. Resources: {'cores', 'instances', 'ram'} {{(pid=116102) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 09 20:41:07.783989 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.quota [None req-2f499182-1396-400a-8ae7-ee8c32d760e2 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Getting quotas for user 05573fa698bd46e88032483a6cb0ad30 and project 4a7db7a0f06b4371a79629e21c8d4bdf. Resources: {'cores', 'instances', 'ram'} {{(pid=116102) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 09 20:41:07.794926 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-2f499182-1396-400a-8ae7-ee8c32d760e2 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Going to run 1 instances... {{(pid=116102) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 09 20:41:07.797253 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-2f499182-1396-400a-8ae7-ee8c32d760e2 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] [instance: f634121a-0b50-440d-b976-14f1945e9dc2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='109ded43-8c19-4f17-afac-7625dcfef942',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 09 20:41:07.843611 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-2f499182-1396-400a-8ae7-ee8c32d760e2 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.716037 Nov 09 20:41:07.844240 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1264/2497] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Nov 9 20:41:07 2021] POST /compute/v2.1/servers => generated 380 bytes in 717 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 09 20:41:07.854916 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-9b72bfe3-e6e4-4f11-bbf6-d913b504eb30 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:41:07.855515 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-9b72bfe3-e6e4-4f11-bbf6-d913b504eb30 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] [instance: f634121a-0b50-440d-b976-14f1945e9dc2] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:41:07.907362 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-9b72bfe3-e6e4-4f11-bbf6-d913b504eb30 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05573fa698bd46e88032483a6cb0ad30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a7db7a0f06b4371a79629e21c8d4bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:41:07.914854 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-9b72bfe3-e6e4-4f11-bbf6-d913b504eb30 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] 10.222.0.25 "GET /compute/v2.1/servers/f634121a-0b50-440d-b976-14f1945e9dc2" status: 200 len: 1217 microversion: 2.1 time: 0.063533 Nov 09 20:41:07.915752 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1234/2498] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:41:07 2021] GET /compute/v2.1/servers/f634121a-0b50-440d-b976-14f1945e9dc2 => generated 1217 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:41:08.435329 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-a4c2c5cf-0713-4dd6-ab74-8a78d6239a9f tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:41:08.435890 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-a4c2c5cf-0713-4dd6-ab74-8a78d6239a9f tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 15eeef62-ce91-49c8-a1fc-3ba3d6d83ef7] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:41:08.441693 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a4c2c5cf-0713-4dd6-ab74-8a78d6239a9f tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:41:08.442137 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a4c2c5cf-0713-4dd6-ab74-8a78d6239a9f tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:41:08.442891 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a4c2c5cf-0713-4dd6-ab74-8a78d6239a9f tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:41:08.443317 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a4c2c5cf-0713-4dd6-ab74-8a78d6239a9f tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:41:08.571643 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-a4c2c5cf-0713-4dd6-ab74-8a78d6239a9f tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:41:08.579030 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-a4c2c5cf-0713-4dd6-ab74-8a78d6239a9f tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/15eeef62-ce91-49c8-a1fc-3ba3d6d83ef7" status: 200 len: 1318 microversion: 2.1 time: 0.147907 Nov 09 20:41:08.579587 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1265/2499] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:41:08 2021] GET /compute/v2.1/servers/15eeef62-ce91-49c8-a1fc-3ba3d6d83ef7 => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:41:08.931646 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-892f15c6-9172-4ed8-9fb5-56df224dae2a tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:41:08.932358 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-892f15c6-9172-4ed8-9fb5-56df224dae2a tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] [instance: f634121a-0b50-440d-b976-14f1945e9dc2] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:41:08.941002 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-892f15c6-9172-4ed8-9fb5-56df224dae2a tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:41:08.941382 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-892f15c6-9172-4ed8-9fb5-56df224dae2a tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:41:08.942168 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-892f15c6-9172-4ed8-9fb5-56df224dae2a tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:41:08.942602 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-892f15c6-9172-4ed8-9fb5-56df224dae2a tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:41:09.008704 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-892f15c6-9172-4ed8-9fb5-56df224dae2a tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05573fa698bd46e88032483a6cb0ad30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a7db7a0f06b4371a79629e21c8d4bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:41:09.016875 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-892f15c6-9172-4ed8-9fb5-56df224dae2a tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] 10.222.0.25 "GET /compute/v2.1/servers/f634121a-0b50-440d-b976-14f1945e9dc2" status: 200 len: 1287 microversion: 2.1 time: 0.089316 Nov 09 20:41:09.017755 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1235/2500] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:41:08 2021] GET /compute/v2.1/servers/f634121a-0b50-440d-b976-14f1945e9dc2 => generated 1287 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:41:09.596026 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-f657dc4b-0c50-406e-8362-565350a7e53d tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:41:09.596673 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-f657dc4b-0c50-406e-8362-565350a7e53d tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 15eeef62-ce91-49c8-a1fc-3ba3d6d83ef7] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:41:09.606898 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f657dc4b-0c50-406e-8362-565350a7e53d tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:41:09.607345 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f657dc4b-0c50-406e-8362-565350a7e53d tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:41:09.608124 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f657dc4b-0c50-406e-8362-565350a7e53d tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:41:09.609424 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f657dc4b-0c50-406e-8362-565350a7e53d tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:41:09.759653 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-f657dc4b-0c50-406e-8362-565350a7e53d tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:41:09.767848 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-f657dc4b-0c50-406e-8362-565350a7e53d tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/15eeef62-ce91-49c8-a1fc-3ba3d6d83ef7" status: 200 len: 1318 microversion: 2.1 time: 0.175460 Nov 09 20:41:09.768780 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1266/2501] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:41:09 2021] GET /compute/v2.1/servers/15eeef62-ce91-49c8-a1fc-3ba3d6d83ef7 => generated 1318 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:41:10.034173 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-aeed65dd-cc54-4884-a9bf-5014ef022bfe tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:41:10.035405 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-aeed65dd-cc54-4884-a9bf-5014ef022bfe tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] [instance: f634121a-0b50-440d-b976-14f1945e9dc2] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:41:10.042797 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-aeed65dd-cc54-4884-a9bf-5014ef022bfe tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:41:10.043232 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-aeed65dd-cc54-4884-a9bf-5014ef022bfe tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:41:10.044199 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-aeed65dd-cc54-4884-a9bf-5014ef022bfe tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:41:10.044648 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-aeed65dd-cc54-4884-a9bf-5014ef022bfe tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:41:10.196999 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-aeed65dd-cc54-4884-a9bf-5014ef022bfe tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05573fa698bd46e88032483a6cb0ad30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a7db7a0f06b4371a79629e21c8d4bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:41:10.206791 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-aeed65dd-cc54-4884-a9bf-5014ef022bfe tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] 10.222.0.25 "GET /compute/v2.1/servers/f634121a-0b50-440d-b976-14f1945e9dc2" status: 200 len: 1317 microversion: 2.1 time: 0.176161 Nov 09 20:41:10.216908 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1236/2502] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:41:10 2021] GET /compute/v2.1/servers/f634121a-0b50-440d-b976-14f1945e9dc2 => generated 1317 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:41:10.425769 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [req-b3cb17f6-c4a4-48aa-bfa5-7b44bd79c964 req-f163975a-924c-4b17-a1c5-2e22701670ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f634121a-0b50-440d-b976-14f1945e9dc2", "tag": "c1095bb4-ce3f-48c7-926a-b6e26611dbb1"}]} {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:41:10.427583 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 20:41:10.427583 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: warnings.warn(msg) Nov 09 20:41:10.436607 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [req-b3cb17f6-c4a4-48aa-bfa5-7b44bd79c964 req-f163975a-924c-4b17-a1c5-2e22701670ee service nova] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:41:10.437430 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [req-b3cb17f6-c4a4-48aa-bfa5-7b44bd79c964 req-f163975a-924c-4b17-a1c5-2e22701670ee service nova] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:41:10.448793 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.compute.server_external_events [req-b3cb17f6-c4a4-48aa-bfa5-7b44bd79c964 req-f163975a-924c-4b17-a1c5-2e22701670ee service nova] Creating event network-changed:c1095bb4-ce3f-48c7-926a-b6e26611dbb1 for instance f634121a-0b50-440d-b976-14f1945e9dc2 on hv-cinder-80135 Nov 09 20:41:10.453664 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [req-b3cb17f6-c4a4-48aa-bfa5-7b44bd79c964 req-f163975a-924c-4b17-a1c5-2e22701670ee service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032497 Nov 09 20:41:10.454592 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1267/2503] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Nov 9 20:41:10 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:41:10.785215 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-7c780b40-1ffe-4d80-8c56-351216764367 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:41:10.785766 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-7c780b40-1ffe-4d80-8c56-351216764367 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 15eeef62-ce91-49c8-a1fc-3ba3d6d83ef7] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:41:10.792889 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7c780b40-1ffe-4d80-8c56-351216764367 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:41:10.793323 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7c780b40-1ffe-4d80-8c56-351216764367 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:41:10.794098 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7c780b40-1ffe-4d80-8c56-351216764367 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:41:10.794525 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7c780b40-1ffe-4d80-8c56-351216764367 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:41:11.031019 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-7c780b40-1ffe-4d80-8c56-351216764367 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:41:11.039461 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-7c780b40-1ffe-4d80-8c56-351216764367 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/15eeef62-ce91-49c8-a1fc-3ba3d6d83ef7" status: 200 len: 1318 microversion: 2.1 time: 0.257107 Nov 09 20:41:11.040273 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1237/2504] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:41:10 2021] GET /compute/v2.1/servers/15eeef62-ce91-49c8-a1fc-3ba3d6d83ef7 => generated 1318 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:41:11.224998 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-b0ade105-0ed8-479d-b577-6067ae1a5068 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:41:11.226503 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-b0ade105-0ed8-479d-b577-6067ae1a5068 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] [instance: f634121a-0b50-440d-b976-14f1945e9dc2] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:41:11.233307 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b0ade105-0ed8-479d-b577-6067ae1a5068 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:41:11.234089 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b0ade105-0ed8-479d-b577-6067ae1a5068 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:41:11.235180 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b0ade105-0ed8-479d-b577-6067ae1a5068 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:41:11.235687 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b0ade105-0ed8-479d-b577-6067ae1a5068 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:41:11.401622 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-b0ade105-0ed8-479d-b577-6067ae1a5068 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05573fa698bd46e88032483a6cb0ad30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a7db7a0f06b4371a79629e21c8d4bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:41:11.409448 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-b0ade105-0ed8-479d-b577-6067ae1a5068 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] 10.222.0.25 "GET /compute/v2.1/servers/f634121a-0b50-440d-b976-14f1945e9dc2" status: 200 len: 1317 microversion: 2.1 time: 0.188353 Nov 09 20:41:11.410135 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1268/2505] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:41:11 2021] GET /compute/v2.1/servers/f634121a-0b50-440d-b976-14f1945e9dc2 => generated 1317 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 20:41:12.056604 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-7aa3bfb5-1941-4b66-ab46-a74ef9fa3750 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:41:12.057213 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-7aa3bfb5-1941-4b66-ab46-a74ef9fa3750 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 15eeef62-ce91-49c8-a1fc-3ba3d6d83ef7] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:41:12.063315 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7aa3bfb5-1941-4b66-ab46-a74ef9fa3750 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:41:12.063758 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7aa3bfb5-1941-4b66-ab46-a74ef9fa3750 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:41:12.064607 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7aa3bfb5-1941-4b66-ab46-a74ef9fa3750 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:41:12.065061 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7aa3bfb5-1941-4b66-ab46-a74ef9fa3750 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:41:12.199559 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-7aa3bfb5-1941-4b66-ab46-a74ef9fa3750 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:41:12.207022 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-7aa3bfb5-1941-4b66-ab46-a74ef9fa3750 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/15eeef62-ce91-49c8-a1fc-3ba3d6d83ef7" status: 200 len: 1318 microversion: 2.1 time: 0.154127 Nov 09 20:41:12.208033 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1238/2506] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:41:12 2021] GET /compute/v2.1/servers/15eeef62-ce91-49c8-a1fc-3ba3d6d83ef7 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:41:12.291517 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 09 20:41:12.291713 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: Tue Nov 9 20:41:12 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 09 20:41:12.427549 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-3439f3b4-5c23-4abc-b3c0-43d64c0b02a2 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:41:12.428144 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-3439f3b4-5c23-4abc-b3c0-43d64c0b02a2 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] [instance: f634121a-0b50-440d-b976-14f1945e9dc2] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:41:12.434789 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-3439f3b4-5c23-4abc-b3c0-43d64c0b02a2 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:41:12.435259 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-3439f3b4-5c23-4abc-b3c0-43d64c0b02a2 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:41:12.436151 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-3439f3b4-5c23-4abc-b3c0-43d64c0b02a2 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:41:12.436823 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-3439f3b4-5c23-4abc-b3c0-43d64c0b02a2 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:41:12.591800 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-3439f3b4-5c23-4abc-b3c0-43d64c0b02a2 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05573fa698bd46e88032483a6cb0ad30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a7db7a0f06b4371a79629e21c8d4bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:41:12.600926 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-3439f3b4-5c23-4abc-b3c0-43d64c0b02a2 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] 10.222.0.25 "GET /compute/v2.1/servers/f634121a-0b50-440d-b976-14f1945e9dc2" status: 200 len: 1317 microversion: 2.1 time: 0.176803 Nov 09 20:41:12.601863 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1269/2507] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:41:12 2021] GET /compute/v2.1/servers/f634121a-0b50-440d-b976-14f1945e9dc2 => generated 1317 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:41:12.644805 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [req-c3a78c6d-7afc-4dbc-a6d1-e12251db9092 req-c9dadbb0-39a1-40f7-b725-1edd270ec91a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15eeef62-ce91-49c8-a1fc-3ba3d6d83ef7", "name": "network-vif-plugged", "status": "completed", "tag": "de952cf6-304c-4bd3-9829-b2a76fee9329"}]} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:41:12.646355 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 20:41:12.646355 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: warnings.warn(msg) Nov 09 20:41:12.654250 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-c3a78c6d-7afc-4dbc-a6d1-e12251db9092 req-c9dadbb0-39a1-40f7-b725-1edd270ec91a service nova] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:41:12.654784 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-c3a78c6d-7afc-4dbc-a6d1-e12251db9092 req-c9dadbb0-39a1-40f7-b725-1edd270ec91a service nova] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:41:12.666273 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.compute.server_external_events [req-c3a78c6d-7afc-4dbc-a6d1-e12251db9092 req-c9dadbb0-39a1-40f7-b725-1edd270ec91a service nova] Creating event network-vif-plugged:de952cf6-304c-4bd3-9829-b2a76fee9329 for instance 15eeef62-ce91-49c8-a1fc-3ba3d6d83ef7 on hv-cinder-80135 Nov 09 20:41:12.671391 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [req-c3a78c6d-7afc-4dbc-a6d1-e12251db9092 req-c9dadbb0-39a1-40f7-b725-1edd270ec91a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.177553 Nov 09 20:41:12.672075 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1239/2508] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Nov 9 20:41:12 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:41:13.225389 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-aad48f8d-261c-421f-967c-d2e26e08a242 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:41:13.226731 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-aad48f8d-261c-421f-967c-d2e26e08a242 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 15eeef62-ce91-49c8-a1fc-3ba3d6d83ef7] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:41:13.233140 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-aad48f8d-261c-421f-967c-d2e26e08a242 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:41:13.233579 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-aad48f8d-261c-421f-967c-d2e26e08a242 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:41:13.234356 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-aad48f8d-261c-421f-967c-d2e26e08a242 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:41:13.234791 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-aad48f8d-261c-421f-967c-d2e26e08a242 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:41:13.390184 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-aad48f8d-261c-421f-967c-d2e26e08a242 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:41:13.398569 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-aad48f8d-261c-421f-967c-d2e26e08a242 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/15eeef62-ce91-49c8-a1fc-3ba3d6d83ef7" status: 200 len: 1318 microversion: 2.1 time: 0.176760 Nov 09 20:41:13.399158 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1270/2509] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:41:13 2021] GET /compute/v2.1/servers/15eeef62-ce91-49c8-a1fc-3ba3d6d83ef7 => generated 1318 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 20:41:13.619384 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-a7da209b-eae7-4244-9afe-a2740c2aedc4 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:41:13.620110 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-a7da209b-eae7-4244-9afe-a2740c2aedc4 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] [instance: f634121a-0b50-440d-b976-14f1945e9dc2] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:41:13.626011 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a7da209b-eae7-4244-9afe-a2740c2aedc4 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:41:13.626467 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a7da209b-eae7-4244-9afe-a2740c2aedc4 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:41:13.627214 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a7da209b-eae7-4244-9afe-a2740c2aedc4 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:41:13.627643 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a7da209b-eae7-4244-9afe-a2740c2aedc4 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:41:13.761378 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-a7da209b-eae7-4244-9afe-a2740c2aedc4 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05573fa698bd46e88032483a6cb0ad30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a7db7a0f06b4371a79629e21c8d4bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:41:13.768541 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-a7da209b-eae7-4244-9afe-a2740c2aedc4 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] 10.222.0.25 "GET /compute/v2.1/servers/f634121a-0b50-440d-b976-14f1945e9dc2" status: 200 len: 1317 microversion: 2.1 time: 0.154158 Nov 09 20:41:13.769090 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1240/2510] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:41:13 2021] GET /compute/v2.1/servers/f634121a-0b50-440d-b976-14f1945e9dc2 => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:41:14.416022 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-fdeab386-bb00-489f-8591-db2d5fc29d6b tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:41:14.416607 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-fdeab386-bb00-489f-8591-db2d5fc29d6b tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 15eeef62-ce91-49c8-a1fc-3ba3d6d83ef7] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:41:14.423361 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-fdeab386-bb00-489f-8591-db2d5fc29d6b tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:41:14.423761 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-fdeab386-bb00-489f-8591-db2d5fc29d6b tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:41:14.424575 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-fdeab386-bb00-489f-8591-db2d5fc29d6b tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:41:14.425013 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-fdeab386-bb00-489f-8591-db2d5fc29d6b tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:41:14.567581 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-fdeab386-bb00-489f-8591-db2d5fc29d6b tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:41:14.579112 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-fdeab386-bb00-489f-8591-db2d5fc29d6b tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/15eeef62-ce91-49c8-a1fc-3ba3d6d83ef7" status: 200 len: 1507 microversion: 2.1 time: 0.167229 Nov 09 20:41:14.579329 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1271/2511] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:41:14 2021] GET /compute/v2.1/servers/15eeef62-ce91-49c8-a1fc-3ba3d6d83ef7 => generated 1507 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:41:14.599965 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-1c97cda9-4cdb-4cbb-9ef8-d6d84e3aadd1 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "98941877-659b-44a9-a6a5-60b0adfd0de9", "device": "/dev/sdb"}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:41:14.602000 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-1c97cda9-4cdb-4cbb-9ef8-d6d84e3aadd1 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 15eeef62-ce91-49c8-a1fc-3ba3d6d83ef7] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:41:14.608191 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1c97cda9-4cdb-4cbb-9ef8-d6d84e3aadd1 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:41:14.608679 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1c97cda9-4cdb-4cbb-9ef8-d6d84e3aadd1 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:41:14.609467 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1c97cda9-4cdb-4cbb-9ef8-d6d84e3aadd1 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:41:14.609977 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1c97cda9-4cdb-4cbb-9ef8-d6d84e3aadd1 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:41:14.784958 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-b9e2d4ad-7003-4eaa-8a92-4ad76e148378 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:41:14.785563 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-b9e2d4ad-7003-4eaa-8a92-4ad76e148378 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] [instance: f634121a-0b50-440d-b976-14f1945e9dc2] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:41:14.791910 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b9e2d4ad-7003-4eaa-8a92-4ad76e148378 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:41:14.792358 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b9e2d4ad-7003-4eaa-8a92-4ad76e148378 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:41:14.793190 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b9e2d4ad-7003-4eaa-8a92-4ad76e148378 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:41:14.794137 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b9e2d4ad-7003-4eaa-8a92-4ad76e148378 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:41:14.864026 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-1c97cda9-4cdb-4cbb-9ef8-d6d84e3aadd1 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "POST /compute/v2.1/servers/15eeef62-ce91-49c8-a1fc-3ba3d6d83ef7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.268974 Nov 09 20:41:14.865285 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1241/2512] 10.222.0.25 () {60 vars in 1322 bytes} [Tue Nov 9 20:41:14 2021] POST /compute/v2.1/servers/15eeef62-ce91-49c8-a1fc-3ba3d6d83ef7/os-volume_attachments => generated 194 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:41:14.960999 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-b9e2d4ad-7003-4eaa-8a92-4ad76e148378 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05573fa698bd46e88032483a6cb0ad30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a7db7a0f06b4371a79629e21c8d4bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:41:14.968418 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-b9e2d4ad-7003-4eaa-8a92-4ad76e148378 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] 10.222.0.25 "GET /compute/v2.1/servers/f634121a-0b50-440d-b976-14f1945e9dc2" status: 200 len: 1317 microversion: 2.1 time: 0.187021 Nov 09 20:41:14.968983 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1272/2513] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:41:14 2021] GET /compute/v2.1/servers/f634121a-0b50-440d-b976-14f1945e9dc2 => generated 1317 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 20:41:15.990678 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-2a555b03-3773-4139-81d3-f60f990f4204 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:41:15.992685 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-2a555b03-3773-4139-81d3-f60f990f4204 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] [instance: f634121a-0b50-440d-b976-14f1945e9dc2] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:41:15.999665 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2a555b03-3773-4139-81d3-f60f990f4204 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:41:16.000122 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2a555b03-3773-4139-81d3-f60f990f4204 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:41:16.001139 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2a555b03-3773-4139-81d3-f60f990f4204 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:41:16.001501 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2a555b03-3773-4139-81d3-f60f990f4204 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:41:16.170875 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-2a555b03-3773-4139-81d3-f60f990f4204 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05573fa698bd46e88032483a6cb0ad30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a7db7a0f06b4371a79629e21c8d4bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:41:16.178173 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-2a555b03-3773-4139-81d3-f60f990f4204 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] 10.222.0.25 "GET /compute/v2.1/servers/f634121a-0b50-440d-b976-14f1945e9dc2" status: 200 len: 1317 microversion: 2.1 time: 0.193476 Nov 09 20:41:16.178758 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1242/2514] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:41:15 2021] GET /compute/v2.1/servers/f634121a-0b50-440d-b976-14f1945e9dc2 => generated 1317 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:41:16.527138 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [req-cb4aaa76-9a1e-4d8d-80ad-ed1f2d15d609 req-ba4040db-98f7-41cd-bcc6-46465a62547b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f634121a-0b50-440d-b976-14f1945e9dc2", "name": "network-vif-plugged", "status": "completed", "tag": "c1095bb4-ce3f-48c7-926a-b6e26611dbb1"}]} {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:41:16.528761 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 20:41:16.528761 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: warnings.warn(msg) Nov 09 20:41:16.536455 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [req-cb4aaa76-9a1e-4d8d-80ad-ed1f2d15d609 req-ba4040db-98f7-41cd-bcc6-46465a62547b service nova] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:41:16.536913 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [req-cb4aaa76-9a1e-4d8d-80ad-ed1f2d15d609 req-ba4040db-98f7-41cd-bcc6-46465a62547b service nova] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:41:16.548232 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.compute.server_external_events [req-cb4aaa76-9a1e-4d8d-80ad-ed1f2d15d609 req-ba4040db-98f7-41cd-bcc6-46465a62547b service nova] Creating event network-vif-plugged:c1095bb4-ce3f-48c7-926a-b6e26611dbb1 for instance f634121a-0b50-440d-b976-14f1945e9dc2 on hv-cinder-80135 Nov 09 20:41:16.553199 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [req-cb4aaa76-9a1e-4d8d-80ad-ed1f2d15d609 req-ba4040db-98f7-41cd-bcc6-46465a62547b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029713 Nov 09 20:41:16.553863 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1273/2515] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Nov 9 20:41:16 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 20:41:17.194576 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-ee9d839a-6ab0-418c-8b35-c954e26cb6e8 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:41:17.195188 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-ee9d839a-6ab0-418c-8b35-c954e26cb6e8 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] [instance: f634121a-0b50-440d-b976-14f1945e9dc2] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:41:17.203370 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ee9d839a-6ab0-418c-8b35-c954e26cb6e8 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:41:17.203825 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ee9d839a-6ab0-418c-8b35-c954e26cb6e8 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:41:17.204853 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ee9d839a-6ab0-418c-8b35-c954e26cb6e8 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:41:17.205150 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ee9d839a-6ab0-418c-8b35-c954e26cb6e8 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:41:17.337645 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-ee9d839a-6ab0-418c-8b35-c954e26cb6e8 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05573fa698bd46e88032483a6cb0ad30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a7db7a0f06b4371a79629e21c8d4bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:41:17.344693 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-ee9d839a-6ab0-418c-8b35-c954e26cb6e8 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] 10.222.0.25 "GET /compute/v2.1/servers/f634121a-0b50-440d-b976-14f1945e9dc2" status: 200 len: 1317 microversion: 2.1 time: 0.153643 Nov 09 20:41:17.345249 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1243/2516] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:41:17 2021] GET /compute/v2.1/servers/f634121a-0b50-440d-b976-14f1945e9dc2 => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:41:18.362413 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-f101aa5e-bcab-4a97-a5fb-6c7b3e7a3cf7 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:41:18.363105 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-f101aa5e-bcab-4a97-a5fb-6c7b3e7a3cf7 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] [instance: f634121a-0b50-440d-b976-14f1945e9dc2] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:41:18.369204 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f101aa5e-bcab-4a97-a5fb-6c7b3e7a3cf7 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:41:18.369655 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f101aa5e-bcab-4a97-a5fb-6c7b3e7a3cf7 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:41:18.370423 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f101aa5e-bcab-4a97-a5fb-6c7b3e7a3cf7 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:41:18.370856 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f101aa5e-bcab-4a97-a5fb-6c7b3e7a3cf7 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:41:18.500563 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-f101aa5e-bcab-4a97-a5fb-6c7b3e7a3cf7 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05573fa698bd46e88032483a6cb0ad30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a7db7a0f06b4371a79629e21c8d4bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:41:18.507989 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-f101aa5e-bcab-4a97-a5fb-6c7b3e7a3cf7 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] 10.222.0.25 "GET /compute/v2.1/servers/f634121a-0b50-440d-b976-14f1945e9dc2" status: 200 len: 1507 microversion: 2.1 time: 0.150140 Nov 09 20:41:18.509167 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1274/2517] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:41:18 2021] GET /compute/v2.1/servers/f634121a-0b50-440d-b976-14f1945e9dc2 => generated 1507 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:41:19.851660 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-294c35ac-5265-4548-a338-1022570d0739 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1783ddbe-0529-4b43-ab9e-8c1bb6712439"}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:41:19.853273 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-294c35ac-5265-4548-a338-1022570d0739 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] [instance: f634121a-0b50-440d-b976-14f1945e9dc2] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:41:19.859648 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-294c35ac-5265-4548-a338-1022570d0739 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:41:19.860097 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-294c35ac-5265-4548-a338-1022570d0739 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:41:19.861021 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-294c35ac-5265-4548-a338-1022570d0739 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:41:19.861453 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-294c35ac-5265-4548-a338-1022570d0739 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:41:20.101780 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-294c35ac-5265-4548-a338-1022570d0739 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] 10.222.0.25 "POST /compute/v2.1/servers/f634121a-0b50-440d-b976-14f1945e9dc2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.253654 Nov 09 20:41:20.103806 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1244/2518] 10.222.0.25 () {60 vars in 1322 bytes} [Tue Nov 9 20:41:19 2021] POST /compute/v2.1/servers/f634121a-0b50-440d-b976-14f1945e9dc2/os-volume_attachments => generated 194 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:41:33.968697 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-093c8610-3738-4cab-a50b-e3e3eb2684c7 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-719726457", "imageRef": "109ded43-8c19-4f17-afac-7625dcfef942", "flavorRef": "452", "networks": [{"uuid": "b06c7dbf-1a90-4fd3-b488-da69f3621cb9"}]}} {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:41:34.019330 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.network.neutron [None req-093c8610-3738-4cab-a50b-e3e3eb2684c7 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] validate_networks() for [('b06c7dbf-1a90-4fd3-b488-da69f3621cb9', None, None, None, None, None)] {{(pid=116102) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 09 20:41:34.387345 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.virt.hardware [None req-093c8610-3738-4cab-a50b-e3e3eb2684c7 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Flavor limits 0:0:0 {{(pid=116102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 09 20:41:34.387789 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.virt.hardware [None req-093c8610-3738-4cab-a50b-e3e3eb2684c7 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Image limits 0:0:0 {{(pid=116102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 09 20:41:34.388244 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.virt.hardware [None req-093c8610-3738-4cab-a50b-e3e3eb2684c7 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Flavor pref 0:0:0 {{(pid=116102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 09 20:41:34.388757 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.virt.hardware [None req-093c8610-3738-4cab-a50b-e3e3eb2684c7 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Image pref 0:0:0 {{(pid=116102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 09 20:41:34.389168 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.virt.hardware [None req-093c8610-3738-4cab-a50b-e3e3eb2684c7 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 09 20:41:34.397681 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-093c8610-3738-4cab-a50b-e3e3eb2684c7 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:41:34.398133 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-093c8610-3738-4cab-a50b-e3e3eb2684c7 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:41:34.398937 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-093c8610-3738-4cab-a50b-e3e3eb2684c7 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:41:34.399371 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-093c8610-3738-4cab-a50b-e3e3eb2684c7 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:41:34.415874 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.quota [None req-093c8610-3738-4cab-a50b-e3e3eb2684c7 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Getting quotas for project 4a7db7a0f06b4371a79629e21c8d4bdf. Resources: {'cores', 'instances', 'ram'} {{(pid=116102) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 09 20:41:34.419922 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.quota [None req-093c8610-3738-4cab-a50b-e3e3eb2684c7 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Getting quotas for user 05573fa698bd46e88032483a6cb0ad30 and project 4a7db7a0f06b4371a79629e21c8d4bdf. Resources: {'cores', 'instances', 'ram'} {{(pid=116102) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 09 20:41:34.430443 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-093c8610-3738-4cab-a50b-e3e3eb2684c7 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Going to run 1 instances... {{(pid=116102) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 09 20:41:34.432850 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-093c8610-3738-4cab-a50b-e3e3eb2684c7 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] [instance: f979bb50-149c-4173-bc59-6a77465e755e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='109ded43-8c19-4f17-afac-7625dcfef942',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 09 20:41:34.476557 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-093c8610-3738-4cab-a50b-e3e3eb2684c7 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.517046 Nov 09 20:41:34.477204 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1275/2519] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Nov 9 20:41:33 2021] POST /compute/v2.1/servers => generated 380 bytes in 518 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 09 20:41:34.488734 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-b409b3f8-91f0-4272-a5cb-975148ed66d5 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:41:34.489501 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-b409b3f8-91f0-4272-a5cb-975148ed66d5 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] [instance: f979bb50-149c-4173-bc59-6a77465e755e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:41:34.544929 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-b409b3f8-91f0-4272-a5cb-975148ed66d5 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05573fa698bd46e88032483a6cb0ad30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a7db7a0f06b4371a79629e21c8d4bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:41:34.551766 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-b409b3f8-91f0-4272-a5cb-975148ed66d5 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] 10.222.0.25 "GET /compute/v2.1/servers/f979bb50-149c-4173-bc59-6a77465e755e" status: 200 len: 1217 microversion: 2.1 time: 0.067733 Nov 09 20:41:34.552420 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1245/2520] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:41:34 2021] GET /compute/v2.1/servers/f979bb50-149c-4173-bc59-6a77465e755e => generated 1217 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:41:35.571751 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-358f2838-a6df-45ae-977f-b0c85245fe4c tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:41:35.574680 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-358f2838-a6df-45ae-977f-b0c85245fe4c tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] [instance: f979bb50-149c-4173-bc59-6a77465e755e] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:41:35.581074 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-358f2838-a6df-45ae-977f-b0c85245fe4c tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:41:35.581800 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-358f2838-a6df-45ae-977f-b0c85245fe4c tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:41:35.582810 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-358f2838-a6df-45ae-977f-b0c85245fe4c tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:41:35.583762 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-358f2838-a6df-45ae-977f-b0c85245fe4c tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:41:35.685275 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-358f2838-a6df-45ae-977f-b0c85245fe4c tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05573fa698bd46e88032483a6cb0ad30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a7db7a0f06b4371a79629e21c8d4bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:41:35.695823 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-358f2838-a6df-45ae-977f-b0c85245fe4c tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] 10.222.0.25 "GET /compute/v2.1/servers/f979bb50-149c-4173-bc59-6a77465e755e" status: 200 len: 1275 microversion: 2.1 time: 0.130629 Nov 09 20:41:35.697284 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1276/2521] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:41:35 2021] GET /compute/v2.1/servers/f979bb50-149c-4173-bc59-6a77465e755e => generated 1275 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:41:36.716981 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-71c2c97c-e51d-4853-9cdd-d936722ea20d tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:41:36.716981 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-71c2c97c-e51d-4853-9cdd-d936722ea20d tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] [instance: f979bb50-149c-4173-bc59-6a77465e755e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:41:36.723774 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-71c2c97c-e51d-4853-9cdd-d936722ea20d tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:41:36.724221 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-71c2c97c-e51d-4853-9cdd-d936722ea20d tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:41:36.725030 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-71c2c97c-e51d-4853-9cdd-d936722ea20d tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:41:36.725495 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-71c2c97c-e51d-4853-9cdd-d936722ea20d tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:41:36.874717 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-71c2c97c-e51d-4853-9cdd-d936722ea20d tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05573fa698bd46e88032483a6cb0ad30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a7db7a0f06b4371a79629e21c8d4bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:41:36.882834 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-71c2c97c-e51d-4853-9cdd-d936722ea20d tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] 10.222.0.25 "GET /compute/v2.1/servers/f979bb50-149c-4173-bc59-6a77465e755e" status: 200 len: 1317 microversion: 2.1 time: 0.172578 Nov 09 20:41:36.893740 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1246/2522] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:41:36 2021] GET /compute/v2.1/servers/f979bb50-149c-4173-bc59-6a77465e755e => generated 1317 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:41:36.910137 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [req-410e3d7e-1d37-4e3c-b774-3affa3f8dbcb req-b4fa4a58-9f63-40fc-bd2f-87efe1b203ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f979bb50-149c-4173-bc59-6a77465e755e", "tag": "8b33d53b-0014-4527-bbfc-55150cd1f6d4"}]} {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:41:36.914828 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 20:41:36.914828 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: warnings.warn(msg) Nov 09 20:41:36.923499 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [req-410e3d7e-1d37-4e3c-b774-3affa3f8dbcb req-b4fa4a58-9f63-40fc-bd2f-87efe1b203ef service nova] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:41:36.924250 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [req-410e3d7e-1d37-4e3c-b774-3affa3f8dbcb req-b4fa4a58-9f63-40fc-bd2f-87efe1b203ef service nova] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:41:36.936091 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.compute.server_external_events [req-410e3d7e-1d37-4e3c-b774-3affa3f8dbcb req-b4fa4a58-9f63-40fc-bd2f-87efe1b203ef service nova] Creating event network-changed:8b33d53b-0014-4527-bbfc-55150cd1f6d4 for instance f979bb50-149c-4173-bc59-6a77465e755e on hv-cinder-80135 Nov 09 20:41:36.941192 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [req-410e3d7e-1d37-4e3c-b774-3affa3f8dbcb req-b4fa4a58-9f63-40fc-bd2f-87efe1b203ef service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034525 Nov 09 20:41:36.943306 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1277/2523] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Nov 9 20:41:36 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:41:37.239695 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-df2d12b0-8043-4c33-bb79-8b9167984b63 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:41:37.241416 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-df2d12b0-8043-4c33-bb79-8b9167984b63 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 15eeef62-ce91-49c8-a1fc-3ba3d6d83ef7] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:41:37.255193 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-df2d12b0-8043-4c33-bb79-8b9167984b63 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:41:37.255713 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-df2d12b0-8043-4c33-bb79-8b9167984b63 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:41:37.256684 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-df2d12b0-8043-4c33-bb79-8b9167984b63 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:41:37.257293 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-df2d12b0-8043-4c33-bb79-8b9167984b63 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:41:37.349249 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.objects.instance [None req-df2d12b0-8043-4c33-bb79-8b9167984b63 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lazy-loading 'services' on Instance uuid 15eeef62-ce91-49c8-a1fc-3ba3d6d83ef7 {{(pid=116103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 09 20:41:37.423429 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-df2d12b0-8043-4c33-bb79-8b9167984b63 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "DELETE /compute/v2.1/servers/15eeef62-ce91-49c8-a1fc-3ba3d6d83ef7/os-volume_attachments/98941877-659b-44a9-a6a5-60b0adfd0de9" status: 202 len: 0 microversion: 2.1 time: 0.189867 Nov 09 20:41:37.424275 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1247/2524] 10.222.0.25 () {58 vars in 1415 bytes} [Tue Nov 9 20:41:37 2021] DELETE /compute/v2.1/servers/15eeef62-ce91-49c8-a1fc-3ba3d6d83ef7/os-volume_attachments/98941877-659b-44a9-a6a5-60b0adfd0de9 => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 09 20:41:37.901295 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-ece7fc59-3ec7-45eb-bc59-0d87c47a558d tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:41:37.901984 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-ece7fc59-3ec7-45eb-bc59-0d87c47a558d tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] [instance: f979bb50-149c-4173-bc59-6a77465e755e] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:41:37.908173 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ece7fc59-3ec7-45eb-bc59-0d87c47a558d tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:41:37.908600 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ece7fc59-3ec7-45eb-bc59-0d87c47a558d tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:41:37.909409 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ece7fc59-3ec7-45eb-bc59-0d87c47a558d tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:41:37.909840 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ece7fc59-3ec7-45eb-bc59-0d87c47a558d tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:41:38.041020 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-ece7fc59-3ec7-45eb-bc59-0d87c47a558d tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05573fa698bd46e88032483a6cb0ad30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a7db7a0f06b4371a79629e21c8d4bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:41:38.048897 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-ece7fc59-3ec7-45eb-bc59-0d87c47a558d tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] 10.222.0.25 "GET /compute/v2.1/servers/f979bb50-149c-4173-bc59-6a77465e755e" status: 200 len: 1317 microversion: 2.1 time: 0.151731 Nov 09 20:41:38.049459 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1278/2525] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:41:37 2021] GET /compute/v2.1/servers/f979bb50-149c-4173-bc59-6a77465e755e => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:41:38.536135 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-1e9b94b4-7e16-40a6-bea9-e9ea7fece727 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:41:38.536748 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-1e9b94b4-7e16-40a6-bea9-e9ea7fece727 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 15eeef62-ce91-49c8-a1fc-3ba3d6d83ef7] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:41:38.543503 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1e9b94b4-7e16-40a6-bea9-e9ea7fece727 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:41:38.543941 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1e9b94b4-7e16-40a6-bea9-e9ea7fece727 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:41:38.544727 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1e9b94b4-7e16-40a6-bea9-e9ea7fece727 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:41:38.545152 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1e9b94b4-7e16-40a6-bea9-e9ea7fece727 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:41:38.568706 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-1e9b94b4-7e16-40a6-bea9-e9ea7fece727 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 15eeef62-ce91-49c8-a1fc-3ba3d6d83ef7] Going to try to terminate instance {{(pid=116103) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 09 20:41:38.640817 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-1e9b94b4-7e16-40a6-bea9-e9ea7fece727 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "DELETE /compute/v2.1/servers/15eeef62-ce91-49c8-a1fc-3ba3d6d83ef7" status: 204 len: 0 microversion: 2.1 time: 0.108986 Nov 09 20:41:38.641404 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1248/2526] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Nov 9 20:41:38 2021] DELETE /compute/v2.1/servers/15eeef62-ce91-49c8-a1fc-3ba3d6d83ef7 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 09 20:41:38.649632 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-7b6db4da-ceee-4cd0-aa94-e8c296805117 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:41:38.650388 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-7b6db4da-ceee-4cd0-aa94-e8c296805117 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 15eeef62-ce91-49c8-a1fc-3ba3d6d83ef7] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:41:38.657900 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-7b6db4da-ceee-4cd0-aa94-e8c296805117 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:41:38.658339 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-7b6db4da-ceee-4cd0-aa94-e8c296805117 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:41:38.659104 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-7b6db4da-ceee-4cd0-aa94-e8c296805117 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:41:38.659536 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-7b6db4da-ceee-4cd0-aa94-e8c296805117 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:41:38.788507 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-7b6db4da-ceee-4cd0-aa94-e8c296805117 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:41:38.795755 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-7b6db4da-ceee-4cd0-aa94-e8c296805117 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/15eeef62-ce91-49c8-a1fc-3ba3d6d83ef7" status: 200 len: 1513 microversion: 2.1 time: 0.150210 Nov 09 20:41:38.796307 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1279/2527] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:41:38 2021] GET /compute/v2.1/servers/15eeef62-ce91-49c8-a1fc-3ba3d6d83ef7 => generated 1513 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 20:41:39.066290 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-f4885de2-47c2-4a31-90b3-af82fe493b6b tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:41:39.066901 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-f4885de2-47c2-4a31-90b3-af82fe493b6b tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] [instance: f979bb50-149c-4173-bc59-6a77465e755e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:41:39.072744 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f4885de2-47c2-4a31-90b3-af82fe493b6b tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:41:39.073943 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f4885de2-47c2-4a31-90b3-af82fe493b6b tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:41:39.074703 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f4885de2-47c2-4a31-90b3-af82fe493b6b tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:41:39.075138 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f4885de2-47c2-4a31-90b3-af82fe493b6b tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:41:39.206794 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-f4885de2-47c2-4a31-90b3-af82fe493b6b tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05573fa698bd46e88032483a6cb0ad30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a7db7a0f06b4371a79629e21c8d4bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:41:39.214278 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-f4885de2-47c2-4a31-90b3-af82fe493b6b tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] 10.222.0.25 "GET /compute/v2.1/servers/f979bb50-149c-4173-bc59-6a77465e755e" status: 200 len: 1317 microversion: 2.1 time: 0.151699 Nov 09 20:41:39.214840 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1249/2528] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:41:39 2021] GET /compute/v2.1/servers/f979bb50-149c-4173-bc59-6a77465e755e => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:41:39.813133 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-338820c6-18d8-4e8d-8dd9-d9e4c2e93064 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:41:39.813685 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-338820c6-18d8-4e8d-8dd9-d9e4c2e93064 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 15eeef62-ce91-49c8-a1fc-3ba3d6d83ef7] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:41:39.819843 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-338820c6-18d8-4e8d-8dd9-d9e4c2e93064 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:41:39.820379 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-338820c6-18d8-4e8d-8dd9-d9e4c2e93064 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:41:39.821363 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-338820c6-18d8-4e8d-8dd9-d9e4c2e93064 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:41:39.821881 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-338820c6-18d8-4e8d-8dd9-d9e4c2e93064 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:41:39.951905 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-338820c6-18d8-4e8d-8dd9-d9e4c2e93064 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:41:39.959302 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-338820c6-18d8-4e8d-8dd9-d9e4c2e93064 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/15eeef62-ce91-49c8-a1fc-3ba3d6d83ef7" status: 200 len: 1513 microversion: 2.1 time: 0.149863 Nov 09 20:41:39.959874 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1280/2529] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:41:39 2021] GET /compute/v2.1/servers/15eeef62-ce91-49c8-a1fc-3ba3d6d83ef7 => generated 1513 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:41:40.231328 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-a2fbe50f-297d-4bad-ab25-7faacc9c3b50 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:41:40.231931 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-a2fbe50f-297d-4bad-ab25-7faacc9c3b50 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] [instance: f979bb50-149c-4173-bc59-6a77465e755e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:41:40.238089 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a2fbe50f-297d-4bad-ab25-7faacc9c3b50 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:41:40.238533 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a2fbe50f-297d-4bad-ab25-7faacc9c3b50 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:41:40.239296 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a2fbe50f-297d-4bad-ab25-7faacc9c3b50 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:41:40.239726 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a2fbe50f-297d-4bad-ab25-7faacc9c3b50 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:41:40.366711 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-a2fbe50f-297d-4bad-ab25-7faacc9c3b50 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05573fa698bd46e88032483a6cb0ad30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a7db7a0f06b4371a79629e21c8d4bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:41:40.375247 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-a2fbe50f-297d-4bad-ab25-7faacc9c3b50 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] 10.222.0.25 "GET /compute/v2.1/servers/f979bb50-149c-4173-bc59-6a77465e755e" status: 200 len: 1317 microversion: 2.1 time: 0.148289 Nov 09 20:41:40.375802 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1250/2530] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:41:40 2021] GET /compute/v2.1/servers/f979bb50-149c-4173-bc59-6a77465e755e => generated 1317 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:41:40.976630 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-4af45d32-3d8f-4696-9897-0df6b931f656 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:41:40.977228 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-4af45d32-3d8f-4696-9897-0df6b931f656 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 15eeef62-ce91-49c8-a1fc-3ba3d6d83ef7] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:41:40.984054 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-4af45d32-3d8f-4696-9897-0df6b931f656 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:41:40.984524 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-4af45d32-3d8f-4696-9897-0df6b931f656 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:41:40.985284 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-4af45d32-3d8f-4696-9897-0df6b931f656 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:41:40.985709 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-4af45d32-3d8f-4696-9897-0df6b931f656 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:41:41.114947 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-4af45d32-3d8f-4696-9897-0df6b931f656 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:41:41.123003 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-4af45d32-3d8f-4696-9897-0df6b931f656 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/15eeef62-ce91-49c8-a1fc-3ba3d6d83ef7" status: 200 len: 1513 microversion: 2.1 time: 0.150036 Nov 09 20:41:41.123560 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1281/2531] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:41:40 2021] GET /compute/v2.1/servers/15eeef62-ce91-49c8-a1fc-3ba3d6d83ef7 => generated 1513 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:41:41.391402 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-f4451b3f-4e9f-4482-bed8-d21355dc2ac9 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:41:41.392028 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-f4451b3f-4e9f-4482-bed8-d21355dc2ac9 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] [instance: f979bb50-149c-4173-bc59-6a77465e755e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:41:41.398427 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f4451b3f-4e9f-4482-bed8-d21355dc2ac9 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:41:41.398874 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f4451b3f-4e9f-4482-bed8-d21355dc2ac9 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:41:41.399684 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f4451b3f-4e9f-4482-bed8-d21355dc2ac9 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:41:41.400119 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f4451b3f-4e9f-4482-bed8-d21355dc2ac9 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:41:41.528015 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-f4451b3f-4e9f-4482-bed8-d21355dc2ac9 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05573fa698bd46e88032483a6cb0ad30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a7db7a0f06b4371a79629e21c8d4bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:41:41.535082 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-f4451b3f-4e9f-4482-bed8-d21355dc2ac9 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] 10.222.0.25 "GET /compute/v2.1/servers/f979bb50-149c-4173-bc59-6a77465e755e" status: 200 len: 1317 microversion: 2.1 time: 0.147331 Nov 09 20:41:41.535650 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1251/2532] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:41:41 2021] GET /compute/v2.1/servers/f979bb50-149c-4173-bc59-6a77465e755e => generated 1317 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:41:42.141055 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-d8d3530a-affa-4a72-839d-df10bdb7da46 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:41:42.141665 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-d8d3530a-affa-4a72-839d-df10bdb7da46 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 15eeef62-ce91-49c8-a1fc-3ba3d6d83ef7] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:41:42.148104 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d8d3530a-affa-4a72-839d-df10bdb7da46 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:41:42.148601 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d8d3530a-affa-4a72-839d-df10bdb7da46 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:41:42.149380 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d8d3530a-affa-4a72-839d-df10bdb7da46 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:41:42.149817 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d8d3530a-affa-4a72-839d-df10bdb7da46 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:41:42.280585 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-d8d3530a-affa-4a72-839d-df10bdb7da46 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:41:42.289177 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-d8d3530a-affa-4a72-839d-df10bdb7da46 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/15eeef62-ce91-49c8-a1fc-3ba3d6d83ef7" status: 200 len: 1513 microversion: 2.1 time: 0.151726 Nov 09 20:41:42.289756 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1282/2533] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:41:42 2021] GET /compute/v2.1/servers/15eeef62-ce91-49c8-a1fc-3ba3d6d83ef7 => generated 1513 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:41:42.552390 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-b9e851e9-9589-44ef-8121-acb3d4ba8842 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:41:42.552998 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-b9e851e9-9589-44ef-8121-acb3d4ba8842 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] [instance: f979bb50-149c-4173-bc59-6a77465e755e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:41:42.559807 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b9e851e9-9589-44ef-8121-acb3d4ba8842 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:41:42.560245 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b9e851e9-9589-44ef-8121-acb3d4ba8842 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:41:42.561025 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b9e851e9-9589-44ef-8121-acb3d4ba8842 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:41:42.561449 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b9e851e9-9589-44ef-8121-acb3d4ba8842 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:41:42.697479 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-b9e851e9-9589-44ef-8121-acb3d4ba8842 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05573fa698bd46e88032483a6cb0ad30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a7db7a0f06b4371a79629e21c8d4bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:41:42.706909 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-b9e851e9-9589-44ef-8121-acb3d4ba8842 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] 10.222.0.25 "GET /compute/v2.1/servers/f979bb50-149c-4173-bc59-6a77465e755e" status: 200 len: 1317 microversion: 2.1 time: 0.157967 Nov 09 20:41:42.717038 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1252/2534] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:41:42 2021] GET /compute/v2.1/servers/f979bb50-149c-4173-bc59-6a77465e755e => generated 1317 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:41:42.931424 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [req-8f0879be-7145-4e62-bd06-41045553b808 req-fc943f5b-002f-4b67-9144-93356cc755e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15eeef62-ce91-49c8-a1fc-3ba3d6d83ef7", "name": "network-vif-deleted", "tag": "de952cf6-304c-4bd3-9829-b2a76fee9329"}]} {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:41:42.933774 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 20:41:42.933774 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: warnings.warn(msg) Nov 09 20:41:42.941055 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [req-8f0879be-7145-4e62-bd06-41045553b808 req-fc943f5b-002f-4b67-9144-93356cc755e8 service nova] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:41:42.941628 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [req-8f0879be-7145-4e62-bd06-41045553b808 req-fc943f5b-002f-4b67-9144-93356cc755e8 service nova] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:41:42.954004 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.compute.server_external_events [req-8f0879be-7145-4e62-bd06-41045553b808 req-fc943f5b-002f-4b67-9144-93356cc755e8 service nova] Creating event network-vif-deleted:de952cf6-304c-4bd3-9829-b2a76fee9329 for instance 15eeef62-ce91-49c8-a1fc-3ba3d6d83ef7 on hv-cinder-80135 Nov 09 20:41:42.959232 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [req-8f0879be-7145-4e62-bd06-41045553b808 req-fc943f5b-002f-4b67-9144-93356cc755e8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032074 Nov 09 20:41:42.960022 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1283/2535] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Nov 9 20:41:42 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:41:43.306799 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-ebff5163-eab3-4fb0-8e65-9d7f2e51bd40 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:41:43.308042 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-ebff5163-eab3-4fb0-8e65-9d7f2e51bd40 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 15eeef62-ce91-49c8-a1fc-3ba3d6d83ef7] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:41:43.313882 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ebff5163-eab3-4fb0-8e65-9d7f2e51bd40 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:41:43.314325 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ebff5163-eab3-4fb0-8e65-9d7f2e51bd40 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:41:43.315088 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ebff5163-eab3-4fb0-8e65-9d7f2e51bd40 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:41:43.315513 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ebff5163-eab3-4fb0-8e65-9d7f2e51bd40 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:41:43.346435 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ebff5163-eab3-4fb0-8e65-9d7f2e51bd40 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:41:43.346881 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ebff5163-eab3-4fb0-8e65-9d7f2e51bd40 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:41:43.347327 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.objects.instance [None req-ebff5163-eab3-4fb0-8e65-9d7f2e51bd40 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lazy-loading 'fault' on Instance uuid 15eeef62-ce91-49c8-a1fc-3ba3d6d83ef7 {{(pid=116103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 09 20:41:43.386612 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-ebff5163-eab3-4fb0-8e65-9d7f2e51bd40 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:41:43.393896 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-ebff5163-eab3-4fb0-8e65-9d7f2e51bd40 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/15eeef62-ce91-49c8-a1fc-3ba3d6d83ef7" status: 200 len: 1308 microversion: 2.1 time: 0.090771 Nov 09 20:41:43.394461 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1253/2536] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:41:43 2021] GET /compute/v2.1/servers/15eeef62-ce91-49c8-a1fc-3ba3d6d83ef7 => generated 1308 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:41:43.725439 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-b4144126-81c7-41d6-8661-e73e99af64b1 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:41:43.726127 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-b4144126-81c7-41d6-8661-e73e99af64b1 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] [instance: f979bb50-149c-4173-bc59-6a77465e755e] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:41:43.732860 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b4144126-81c7-41d6-8661-e73e99af64b1 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:41:43.733308 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b4144126-81c7-41d6-8661-e73e99af64b1 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:41:43.734072 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b4144126-81c7-41d6-8661-e73e99af64b1 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:41:43.734500 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-b4144126-81c7-41d6-8661-e73e99af64b1 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:41:43.862200 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-b4144126-81c7-41d6-8661-e73e99af64b1 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05573fa698bd46e88032483a6cb0ad30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a7db7a0f06b4371a79629e21c8d4bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:41:43.869274 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-b4144126-81c7-41d6-8661-e73e99af64b1 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] 10.222.0.25 "GET /compute/v2.1/servers/f979bb50-149c-4173-bc59-6a77465e755e" status: 200 len: 1317 microversion: 2.1 time: 0.148474 Nov 09 20:41:43.869832 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1284/2537] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:41:43 2021] GET /compute/v2.1/servers/f979bb50-149c-4173-bc59-6a77465e755e => generated 1317 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:41:44.410973 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-e2021533-8b77-40f3-8862-72cac28bd4c8 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:41:44.411948 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-e2021533-8b77-40f3-8862-72cac28bd4c8 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 15eeef62-ce91-49c8-a1fc-3ba3d6d83ef7] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:41:44.417978 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e2021533-8b77-40f3-8862-72cac28bd4c8 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:41:44.418413 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e2021533-8b77-40f3-8862-72cac28bd4c8 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:41:44.419176 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e2021533-8b77-40f3-8862-72cac28bd4c8 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:41:44.419598 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e2021533-8b77-40f3-8862-72cac28bd4c8 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:41:44.450224 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e2021533-8b77-40f3-8862-72cac28bd4c8 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:41:44.450662 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e2021533-8b77-40f3-8862-72cac28bd4c8 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:41:44.451098 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.objects.instance [None req-e2021533-8b77-40f3-8862-72cac28bd4c8 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lazy-loading 'fault' on Instance uuid 15eeef62-ce91-49c8-a1fc-3ba3d6d83ef7 {{(pid=116103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 09 20:41:44.491314 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-e2021533-8b77-40f3-8862-72cac28bd4c8 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:41:44.498944 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-e2021533-8b77-40f3-8862-72cac28bd4c8 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/15eeef62-ce91-49c8-a1fc-3ba3d6d83ef7" status: 200 len: 1308 microversion: 2.1 time: 0.091715 Nov 09 20:41:44.499495 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1254/2538] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:41:44 2021] GET /compute/v2.1/servers/15eeef62-ce91-49c8-a1fc-3ba3d6d83ef7 => generated 1308 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:41:44.886223 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-18d5a61f-21ed-472c-81a2-ce06d8a3e074 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:41:44.886831 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-18d5a61f-21ed-472c-81a2-ce06d8a3e074 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] [instance: f979bb50-149c-4173-bc59-6a77465e755e] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:41:44.893096 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-18d5a61f-21ed-472c-81a2-ce06d8a3e074 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:41:44.893541 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-18d5a61f-21ed-472c-81a2-ce06d8a3e074 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:41:44.894304 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-18d5a61f-21ed-472c-81a2-ce06d8a3e074 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:41:44.894735 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-18d5a61f-21ed-472c-81a2-ce06d8a3e074 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:41:45.025269 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-18d5a61f-21ed-472c-81a2-ce06d8a3e074 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05573fa698bd46e88032483a6cb0ad30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a7db7a0f06b4371a79629e21c8d4bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:41:45.032364 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-18d5a61f-21ed-472c-81a2-ce06d8a3e074 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] 10.222.0.25 "GET /compute/v2.1/servers/f979bb50-149c-4173-bc59-6a77465e755e" status: 200 len: 1317 microversion: 2.1 time: 0.149931 Nov 09 20:41:45.032946 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1285/2539] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:41:44 2021] GET /compute/v2.1/servers/f979bb50-149c-4173-bc59-6a77465e755e => generated 1317 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:41:45.516232 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-0973a69f-5ce8-4087-abad-0f49c7f8d2f5 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:41:45.516874 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-0973a69f-5ce8-4087-abad-0f49c7f8d2f5 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 15eeef62-ce91-49c8-a1fc-3ba3d6d83ef7] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:41:45.523100 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0973a69f-5ce8-4087-abad-0f49c7f8d2f5 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:41:45.523551 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0973a69f-5ce8-4087-abad-0f49c7f8d2f5 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:41:45.524317 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0973a69f-5ce8-4087-abad-0f49c7f8d2f5 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:41:45.524778 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0973a69f-5ce8-4087-abad-0f49c7f8d2f5 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:41:45.554553 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0973a69f-5ce8-4087-abad-0f49c7f8d2f5 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:41:45.554933 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0973a69f-5ce8-4087-abad-0f49c7f8d2f5 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:41:45.555375 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.objects.instance [None req-0973a69f-5ce8-4087-abad-0f49c7f8d2f5 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lazy-loading 'fault' on Instance uuid 15eeef62-ce91-49c8-a1fc-3ba3d6d83ef7 {{(pid=116103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 09 20:41:45.732301 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-0973a69f-5ce8-4087-abad-0f49c7f8d2f5 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7370bcbf19947a7bb00ab954a6f2d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb677ce693194a32b39358f5b613069f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:41:45.739468 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-0973a69f-5ce8-4087-abad-0f49c7f8d2f5 tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/15eeef62-ce91-49c8-a1fc-3ba3d6d83ef7" status: 200 len: 1308 microversion: 2.1 time: 0.226899 Nov 09 20:41:45.740025 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1255/2540] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:41:45 2021] GET /compute/v2.1/servers/15eeef62-ce91-49c8-a1fc-3ba3d6d83ef7 => generated 1308 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:41:46.027867 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [req-176b4312-8e88-4a6f-a40d-1b672adee2b2 req-b22e178f-2468-4194-be2a-41bf4ad0b88f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f979bb50-149c-4173-bc59-6a77465e755e", "name": "network-vif-plugged", "status": "completed", "tag": "8b33d53b-0014-4527-bbfc-55150cd1f6d4"}]} {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:41:46.029517 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 20:41:46.029517 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: warnings.warn(msg) Nov 09 20:41:46.037069 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [req-176b4312-8e88-4a6f-a40d-1b672adee2b2 req-b22e178f-2468-4194-be2a-41bf4ad0b88f service nova] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:41:46.037508 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [req-176b4312-8e88-4a6f-a40d-1b672adee2b2 req-b22e178f-2468-4194-be2a-41bf4ad0b88f service nova] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:41:46.048334 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-41254902-fe71-463c-9ac0-92b5fa034819 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:41:46.048820 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.compute.server_external_events [req-176b4312-8e88-4a6f-a40d-1b672adee2b2 req-b22e178f-2468-4194-be2a-41bf4ad0b88f service nova] Creating event network-vif-plugged:8b33d53b-0014-4527-bbfc-55150cd1f6d4 for instance f979bb50-149c-4173-bc59-6a77465e755e on hv-cinder-80135 Nov 09 20:41:46.048970 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-41254902-fe71-463c-9ac0-92b5fa034819 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] [instance: f979bb50-149c-4173-bc59-6a77465e755e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:41:46.053848 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [req-176b4312-8e88-4a6f-a40d-1b672adee2b2 req-b22e178f-2468-4194-be2a-41bf4ad0b88f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029697 Nov 09 20:41:46.054603 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1286/2541] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Nov 9 20:41:46 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 20:41:46.054762 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-41254902-fe71-463c-9ac0-92b5fa034819 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:41:46.055178 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-41254902-fe71-463c-9ac0-92b5fa034819 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:41:46.055956 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-41254902-fe71-463c-9ac0-92b5fa034819 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:41:46.056612 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-41254902-fe71-463c-9ac0-92b5fa034819 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:41:46.216596 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-41254902-fe71-463c-9ac0-92b5fa034819 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05573fa698bd46e88032483a6cb0ad30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a7db7a0f06b4371a79629e21c8d4bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:41:46.224907 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-41254902-fe71-463c-9ac0-92b5fa034819 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] 10.222.0.25 "GET /compute/v2.1/servers/f979bb50-149c-4173-bc59-6a77465e755e" status: 200 len: 1317 microversion: 2.1 time: 0.180121 Nov 09 20:41:46.225502 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1256/2542] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:41:46 2021] GET /compute/v2.1/servers/f979bb50-149c-4173-bc59-6a77465e755e => generated 1317 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 20:41:46.756289 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-69146dad-0de4-46ec-bfe0-a374b9bccc4a tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:41:46.756951 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-69146dad-0de4-46ec-bfe0-a374b9bccc4a tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] [instance: 15eeef62-ce91-49c8-a1fc-3ba3d6d83ef7] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:41:46.763026 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-69146dad-0de4-46ec-bfe0-a374b9bccc4a tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:41:46.763460 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-69146dad-0de4-46ec-bfe0-a374b9bccc4a tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:41:46.764216 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-69146dad-0de4-46ec-bfe0-a374b9bccc4a tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:41:46.764665 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-69146dad-0de4-46ec-bfe0-a374b9bccc4a tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:41:46.777661 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.wsgi [None req-69146dad-0de4-46ec-bfe0-a374b9bccc4a tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] HTTP exception thrown: Instance 15eeef62-ce91-49c8-a1fc-3ba3d6d83ef7 could not be found. Nov 09 20:41:46.778231 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-69146dad-0de4-46ec-bfe0-a374b9bccc4a tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] Returning 404 to user: Instance 15eeef62-ce91-49c8-a1fc-3ba3d6d83ef7 could not be found. {{(pid=116102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 09 20:41:46.779145 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-69146dad-0de4-46ec-bfe0-a374b9bccc4a tempest-VolumesSnapshotTestJSON-898776056 tempest-VolumesSnapshotTestJSON-898776056-project] 10.222.0.25 "GET /compute/v2.1/servers/15eeef62-ce91-49c8-a1fc-3ba3d6d83ef7" status: 404 len: 111 microversion: 2.1 time: 0.027257 Nov 09 20:41:46.779662 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1287/2543] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:41:46 2021] GET /compute/v2.1/servers/15eeef62-ce91-49c8-a1fc-3ba3d6d83ef7 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 09 20:41:47.243175 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-8e82bfee-0f39-402b-b710-584318379d54 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:41:47.243756 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-8e82bfee-0f39-402b-b710-584318379d54 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] [instance: f979bb50-149c-4173-bc59-6a77465e755e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:41:47.250159 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8e82bfee-0f39-402b-b710-584318379d54 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:41:47.250627 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8e82bfee-0f39-402b-b710-584318379d54 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:41:47.251410 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8e82bfee-0f39-402b-b710-584318379d54 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:41:47.251835 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8e82bfee-0f39-402b-b710-584318379d54 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:41:47.391724 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-8e82bfee-0f39-402b-b710-584318379d54 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05573fa698bd46e88032483a6cb0ad30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a7db7a0f06b4371a79629e21c8d4bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:41:47.398836 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-8e82bfee-0f39-402b-b710-584318379d54 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] 10.222.0.25 "GET /compute/v2.1/servers/f979bb50-149c-4173-bc59-6a77465e755e" status: 200 len: 1317 microversion: 2.1 time: 0.159840 Nov 09 20:41:47.399393 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1257/2544] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:41:47 2021] GET /compute/v2.1/servers/f979bb50-149c-4173-bc59-6a77465e755e => generated 1317 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:41:48.415529 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-78e735ea-13b6-4071-824d-df20dd71f1a6 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:41:48.416161 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-78e735ea-13b6-4071-824d-df20dd71f1a6 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] [instance: f979bb50-149c-4173-bc59-6a77465e755e] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:41:48.423232 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-78e735ea-13b6-4071-824d-df20dd71f1a6 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:41:48.423928 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-78e735ea-13b6-4071-824d-df20dd71f1a6 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:41:48.424737 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-78e735ea-13b6-4071-824d-df20dd71f1a6 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:41:48.425171 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-78e735ea-13b6-4071-824d-df20dd71f1a6 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:41:48.555656 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-78e735ea-13b6-4071-824d-df20dd71f1a6 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05573fa698bd46e88032483a6cb0ad30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a7db7a0f06b4371a79629e21c8d4bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:41:48.562921 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-78e735ea-13b6-4071-824d-df20dd71f1a6 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] 10.222.0.25 "GET /compute/v2.1/servers/f979bb50-149c-4173-bc59-6a77465e755e" status: 200 len: 1507 microversion: 2.1 time: 0.151077 Nov 09 20:41:48.563477 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1288/2545] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:41:48 2021] GET /compute/v2.1/servers/f979bb50-149c-4173-bc59-6a77465e755e => generated 1507 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:41:48.579827 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-b29aa62f-fcf2-4d24-a484-698a0df07065 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1783ddbe-0529-4b43-ab9e-8c1bb6712439"}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:41:48.580974 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-b29aa62f-fcf2-4d24-a484-698a0df07065 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] [instance: f979bb50-149c-4173-bc59-6a77465e755e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:41:48.587098 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b29aa62f-fcf2-4d24-a484-698a0df07065 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:41:48.587542 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b29aa62f-fcf2-4d24-a484-698a0df07065 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:41:48.588300 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b29aa62f-fcf2-4d24-a484-698a0df07065 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:41:48.589508 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b29aa62f-fcf2-4d24-a484-698a0df07065 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:41:48.664628 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.wsgi [None req-b29aa62f-fcf2-4d24-a484-698a0df07065 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] HTTP exception thrown: Invalid volume: volume 1783ddbe-0529-4b43-ab9e-8c1bb6712439 is already attached to instances: f634121a-0b50-440d-b976-14f1945e9dc2 Nov 09 20:41:48.665229 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-b29aa62f-fcf2-4d24-a484-698a0df07065 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Returning 400 to user: Invalid volume: volume 1783ddbe-0529-4b43-ab9e-8c1bb6712439 is already attached to instances: f634121a-0b50-440d-b976-14f1945e9dc2 {{(pid=116103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 09 20:41:48.666057 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-b29aa62f-fcf2-4d24-a484-698a0df07065 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] 10.222.0.25 "POST /compute/v2.1/servers/f979bb50-149c-4173-bc59-6a77465e755e/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.090025 Nov 09 20:41:48.666611 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1258/2546] 10.222.0.25 () {60 vars in 1322 bytes} [Tue Nov 9 20:41:48 2021] POST /compute/v2.1/servers/f979bb50-149c-4173-bc59-6a77465e755e/os-volume_attachments => generated 174 bytes in 91 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 09 20:41:48.723356 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-9967d5dd-d9ce-47e6-86d3-6a35cb115b6a tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:41:48.723840 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-9967d5dd-d9ce-47e6-86d3-6a35cb115b6a tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] [instance: f634121a-0b50-440d-b976-14f1945e9dc2] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:41:48.730091 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-9967d5dd-d9ce-47e6-86d3-6a35cb115b6a tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:41:48.730534 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-9967d5dd-d9ce-47e6-86d3-6a35cb115b6a tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:41:48.731305 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-9967d5dd-d9ce-47e6-86d3-6a35cb115b6a tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:41:48.731739 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-9967d5dd-d9ce-47e6-86d3-6a35cb115b6a tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:41:48.808358 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.objects.instance [None req-9967d5dd-d9ce-47e6-86d3-6a35cb115b6a tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lazy-loading 'services' on Instance uuid f634121a-0b50-440d-b976-14f1945e9dc2 {{(pid=116102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 09 20:41:48.875881 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-9967d5dd-d9ce-47e6-86d3-6a35cb115b6a tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] 10.222.0.25 "DELETE /compute/v2.1/servers/f634121a-0b50-440d-b976-14f1945e9dc2/os-volume_attachments/1783ddbe-0529-4b43-ab9e-8c1bb6712439" status: 202 len: 0 microversion: 2.1 time: 0.156006 Nov 09 20:41:48.876564 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1289/2547] 10.222.0.25 () {58 vars in 1415 bytes} [Tue Nov 9 20:41:48 2021] DELETE /compute/v2.1/servers/f634121a-0b50-440d-b976-14f1945e9dc2/os-volume_attachments/1783ddbe-0529-4b43-ab9e-8c1bb6712439 => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 09 20:41:48.884823 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-4c1b9793-a44c-4c3d-ad0f-3562b802d143 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:41:48.886030 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-4c1b9793-a44c-4c3d-ad0f-3562b802d143 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] [instance: f634121a-0b50-440d-b976-14f1945e9dc2] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:41:48.893164 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4c1b9793-a44c-4c3d-ad0f-3562b802d143 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:41:48.893600 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4c1b9793-a44c-4c3d-ad0f-3562b802d143 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:41:48.894406 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4c1b9793-a44c-4c3d-ad0f-3562b802d143 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:41:48.894880 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4c1b9793-a44c-4c3d-ad0f-3562b802d143 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:41:48.922832 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-4c1b9793-a44c-4c3d-ad0f-3562b802d143 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] 10.222.0.25 "GET /compute/v2.1/servers/f634121a-0b50-440d-b976-14f1945e9dc2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041717 Nov 09 20:41:48.923379 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1259/2548] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:41:48 2021] GET /compute/v2.1/servers/f634121a-0b50-440d-b976-14f1945e9dc2/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:41:49.935278 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-9fa8bf4e-9d10-441c-b89a-458191a8def9 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:41:49.936354 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-9fa8bf4e-9d10-441c-b89a-458191a8def9 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] [instance: f634121a-0b50-440d-b976-14f1945e9dc2] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:41:49.942511 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-9fa8bf4e-9d10-441c-b89a-458191a8def9 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:41:49.942959 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-9fa8bf4e-9d10-441c-b89a-458191a8def9 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:41:49.943730 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-9fa8bf4e-9d10-441c-b89a-458191a8def9 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:41:49.944160 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-9fa8bf4e-9d10-441c-b89a-458191a8def9 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:41:49.973383 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-9fa8bf4e-9d10-441c-b89a-458191a8def9 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] 10.222.0.25 "GET /compute/v2.1/servers/f634121a-0b50-440d-b976-14f1945e9dc2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042802 Nov 09 20:41:49.973927 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1290/2549] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:41:49 2021] GET /compute/v2.1/servers/f634121a-0b50-440d-b976-14f1945e9dc2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:41:50.985276 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-43959add-b984-4c49-bc1e-40953c15a902 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:41:50.986192 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-43959add-b984-4c49-bc1e-40953c15a902 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] [instance: f634121a-0b50-440d-b976-14f1945e9dc2] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:41:50.992476 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-43959add-b984-4c49-bc1e-40953c15a902 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:41:50.992988 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-43959add-b984-4c49-bc1e-40953c15a902 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:41:50.993760 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-43959add-b984-4c49-bc1e-40953c15a902 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:41:50.994191 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-43959add-b984-4c49-bc1e-40953c15a902 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:41:51.024178 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-43959add-b984-4c49-bc1e-40953c15a902 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] 10.222.0.25 "GET /compute/v2.1/servers/f634121a-0b50-440d-b976-14f1945e9dc2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043218 Nov 09 20:41:51.024743 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1260/2550] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:41:50 2021] GET /compute/v2.1/servers/f634121a-0b50-440d-b976-14f1945e9dc2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:41:52.035519 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-8b83f9e3-603b-4544-885e-99bd00b3d23c tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:41:52.036337 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-8b83f9e3-603b-4544-885e-99bd00b3d23c tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] [instance: f634121a-0b50-440d-b976-14f1945e9dc2] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:41:52.042460 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-8b83f9e3-603b-4544-885e-99bd00b3d23c tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:41:52.042904 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-8b83f9e3-603b-4544-885e-99bd00b3d23c tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:41:52.043853 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-8b83f9e3-603b-4544-885e-99bd00b3d23c tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:41:52.044279 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-8b83f9e3-603b-4544-885e-99bd00b3d23c tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:41:52.072028 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-8b83f9e3-603b-4544-885e-99bd00b3d23c tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] 10.222.0.25 "GET /compute/v2.1/servers/f634121a-0b50-440d-b976-14f1945e9dc2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.040364 Nov 09 20:41:52.072592 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1291/2551] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:41:52 2021] GET /compute/v2.1/servers/f634121a-0b50-440d-b976-14f1945e9dc2/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 09 20:41:52.216307 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-b0296bcc-5f79-4f36-80ba-f3d0e1744995 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1082813824", "imageRef": "109ded43-8c19-4f17-afac-7625dcfef942", "flavorRef": "452", "networks": [{"uuid": "b06c7dbf-1a90-4fd3-b488-da69f3621cb9"}]}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:41:52.269443 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.network.neutron [None req-b0296bcc-5f79-4f36-80ba-f3d0e1744995 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] validate_networks() for [('b06c7dbf-1a90-4fd3-b488-da69f3621cb9', None, None, None, None, None)] {{(pid=116103) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 09 20:41:52.906619 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.virt.hardware [None req-b0296bcc-5f79-4f36-80ba-f3d0e1744995 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Flavor limits 0:0:0 {{(pid=116103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 09 20:41:52.907064 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.virt.hardware [None req-b0296bcc-5f79-4f36-80ba-f3d0e1744995 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Image limits 0:0:0 {{(pid=116103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 09 20:41:52.907537 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.virt.hardware [None req-b0296bcc-5f79-4f36-80ba-f3d0e1744995 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Flavor pref 0:0:0 {{(pid=116103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 09 20:41:52.907942 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.virt.hardware [None req-b0296bcc-5f79-4f36-80ba-f3d0e1744995 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Image pref 0:0:0 {{(pid=116103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 09 20:41:52.908349 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.virt.hardware [None req-b0296bcc-5f79-4f36-80ba-f3d0e1744995 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 09 20:41:52.916959 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b0296bcc-5f79-4f36-80ba-f3d0e1744995 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:41:52.917403 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b0296bcc-5f79-4f36-80ba-f3d0e1744995 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:41:52.918831 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b0296bcc-5f79-4f36-80ba-f3d0e1744995 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:41:52.919269 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-b0296bcc-5f79-4f36-80ba-f3d0e1744995 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:41:52.935740 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.quota [None req-b0296bcc-5f79-4f36-80ba-f3d0e1744995 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Getting quotas for project 4a7db7a0f06b4371a79629e21c8d4bdf. Resources: {'cores', 'instances', 'ram'} {{(pid=116103) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 09 20:41:52.939668 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.quota [None req-b0296bcc-5f79-4f36-80ba-f3d0e1744995 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Getting quotas for user 05573fa698bd46e88032483a6cb0ad30 and project 4a7db7a0f06b4371a79629e21c8d4bdf. Resources: {'cores', 'instances', 'ram'} {{(pid=116103) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 09 20:41:52.950595 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-b0296bcc-5f79-4f36-80ba-f3d0e1744995 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Going to run 1 instances... {{(pid=116103) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 09 20:41:52.953052 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-b0296bcc-5f79-4f36-80ba-f3d0e1744995 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] [instance: 09b4db10-7445-4517-b195-2af2df01bb08] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='109ded43-8c19-4f17-afac-7625dcfef942',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116103) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 09 20:41:52.997348 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-b0296bcc-5f79-4f36-80ba-f3d0e1744995 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.785117 Nov 09 20:41:52.997993 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1261/2552] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Nov 9 20:41:52 2021] POST /compute/v2.1/servers => generated 380 bytes in 786 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 09 20:41:53.007700 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-548717a6-b810-4a69-93be-8fd7adf230af tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:41:53.008310 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-548717a6-b810-4a69-93be-8fd7adf230af tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] [instance: 09b4db10-7445-4517-b195-2af2df01bb08] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:41:53.066006 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-548717a6-b810-4a69-93be-8fd7adf230af tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05573fa698bd46e88032483a6cb0ad30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a7db7a0f06b4371a79629e21c8d4bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:41:53.072766 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-548717a6-b810-4a69-93be-8fd7adf230af tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] 10.222.0.25 "GET /compute/v2.1/servers/09b4db10-7445-4517-b195-2af2df01bb08" status: 200 len: 1218 microversion: 2.1 time: 0.068936 Nov 09 20:41:53.073321 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1292/2553] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:41:53 2021] GET /compute/v2.1/servers/09b4db10-7445-4517-b195-2af2df01bb08 => generated 1218 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:41:54.089853 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-c8f963e2-354f-4488-a35c-78e4c8e94982 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:41:54.090497 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-c8f963e2-354f-4488-a35c-78e4c8e94982 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] [instance: 09b4db10-7445-4517-b195-2af2df01bb08] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:41:54.096475 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c8f963e2-354f-4488-a35c-78e4c8e94982 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:41:54.096926 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c8f963e2-354f-4488-a35c-78e4c8e94982 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:41:54.097697 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c8f963e2-354f-4488-a35c-78e4c8e94982 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:41:54.098132 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c8f963e2-354f-4488-a35c-78e4c8e94982 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:41:54.156132 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-c8f963e2-354f-4488-a35c-78e4c8e94982 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05573fa698bd46e88032483a6cb0ad30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a7db7a0f06b4371a79629e21c8d4bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:41:54.163213 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-c8f963e2-354f-4488-a35c-78e4c8e94982 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] 10.222.0.25 "GET /compute/v2.1/servers/09b4db10-7445-4517-b195-2af2df01bb08" status: 200 len: 1222 microversion: 2.1 time: 0.077419 Nov 09 20:41:54.163769 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1262/2554] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:41:54 2021] GET /compute/v2.1/servers/09b4db10-7445-4517-b195-2af2df01bb08 => generated 1222 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:41:55.182430 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-5d63e9fc-0587-408f-8575-a91c7121a670 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:41:55.183021 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-5d63e9fc-0587-408f-8575-a91c7121a670 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] [instance: 09b4db10-7445-4517-b195-2af2df01bb08] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:41:55.190809 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-5d63e9fc-0587-408f-8575-a91c7121a670 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:41:55.191261 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-5d63e9fc-0587-408f-8575-a91c7121a670 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:41:55.192033 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-5d63e9fc-0587-408f-8575-a91c7121a670 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:41:55.192500 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-5d63e9fc-0587-408f-8575-a91c7121a670 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:41:55.253624 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-5d63e9fc-0587-408f-8575-a91c7121a670 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05573fa698bd46e88032483a6cb0ad30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a7db7a0f06b4371a79629e21c8d4bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:41:55.261245 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-5d63e9fc-0587-408f-8575-a91c7121a670 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] 10.222.0.25 "GET /compute/v2.1/servers/09b4db10-7445-4517-b195-2af2df01bb08" status: 200 len: 1222 microversion: 2.1 time: 0.082466 Nov 09 20:41:55.261807 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1293/2555] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:41:55 2021] GET /compute/v2.1/servers/09b4db10-7445-4517-b195-2af2df01bb08 => generated 1222 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:41:56.278814 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-9bdd2575-0f18-432c-b026-b84d92f99899 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:41:56.279643 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-9bdd2575-0f18-432c-b026-b84d92f99899 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] [instance: 09b4db10-7445-4517-b195-2af2df01bb08] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:41:56.286159 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9bdd2575-0f18-432c-b026-b84d92f99899 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:41:56.286159 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9bdd2575-0f18-432c-b026-b84d92f99899 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:41:56.286786 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9bdd2575-0f18-432c-b026-b84d92f99899 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:41:56.287209 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-9bdd2575-0f18-432c-b026-b84d92f99899 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:41:56.352596 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-9bdd2575-0f18-432c-b026-b84d92f99899 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05573fa698bd46e88032483a6cb0ad30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a7db7a0f06b4371a79629e21c8d4bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:41:56.361233 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-9bdd2575-0f18-432c-b026-b84d92f99899 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] 10.222.0.25 "GET /compute/v2.1/servers/09b4db10-7445-4517-b195-2af2df01bb08" status: 200 len: 1270 microversion: 2.1 time: 0.086608 Nov 09 20:41:56.361817 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1263/2556] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:41:56 2021] GET /compute/v2.1/servers/09b4db10-7445-4517-b195-2af2df01bb08 => generated 1270 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:41:57.378521 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-9144086d-d2f8-42ca-bf51-3290f0c6e392 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:41:57.379126 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-9144086d-d2f8-42ca-bf51-3290f0c6e392 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] [instance: 09b4db10-7445-4517-b195-2af2df01bb08] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:41:57.385599 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-9144086d-d2f8-42ca-bf51-3290f0c6e392 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:41:57.386046 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-9144086d-d2f8-42ca-bf51-3290f0c6e392 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:41:57.386822 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-9144086d-d2f8-42ca-bf51-3290f0c6e392 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:41:57.387252 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-9144086d-d2f8-42ca-bf51-3290f0c6e392 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:41:57.516986 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-9144086d-d2f8-42ca-bf51-3290f0c6e392 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05573fa698bd46e88032483a6cb0ad30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a7db7a0f06b4371a79629e21c8d4bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:41:57.524425 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-9144086d-d2f8-42ca-bf51-3290f0c6e392 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] 10.222.0.25 "GET /compute/v2.1/servers/09b4db10-7445-4517-b195-2af2df01bb08" status: 200 len: 1318 microversion: 2.1 time: 0.149509 Nov 09 20:41:57.524991 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1294/2557] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:41:57 2021] GET /compute/v2.1/servers/09b4db10-7445-4517-b195-2af2df01bb08 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:41:57.709579 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [req-eccdd077-d0ec-417f-b959-43e2237d3433 req-31c61bf1-b392-49b7-89da-37d5bb7a7904 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09b4db10-7445-4517-b195-2af2df01bb08", "tag": "1f626854-ec25-4c1a-a056-119bab20d470"}]} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:41:57.711064 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 20:41:57.711064 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: warnings.warn(msg) Nov 09 20:41:57.719015 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-eccdd077-d0ec-417f-b959-43e2237d3433 req-31c61bf1-b392-49b7-89da-37d5bb7a7904 service nova] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:41:57.719453 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-eccdd077-d0ec-417f-b959-43e2237d3433 req-31c61bf1-b392-49b7-89da-37d5bb7a7904 service nova] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:41:57.730431 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.compute.server_external_events [req-eccdd077-d0ec-417f-b959-43e2237d3433 req-31c61bf1-b392-49b7-89da-37d5bb7a7904 service nova] Creating event network-changed:1f626854-ec25-4c1a-a056-119bab20d470 for instance 09b4db10-7445-4517-b195-2af2df01bb08 on hv-cinder-80135 Nov 09 20:41:57.736076 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [req-eccdd077-d0ec-417f-b959-43e2237d3433 req-31c61bf1-b392-49b7-89da-37d5bb7a7904 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030729 Nov 09 20:41:57.736972 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1264/2558] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Nov 9 20:41:57 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:41:58.541934 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-0391e9cd-6a4f-40cd-bd38-67d1f8310515 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:41:58.542476 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-0391e9cd-6a4f-40cd-bd38-67d1f8310515 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] [instance: 09b4db10-7445-4517-b195-2af2df01bb08] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:41:58.549727 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-0391e9cd-6a4f-40cd-bd38-67d1f8310515 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:41:58.550197 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-0391e9cd-6a4f-40cd-bd38-67d1f8310515 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:41:58.550996 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-0391e9cd-6a4f-40cd-bd38-67d1f8310515 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:41:58.551622 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-0391e9cd-6a4f-40cd-bd38-67d1f8310515 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:41:58.692374 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-0391e9cd-6a4f-40cd-bd38-67d1f8310515 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05573fa698bd46e88032483a6cb0ad30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a7db7a0f06b4371a79629e21c8d4bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:41:58.699793 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-0391e9cd-6a4f-40cd-bd38-67d1f8310515 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] 10.222.0.25 "GET /compute/v2.1/servers/09b4db10-7445-4517-b195-2af2df01bb08" status: 200 len: 1318 microversion: 2.1 time: 0.161552 Nov 09 20:41:58.701012 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1295/2559] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:41:58 2021] GET /compute/v2.1/servers/09b4db10-7445-4517-b195-2af2df01bb08 => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:41:59.718918 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-a92e00b2-d35e-4259-ae24-cfab9fccc645 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:41:59.719603 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-a92e00b2-d35e-4259-ae24-cfab9fccc645 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] [instance: 09b4db10-7445-4517-b195-2af2df01bb08] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:41:59.725502 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a92e00b2-d35e-4259-ae24-cfab9fccc645 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:41:59.725938 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a92e00b2-d35e-4259-ae24-cfab9fccc645 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:41:59.726685 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a92e00b2-d35e-4259-ae24-cfab9fccc645 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:41:59.727105 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a92e00b2-d35e-4259-ae24-cfab9fccc645 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:41:59.988353 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-a92e00b2-d35e-4259-ae24-cfab9fccc645 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05573fa698bd46e88032483a6cb0ad30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a7db7a0f06b4371a79629e21c8d4bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:41:59.995474 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-a92e00b2-d35e-4259-ae24-cfab9fccc645 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] 10.222.0.25 "GET /compute/v2.1/servers/09b4db10-7445-4517-b195-2af2df01bb08" status: 200 len: 1318 microversion: 2.1 time: 0.281882 Nov 09 20:41:59.996026 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1265/2560] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:41:59 2021] GET /compute/v2.1/servers/09b4db10-7445-4517-b195-2af2df01bb08 => generated 1318 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:42:01.012506 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-ee55e0bd-7ba3-40c0-8309-c144b94eef5a tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:42:01.013264 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-ee55e0bd-7ba3-40c0-8309-c144b94eef5a tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] [instance: 09b4db10-7445-4517-b195-2af2df01bb08] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:42:01.019603 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ee55e0bd-7ba3-40c0-8309-c144b94eef5a tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:42:01.020076 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ee55e0bd-7ba3-40c0-8309-c144b94eef5a tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:42:01.020875 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ee55e0bd-7ba3-40c0-8309-c144b94eef5a tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:42:01.021306 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ee55e0bd-7ba3-40c0-8309-c144b94eef5a tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:42:01.153914 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-ee55e0bd-7ba3-40c0-8309-c144b94eef5a tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05573fa698bd46e88032483a6cb0ad30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a7db7a0f06b4371a79629e21c8d4bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:42:01.161059 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-ee55e0bd-7ba3-40c0-8309-c144b94eef5a tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] 10.222.0.25 "GET /compute/v2.1/servers/09b4db10-7445-4517-b195-2af2df01bb08" status: 200 len: 1318 microversion: 2.1 time: 0.152369 Nov 09 20:42:01.161617 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1296/2561] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:42:01 2021] GET /compute/v2.1/servers/09b4db10-7445-4517-b195-2af2df01bb08 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:42:02.178826 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-2f9a4aa5-7b61-405d-8278-c722f467e09b tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:42:02.179378 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-2f9a4aa5-7b61-405d-8278-c722f467e09b tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] [instance: 09b4db10-7445-4517-b195-2af2df01bb08] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:42:02.186149 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2f9a4aa5-7b61-405d-8278-c722f467e09b tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:42:02.186583 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2f9a4aa5-7b61-405d-8278-c722f467e09b tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:42:02.187336 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2f9a4aa5-7b61-405d-8278-c722f467e09b tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:42:02.187762 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2f9a4aa5-7b61-405d-8278-c722f467e09b tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:42:02.316999 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-2f9a4aa5-7b61-405d-8278-c722f467e09b tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05573fa698bd46e88032483a6cb0ad30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a7db7a0f06b4371a79629e21c8d4bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:42:02.324041 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-2f9a4aa5-7b61-405d-8278-c722f467e09b tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] 10.222.0.25 "GET /compute/v2.1/servers/09b4db10-7445-4517-b195-2af2df01bb08" status: 200 len: 1318 microversion: 2.1 time: 0.148917 Nov 09 20:42:02.324634 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1266/2562] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:42:02 2021] GET /compute/v2.1/servers/09b4db10-7445-4517-b195-2af2df01bb08 => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:42:03.341269 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-d5674b72-1de2-4a80-ad8c-852f83b3b0be tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:42:03.341949 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-d5674b72-1de2-4a80-ad8c-852f83b3b0be tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] [instance: 09b4db10-7445-4517-b195-2af2df01bb08] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:42:03.348306 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d5674b72-1de2-4a80-ad8c-852f83b3b0be tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:42:03.348771 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d5674b72-1de2-4a80-ad8c-852f83b3b0be tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:42:03.349534 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d5674b72-1de2-4a80-ad8c-852f83b3b0be tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:42:03.349961 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d5674b72-1de2-4a80-ad8c-852f83b3b0be tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:42:03.485652 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-d5674b72-1de2-4a80-ad8c-852f83b3b0be tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05573fa698bd46e88032483a6cb0ad30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a7db7a0f06b4371a79629e21c8d4bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:42:03.493248 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-d5674b72-1de2-4a80-ad8c-852f83b3b0be tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] 10.222.0.25 "GET /compute/v2.1/servers/09b4db10-7445-4517-b195-2af2df01bb08" status: 200 len: 1318 microversion: 2.1 time: 0.156301 Nov 09 20:42:03.493806 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1297/2563] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:42:03 2021] GET /compute/v2.1/servers/09b4db10-7445-4517-b195-2af2df01bb08 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:42:04.514194 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-f06ff2b2-0f62-4303-b2fa-b44bb092e905 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:42:04.514880 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-f06ff2b2-0f62-4303-b2fa-b44bb092e905 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] [instance: 09b4db10-7445-4517-b195-2af2df01bb08] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:42:04.521833 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f06ff2b2-0f62-4303-b2fa-b44bb092e905 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:42:04.522545 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f06ff2b2-0f62-4303-b2fa-b44bb092e905 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:42:04.524637 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f06ff2b2-0f62-4303-b2fa-b44bb092e905 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:42:04.525231 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f06ff2b2-0f62-4303-b2fa-b44bb092e905 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:42:04.665972 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-f06ff2b2-0f62-4303-b2fa-b44bb092e905 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05573fa698bd46e88032483a6cb0ad30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a7db7a0f06b4371a79629e21c8d4bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:42:04.674084 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-f06ff2b2-0f62-4303-b2fa-b44bb092e905 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] 10.222.0.25 "GET /compute/v2.1/servers/09b4db10-7445-4517-b195-2af2df01bb08" status: 200 len: 1318 microversion: 2.1 time: 0.166860 Nov 09 20:42:04.674671 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1267/2564] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:42:04 2021] GET /compute/v2.1/servers/09b4db10-7445-4517-b195-2af2df01bb08 => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:42:05.122805 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [req-938e1c3e-0d51-4396-a2c3-390038d2f292 req-705a62ea-bb61-41cc-b9ba-a3ae7aede3ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09b4db10-7445-4517-b195-2af2df01bb08", "name": "network-vif-plugged", "status": "completed", "tag": "1f626854-ec25-4c1a-a056-119bab20d470"}]} {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:42:05.124387 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 20:42:05.124387 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: warnings.warn(msg) Nov 09 20:42:05.131773 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [req-938e1c3e-0d51-4396-a2c3-390038d2f292 req-705a62ea-bb61-41cc-b9ba-a3ae7aede3ba service nova] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:42:05.132206 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [req-938e1c3e-0d51-4396-a2c3-390038d2f292 req-705a62ea-bb61-41cc-b9ba-a3ae7aede3ba service nova] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:42:05.143581 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.compute.server_external_events [req-938e1c3e-0d51-4396-a2c3-390038d2f292 req-705a62ea-bb61-41cc-b9ba-a3ae7aede3ba service nova] Creating event network-vif-plugged:1f626854-ec25-4c1a-a056-119bab20d470 for instance 09b4db10-7445-4517-b195-2af2df01bb08 on hv-cinder-80135 Nov 09 20:42:05.148532 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [req-938e1c3e-0d51-4396-a2c3-390038d2f292 req-705a62ea-bb61-41cc-b9ba-a3ae7aede3ba service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030033 Nov 09 20:42:05.149113 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1298/2565] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Nov 9 20:42:05 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:42:05.690975 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-627a984f-62ca-44a3-982b-00cb15ae6fe9 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:42:05.691574 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-627a984f-62ca-44a3-982b-00cb15ae6fe9 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] [instance: 09b4db10-7445-4517-b195-2af2df01bb08] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:42:05.697781 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-627a984f-62ca-44a3-982b-00cb15ae6fe9 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:42:05.698223 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-627a984f-62ca-44a3-982b-00cb15ae6fe9 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:42:05.698980 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-627a984f-62ca-44a3-982b-00cb15ae6fe9 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:42:05.699403 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-627a984f-62ca-44a3-982b-00cb15ae6fe9 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:42:05.832760 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-627a984f-62ca-44a3-982b-00cb15ae6fe9 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05573fa698bd46e88032483a6cb0ad30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a7db7a0f06b4371a79629e21c8d4bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:42:05.839844 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-627a984f-62ca-44a3-982b-00cb15ae6fe9 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] 10.222.0.25 "GET /compute/v2.1/servers/09b4db10-7445-4517-b195-2af2df01bb08" status: 200 len: 1318 microversion: 2.1 time: 0.152454 Nov 09 20:42:05.840944 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1268/2566] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:42:05 2021] GET /compute/v2.1/servers/09b4db10-7445-4517-b195-2af2df01bb08 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:42:06.858893 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-6cb144dd-94db-487a-990b-a270b190d038 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:42:06.859583 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-6cb144dd-94db-487a-990b-a270b190d038 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] [instance: 09b4db10-7445-4517-b195-2af2df01bb08] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:42:06.865934 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6cb144dd-94db-487a-990b-a270b190d038 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:42:06.866375 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6cb144dd-94db-487a-990b-a270b190d038 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:42:06.867155 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6cb144dd-94db-487a-990b-a270b190d038 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:42:06.867583 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6cb144dd-94db-487a-990b-a270b190d038 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:42:07.008051 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-6cb144dd-94db-487a-990b-a270b190d038 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05573fa698bd46e88032483a6cb0ad30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a7db7a0f06b4371a79629e21c8d4bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:42:07.016920 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-6cb144dd-94db-487a-990b-a270b190d038 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] 10.222.0.25 "GET /compute/v2.1/servers/09b4db10-7445-4517-b195-2af2df01bb08" status: 200 len: 1507 microversion: 2.1 time: 0.162923 Nov 09 20:42:07.017505 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1299/2567] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:42:06 2021] GET /compute/v2.1/servers/09b4db10-7445-4517-b195-2af2df01bb08 => generated 1507 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:42:08.337099 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-88cf3856-8aa3-44ab-92ed-674c491f86f7 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6252a4e2-129c-4bc9-9862-7da7b145e372"}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:42:08.338222 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-88cf3856-8aa3-44ab-92ed-674c491f86f7 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] [instance: 09b4db10-7445-4517-b195-2af2df01bb08] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:42:08.344640 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-88cf3856-8aa3-44ab-92ed-674c491f86f7 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:42:08.345029 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-88cf3856-8aa3-44ab-92ed-674c491f86f7 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:42:08.345785 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-88cf3856-8aa3-44ab-92ed-674c491f86f7 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:42:08.346208 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-88cf3856-8aa3-44ab-92ed-674c491f86f7 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:42:08.579641 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-88cf3856-8aa3-44ab-92ed-674c491f86f7 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] 10.222.0.25 "POST /compute/v2.1/servers/09b4db10-7445-4517-b195-2af2df01bb08/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.246102 Nov 09 20:42:08.580241 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1269/2568] 10.222.0.25 () {60 vars in 1322 bytes} [Tue Nov 9 20:42:08 2021] POST /compute/v2.1/servers/09b4db10-7445-4517-b195-2af2df01bb08/os-volume_attachments => generated 194 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:42:16.041901 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-0c3d16bd-83ff-4393-a2e6-4e898ba4028e tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6252a4e2-129c-4bc9-9862-7da7b145e372"}} {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:42:16.042944 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-0c3d16bd-83ff-4393-a2e6-4e898ba4028e tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] [instance: 09b4db10-7445-4517-b195-2af2df01bb08] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:42:16.049670 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-0c3d16bd-83ff-4393-a2e6-4e898ba4028e tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:42:16.050113 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-0c3d16bd-83ff-4393-a2e6-4e898ba4028e tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:42:16.050873 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-0c3d16bd-83ff-4393-a2e6-4e898ba4028e tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:42:16.051299 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-0c3d16bd-83ff-4393-a2e6-4e898ba4028e tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:42:16.128120 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.wsgi [None req-0c3d16bd-83ff-4393-a2e6-4e898ba4028e tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] HTTP exception thrown: Invalid volume: volume 6252a4e2-129c-4bc9-9862-7da7b145e372 is already attached to instances: 09b4db10-7445-4517-b195-2af2df01bb08 Nov 09 20:42:16.128822 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-0c3d16bd-83ff-4393-a2e6-4e898ba4028e tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Returning 400 to user: Invalid volume: volume 6252a4e2-129c-4bc9-9862-7da7b145e372 is already attached to instances: 09b4db10-7445-4517-b195-2af2df01bb08 {{(pid=116102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 09 20:42:16.129572 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-0c3d16bd-83ff-4393-a2e6-4e898ba4028e tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] 10.222.0.25 "POST /compute/v2.1/servers/09b4db10-7445-4517-b195-2af2df01bb08/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.091645 Nov 09 20:42:16.130511 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1300/2569] 10.222.0.25 () {60 vars in 1322 bytes} [Tue Nov 9 20:42:16 2021] POST /compute/v2.1/servers/09b4db10-7445-4517-b195-2af2df01bb08/os-volume_attachments => generated 174 bytes in 93 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 09 20:42:16.190357 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-f06b0c42-6bb3-415e-9f3f-a82981ba4453 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:42:16.190896 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-f06b0c42-6bb3-415e-9f3f-a82981ba4453 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] [instance: 09b4db10-7445-4517-b195-2af2df01bb08] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:42:16.196894 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f06b0c42-6bb3-415e-9f3f-a82981ba4453 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:42:16.197367 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f06b0c42-6bb3-415e-9f3f-a82981ba4453 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:42:16.198160 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f06b0c42-6bb3-415e-9f3f-a82981ba4453 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:42:16.198585 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-f06b0c42-6bb3-415e-9f3f-a82981ba4453 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:42:16.279695 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.objects.instance [None req-f06b0c42-6bb3-415e-9f3f-a82981ba4453 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lazy-loading 'services' on Instance uuid 09b4db10-7445-4517-b195-2af2df01bb08 {{(pid=116103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 09 20:42:16.349785 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-f06b0c42-6bb3-415e-9f3f-a82981ba4453 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] 10.222.0.25 "DELETE /compute/v2.1/servers/09b4db10-7445-4517-b195-2af2df01bb08/os-volume_attachments/6252a4e2-129c-4bc9-9862-7da7b145e372" status: 202 len: 0 microversion: 2.1 time: 0.163784 Nov 09 20:42:16.350598 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1270/2570] 10.222.0.25 () {58 vars in 1415 bytes} [Tue Nov 9 20:42:16 2021] DELETE /compute/v2.1/servers/09b4db10-7445-4517-b195-2af2df01bb08/os-volume_attachments/6252a4e2-129c-4bc9-9862-7da7b145e372 => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 09 20:42:16.360223 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-d12c2613-c03b-41eb-8c69-7976631a8624 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:42:16.361480 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-d12c2613-c03b-41eb-8c69-7976631a8624 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] [instance: 09b4db10-7445-4517-b195-2af2df01bb08] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:42:16.368832 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d12c2613-c03b-41eb-8c69-7976631a8624 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:42:16.369314 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d12c2613-c03b-41eb-8c69-7976631a8624 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:42:16.370237 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d12c2613-c03b-41eb-8c69-7976631a8624 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:42:16.370759 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d12c2613-c03b-41eb-8c69-7976631a8624 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:42:16.402391 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-d12c2613-c03b-41eb-8c69-7976631a8624 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] 10.222.0.25 "GET /compute/v2.1/servers/09b4db10-7445-4517-b195-2af2df01bb08/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047218 Nov 09 20:42:16.402983 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1301/2571] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:42:16 2021] GET /compute/v2.1/servers/09b4db10-7445-4517-b195-2af2df01bb08/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 20:42:17.414606 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-bca1c2d2-c834-4eec-a4b0-6964e13a4287 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:42:17.415660 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-bca1c2d2-c834-4eec-a4b0-6964e13a4287 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] [instance: 09b4db10-7445-4517-b195-2af2df01bb08] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:42:17.433056 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bca1c2d2-c834-4eec-a4b0-6964e13a4287 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:42:17.433503 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bca1c2d2-c834-4eec-a4b0-6964e13a4287 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:42:17.434315 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bca1c2d2-c834-4eec-a4b0-6964e13a4287 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:42:17.434726 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bca1c2d2-c834-4eec-a4b0-6964e13a4287 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:42:17.471821 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-bca1c2d2-c834-4eec-a4b0-6964e13a4287 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] 10.222.0.25 "GET /compute/v2.1/servers/09b4db10-7445-4517-b195-2af2df01bb08/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.061753 Nov 09 20:42:17.472412 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1271/2572] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:42:17 2021] GET /compute/v2.1/servers/09b4db10-7445-4517-b195-2af2df01bb08/os-volume_attachments => generated 25 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 09 20:42:17.620386 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-eaca508b-ee38-49a6-9a0a-48c523adac50 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-75365682", "imageRef": "109ded43-8c19-4f17-afac-7625dcfef942", "flavorRef": "452", "networks": [{"uuid": "b06c7dbf-1a90-4fd3-b488-da69f3621cb9"}]}} {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:42:17.863469 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.network.neutron [None req-eaca508b-ee38-49a6-9a0a-48c523adac50 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] validate_networks() for [('b06c7dbf-1a90-4fd3-b488-da69f3621cb9', None, None, None, None, None)] {{(pid=116102) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 09 20:42:18.484100 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.virt.hardware [None req-eaca508b-ee38-49a6-9a0a-48c523adac50 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Flavor limits 0:0:0 {{(pid=116102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 09 20:42:18.485645 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.virt.hardware [None req-eaca508b-ee38-49a6-9a0a-48c523adac50 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Image limits 0:0:0 {{(pid=116102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 09 20:42:18.486202 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.virt.hardware [None req-eaca508b-ee38-49a6-9a0a-48c523adac50 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Flavor pref 0:0:0 {{(pid=116102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 09 20:42:18.486679 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.virt.hardware [None req-eaca508b-ee38-49a6-9a0a-48c523adac50 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Image pref 0:0:0 {{(pid=116102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 09 20:42:18.487344 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.virt.hardware [None req-eaca508b-ee38-49a6-9a0a-48c523adac50 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 09 20:42:18.499066 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-eaca508b-ee38-49a6-9a0a-48c523adac50 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:42:18.499515 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-eaca508b-ee38-49a6-9a0a-48c523adac50 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:42:18.501497 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-eaca508b-ee38-49a6-9a0a-48c523adac50 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:42:18.503108 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-eaca508b-ee38-49a6-9a0a-48c523adac50 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:42:18.544912 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.quota [None req-eaca508b-ee38-49a6-9a0a-48c523adac50 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Getting quotas for project 4a7db7a0f06b4371a79629e21c8d4bdf. Resources: {'cores', 'instances', 'ram'} {{(pid=116102) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 09 20:42:18.549661 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.quota [None req-eaca508b-ee38-49a6-9a0a-48c523adac50 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Getting quotas for user 05573fa698bd46e88032483a6cb0ad30 and project 4a7db7a0f06b4371a79629e21c8d4bdf. Resources: {'cores', 'instances', 'ram'} {{(pid=116102) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 09 20:42:18.561359 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-eaca508b-ee38-49a6-9a0a-48c523adac50 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Going to run 1 instances... {{(pid=116102) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 09 20:42:18.565895 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-eaca508b-ee38-49a6-9a0a-48c523adac50 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] [instance: a7cdc6a6-8316-4a58-a96d-3ff71cb10927] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='109ded43-8c19-4f17-afac-7625dcfef942',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 09 20:42:18.617177 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-eaca508b-ee38-49a6-9a0a-48c523adac50 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.001186 Nov 09 20:42:18.623363 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1302/2573] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Nov 9 20:42:17 2021] POST /compute/v2.1/servers => generated 380 bytes in 1008 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 09 20:42:18.640444 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-f68a67b3-8026-4ce3-88ae-a9b31506bbb1 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:42:18.641666 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-f68a67b3-8026-4ce3-88ae-a9b31506bbb1 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] [instance: a7cdc6a6-8316-4a58-a96d-3ff71cb10927] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:42:18.734978 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-f68a67b3-8026-4ce3-88ae-a9b31506bbb1 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05573fa698bd46e88032483a6cb0ad30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a7db7a0f06b4371a79629e21c8d4bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:42:18.743897 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-f68a67b3-8026-4ce3-88ae-a9b31506bbb1 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] 10.222.0.25 "GET /compute/v2.1/servers/a7cdc6a6-8316-4a58-a96d-3ff71cb10927" status: 200 len: 1216 microversion: 2.1 time: 0.119675 Nov 09 20:42:18.744492 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1272/2574] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:42:18 2021] GET /compute/v2.1/servers/a7cdc6a6-8316-4a58-a96d-3ff71cb10927 => generated 1216 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 20:42:19.761910 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-8471d563-d2a8-41c1-9768-0697e6aba028 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:42:19.762615 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-8471d563-d2a8-41c1-9768-0697e6aba028 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] [instance: a7cdc6a6-8316-4a58-a96d-3ff71cb10927] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:42:19.775992 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-8471d563-d2a8-41c1-9768-0697e6aba028 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:42:19.776471 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-8471d563-d2a8-41c1-9768-0697e6aba028 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:42:19.777749 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-8471d563-d2a8-41c1-9768-0697e6aba028 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:42:19.778383 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-8471d563-d2a8-41c1-9768-0697e6aba028 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:42:19.881729 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-8471d563-d2a8-41c1-9768-0697e6aba028 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05573fa698bd46e88032483a6cb0ad30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a7db7a0f06b4371a79629e21c8d4bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:42:19.897756 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-8471d563-d2a8-41c1-9768-0697e6aba028 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] 10.222.0.25 "GET /compute/v2.1/servers/a7cdc6a6-8316-4a58-a96d-3ff71cb10927" status: 200 len: 1286 microversion: 2.1 time: 0.134191 Nov 09 20:42:19.898407 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1303/2575] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:42:19 2021] GET /compute/v2.1/servers/a7cdc6a6-8316-4a58-a96d-3ff71cb10927 => generated 1286 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:42:20.915460 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-3179826e-0e30-44ca-ab1a-c834a80bd6a3 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:42:20.916022 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-3179826e-0e30-44ca-ab1a-c834a80bd6a3 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] [instance: a7cdc6a6-8316-4a58-a96d-3ff71cb10927] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:42:20.926787 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3179826e-0e30-44ca-ab1a-c834a80bd6a3 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:42:20.927242 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3179826e-0e30-44ca-ab1a-c834a80bd6a3 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:42:20.928042 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3179826e-0e30-44ca-ab1a-c834a80bd6a3 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:42:20.931668 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3179826e-0e30-44ca-ab1a-c834a80bd6a3 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:42:21.226605 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-3179826e-0e30-44ca-ab1a-c834a80bd6a3 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05573fa698bd46e88032483a6cb0ad30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a7db7a0f06b4371a79629e21c8d4bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:42:21.236241 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-3179826e-0e30-44ca-ab1a-c834a80bd6a3 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] 10.222.0.25 "GET /compute/v2.1/servers/a7cdc6a6-8316-4a58-a96d-3ff71cb10927" status: 200 len: 1316 microversion: 2.1 time: 0.323974 Nov 09 20:42:21.236994 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1273/2576] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:42:20 2021] GET /compute/v2.1/servers/a7cdc6a6-8316-4a58-a96d-3ff71cb10927 => generated 1316 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:42:21.444012 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [req-417f8d49-e66d-4bf2-889c-52c228bcef13 req-af9bb2af-45d0-4c2e-98f3-25c5983a7b13 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7cdc6a6-8316-4a58-a96d-3ff71cb10927", "tag": "bf961d0b-5889-4d82-878d-8cc65cabd158"}]} {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:42:21.445648 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 20:42:21.445648 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: warnings.warn(msg) Nov 09 20:42:21.469843 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [req-417f8d49-e66d-4bf2-889c-52c228bcef13 req-af9bb2af-45d0-4c2e-98f3-25c5983a7b13 service nova] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:42:21.473738 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [req-417f8d49-e66d-4bf2-889c-52c228bcef13 req-af9bb2af-45d0-4c2e-98f3-25c5983a7b13 service nova] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:42:21.492545 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.compute.server_external_events [req-417f8d49-e66d-4bf2-889c-52c228bcef13 req-af9bb2af-45d0-4c2e-98f3-25c5983a7b13 service nova] Creating event network-changed:bf961d0b-5889-4d82-878d-8cc65cabd158 for instance a7cdc6a6-8316-4a58-a96d-3ff71cb10927 on hv-cinder-80135 Nov 09 20:42:21.497613 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [req-417f8d49-e66d-4bf2-889c-52c228bcef13 req-af9bb2af-45d0-4c2e-98f3-25c5983a7b13 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057131 Nov 09 20:42:21.498387 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1304/2577] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Nov 9 20:42:21 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:42:22.253624 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-ba2fceb5-21ae-4c1f-b89f-8f1b6a5de826 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:42:22.254692 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-ba2fceb5-21ae-4c1f-b89f-8f1b6a5de826 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] [instance: a7cdc6a6-8316-4a58-a96d-3ff71cb10927] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:42:22.263606 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ba2fceb5-21ae-4c1f-b89f-8f1b6a5de826 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:42:22.264290 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ba2fceb5-21ae-4c1f-b89f-8f1b6a5de826 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:42:22.265129 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ba2fceb5-21ae-4c1f-b89f-8f1b6a5de826 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:42:22.265894 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-ba2fceb5-21ae-4c1f-b89f-8f1b6a5de826 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:42:22.424187 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-ba2fceb5-21ae-4c1f-b89f-8f1b6a5de826 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05573fa698bd46e88032483a6cb0ad30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a7db7a0f06b4371a79629e21c8d4bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:42:22.431471 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-ba2fceb5-21ae-4c1f-b89f-8f1b6a5de826 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] 10.222.0.25 "GET /compute/v2.1/servers/a7cdc6a6-8316-4a58-a96d-3ff71cb10927" status: 200 len: 1316 microversion: 2.1 time: 0.181984 Nov 09 20:42:22.432129 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1274/2578] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:42:22 2021] GET /compute/v2.1/servers/a7cdc6a6-8316-4a58-a96d-3ff71cb10927 => generated 1316 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:42:23.450143 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-e10ec4b6-628e-48d0-bc34-e5a5587fad68 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:42:23.451093 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-e10ec4b6-628e-48d0-bc34-e5a5587fad68 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] [instance: a7cdc6a6-8316-4a58-a96d-3ff71cb10927] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:42:23.458490 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e10ec4b6-628e-48d0-bc34-e5a5587fad68 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:42:23.459020 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e10ec4b6-628e-48d0-bc34-e5a5587fad68 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:42:23.459866 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e10ec4b6-628e-48d0-bc34-e5a5587fad68 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:42:23.460364 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e10ec4b6-628e-48d0-bc34-e5a5587fad68 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:42:23.689605 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-e10ec4b6-628e-48d0-bc34-e5a5587fad68 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05573fa698bd46e88032483a6cb0ad30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a7db7a0f06b4371a79629e21c8d4bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:42:23.698707 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-e10ec4b6-628e-48d0-bc34-e5a5587fad68 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] 10.222.0.25 "GET /compute/v2.1/servers/a7cdc6a6-8316-4a58-a96d-3ff71cb10927" status: 200 len: 1316 microversion: 2.1 time: 0.252573 Nov 09 20:42:23.699384 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1305/2579] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:42:23 2021] GET /compute/v2.1/servers/a7cdc6a6-8316-4a58-a96d-3ff71cb10927 => generated 1316 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:42:24.715980 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-0ad2b556-74cb-4a24-a513-104c73ee23dc tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:42:24.717033 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-0ad2b556-74cb-4a24-a513-104c73ee23dc tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] [instance: a7cdc6a6-8316-4a58-a96d-3ff71cb10927] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:42:24.763987 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0ad2b556-74cb-4a24-a513-104c73ee23dc tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:42:24.764841 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0ad2b556-74cb-4a24-a513-104c73ee23dc tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:42:24.769089 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0ad2b556-74cb-4a24-a513-104c73ee23dc tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:42:24.769763 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0ad2b556-74cb-4a24-a513-104c73ee23dc tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:42:24.995420 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-0ad2b556-74cb-4a24-a513-104c73ee23dc tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05573fa698bd46e88032483a6cb0ad30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a7db7a0f06b4371a79629e21c8d4bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:42:25.004729 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-0ad2b556-74cb-4a24-a513-104c73ee23dc tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] 10.222.0.25 "GET /compute/v2.1/servers/a7cdc6a6-8316-4a58-a96d-3ff71cb10927" status: 200 len: 1316 microversion: 2.1 time: 0.292187 Nov 09 20:42:25.005722 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1275/2580] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:42:24 2021] GET /compute/v2.1/servers/a7cdc6a6-8316-4a58-a96d-3ff71cb10927 => generated 1316 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:42:26.022468 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-427919e3-6d54-4c15-83b9-193c0d45f6ea tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:42:26.023270 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-427919e3-6d54-4c15-83b9-193c0d45f6ea tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] [instance: a7cdc6a6-8316-4a58-a96d-3ff71cb10927] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:42:26.033562 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-427919e3-6d54-4c15-83b9-193c0d45f6ea tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:42:26.039280 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-427919e3-6d54-4c15-83b9-193c0d45f6ea tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:42:26.040277 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-427919e3-6d54-4c15-83b9-193c0d45f6ea tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:42:26.040850 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-427919e3-6d54-4c15-83b9-193c0d45f6ea tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:42:26.668900 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-427919e3-6d54-4c15-83b9-193c0d45f6ea tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05573fa698bd46e88032483a6cb0ad30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a7db7a0f06b4371a79629e21c8d4bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:42:26.689072 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-427919e3-6d54-4c15-83b9-193c0d45f6ea tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] 10.222.0.25 "GET /compute/v2.1/servers/a7cdc6a6-8316-4a58-a96d-3ff71cb10927" status: 200 len: 1316 microversion: 2.1 time: 0.670499 Nov 09 20:42:26.693279 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1306/2581] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:42:26 2021] GET /compute/v2.1/servers/a7cdc6a6-8316-4a58-a96d-3ff71cb10927 => generated 1316 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:42:27.707385 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-a9c834ce-7ecb-4ed8-a639-82b6d0e01dca tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:42:27.708001 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-a9c834ce-7ecb-4ed8-a639-82b6d0e01dca tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] [instance: a7cdc6a6-8316-4a58-a96d-3ff71cb10927] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:42:27.714378 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a9c834ce-7ecb-4ed8-a639-82b6d0e01dca tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:42:27.714919 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a9c834ce-7ecb-4ed8-a639-82b6d0e01dca tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:42:27.715764 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a9c834ce-7ecb-4ed8-a639-82b6d0e01dca tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:42:27.716332 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a9c834ce-7ecb-4ed8-a639-82b6d0e01dca tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:42:27.733405 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-20857135-9767-4ebc-9ade-76cf6adf6fd1 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Action: 'create', calling method: .version_select at 0x7fab3fdd1b80>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-2081092357"}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:42:27.747860 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.quota [None req-20857135-9767-4ebc-9ade-76cf6adf6fd1 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Getting quotas for project 9858a3c560894023a1fdd7e30f9759da. Resources: {'key_pairs'} {{(pid=116103) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 09 20:42:27.752760 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.quota [None req-20857135-9767-4ebc-9ade-76cf6adf6fd1 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Getting quotas for user 03d26c07791240fcac7bcf26606fce8f and project 9858a3c560894023a1fdd7e30f9759da. Resources: {'key_pairs'} {{(pid=116103) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 09 20:42:27.858118 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-a9c834ce-7ecb-4ed8-a639-82b6d0e01dca tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05573fa698bd46e88032483a6cb0ad30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a7db7a0f06b4371a79629e21c8d4bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:42:27.865813 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-a9c834ce-7ecb-4ed8-a639-82b6d0e01dca tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] 10.222.0.25 "GET /compute/v2.1/servers/a7cdc6a6-8316-4a58-a96d-3ff71cb10927" status: 200 len: 1316 microversion: 2.1 time: 0.163779 Nov 09 20:42:27.866399 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1307/2582] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:42:27 2021] GET /compute/v2.1/servers/a7cdc6a6-8316-4a58-a96d-3ff71cb10927 => generated 1316 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:42:28.243840 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.quota [None req-20857135-9767-4ebc-9ade-76cf6adf6fd1 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Getting quotas for project 9858a3c560894023a1fdd7e30f9759da. Resources: {'key_pairs'} {{(pid=116103) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 09 20:42:28.247553 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.quota [None req-20857135-9767-4ebc-9ade-76cf6adf6fd1 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Getting quotas for user 03d26c07791240fcac7bcf26606fce8f and project 9858a3c560894023a1fdd7e30f9759da. Resources: {'key_pairs'} {{(pid=116103) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 09 20:42:28.260519 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-20857135-9767-4ebc-9ade-76cf6adf6fd1 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 2319 microversion: 2.1 time: 0.693879 Nov 09 20:42:28.261113 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1276/2583] 10.222.0.25 () {60 vars in 1157 bytes} [Tue Nov 9 20:42:27 2021] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:42:28.883661 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-c1295034-c47f-4b5d-93ae-a9149b425722 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:42:28.884270 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-c1295034-c47f-4b5d-93ae-a9149b425722 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] [instance: a7cdc6a6-8316-4a58-a96d-3ff71cb10927] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:42:28.894698 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c1295034-c47f-4b5d-93ae-a9149b425722 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:42:28.895298 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c1295034-c47f-4b5d-93ae-a9149b425722 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:42:28.896429 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c1295034-c47f-4b5d-93ae-a9149b425722 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:42:28.896986 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c1295034-c47f-4b5d-93ae-a9149b425722 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:42:29.110460 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-c1295034-c47f-4b5d-93ae-a9149b425722 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05573fa698bd46e88032483a6cb0ad30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a7db7a0f06b4371a79629e21c8d4bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:42:29.118636 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-c1295034-c47f-4b5d-93ae-a9149b425722 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] 10.222.0.25 "GET /compute/v2.1/servers/a7cdc6a6-8316-4a58-a96d-3ff71cb10927" status: 200 len: 1316 microversion: 2.1 time: 0.239338 Nov 09 20:42:29.119213 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1308/2584] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:42:28 2021] GET /compute/v2.1/servers/a7cdc6a6-8316-4a58-a96d-3ff71cb10927 => generated 1316 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:42:29.716642 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [req-4722dd11-bc37-4f5a-b530-cea4862e00eb req-24744d7e-189f-45d2-b5fd-d3fe224d5ba7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7cdc6a6-8316-4a58-a96d-3ff71cb10927", "name": "network-vif-plugged", "status": "completed", "tag": "bf961d0b-5889-4d82-878d-8cc65cabd158"}]} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:42:29.720143 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 20:42:29.720143 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: warnings.warn(msg) Nov 09 20:42:29.730264 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-4722dd11-bc37-4f5a-b530-cea4862e00eb req-24744d7e-189f-45d2-b5fd-d3fe224d5ba7 service nova] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:42:29.730848 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-4722dd11-bc37-4f5a-b530-cea4862e00eb req-24744d7e-189f-45d2-b5fd-d3fe224d5ba7 service nova] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:42:29.742763 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.compute.server_external_events [req-4722dd11-bc37-4f5a-b530-cea4862e00eb req-24744d7e-189f-45d2-b5fd-d3fe224d5ba7 service nova] Creating event network-vif-plugged:bf961d0b-5889-4d82-878d-8cc65cabd158 for instance a7cdc6a6-8316-4a58-a96d-3ff71cb10927 on hv-cinder-80135 Nov 09 20:42:29.748328 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [req-4722dd11-bc37-4f5a-b530-cea4862e00eb req-24744d7e-189f-45d2-b5fd-d3fe224d5ba7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036692 Nov 09 20:42:29.749349 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1277/2585] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Nov 9 20:42:29 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:42:30.135221 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-26b2c526-1e28-4b8e-81bd-542cf7d2ab78 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:42:30.135828 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-26b2c526-1e28-4b8e-81bd-542cf7d2ab78 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] [instance: a7cdc6a6-8316-4a58-a96d-3ff71cb10927] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:42:30.145100 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-26b2c526-1e28-4b8e-81bd-542cf7d2ab78 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:42:30.145570 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-26b2c526-1e28-4b8e-81bd-542cf7d2ab78 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:42:30.146357 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-26b2c526-1e28-4b8e-81bd-542cf7d2ab78 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:42:30.147043 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-26b2c526-1e28-4b8e-81bd-542cf7d2ab78 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:42:30.346975 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-26b2c526-1e28-4b8e-81bd-542cf7d2ab78 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05573fa698bd46e88032483a6cb0ad30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a7db7a0f06b4371a79629e21c8d4bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:42:30.355394 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-26b2c526-1e28-4b8e-81bd-542cf7d2ab78 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] 10.222.0.25 "GET /compute/v2.1/servers/a7cdc6a6-8316-4a58-a96d-3ff71cb10927" status: 200 len: 1316 microversion: 2.1 time: 0.223635 Nov 09 20:42:30.356072 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1309/2586] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:42:30 2021] GET /compute/v2.1/servers/a7cdc6a6-8316-4a58-a96d-3ff71cb10927 => generated 1316 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:42:31.376698 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-3f3352a9-f3f9-45e3-98ad-2395fac0f783 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:42:31.377708 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-3f3352a9-f3f9-45e3-98ad-2395fac0f783 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] [instance: a7cdc6a6-8316-4a58-a96d-3ff71cb10927] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:42:31.387438 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3f3352a9-f3f9-45e3-98ad-2395fac0f783 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:42:31.387880 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3f3352a9-f3f9-45e3-98ad-2395fac0f783 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:42:31.388896 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3f3352a9-f3f9-45e3-98ad-2395fac0f783 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:42:31.389324 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3f3352a9-f3f9-45e3-98ad-2395fac0f783 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:42:31.531044 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-3f3352a9-f3f9-45e3-98ad-2395fac0f783 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05573fa698bd46e88032483a6cb0ad30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a7db7a0f06b4371a79629e21c8d4bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:42:31.540180 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-3f3352a9-f3f9-45e3-98ad-2395fac0f783 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] 10.222.0.25 "GET /compute/v2.1/servers/a7cdc6a6-8316-4a58-a96d-3ff71cb10927" status: 200 len: 1505 microversion: 2.1 time: 0.169527 Nov 09 20:42:31.540819 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1278/2587] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:42:31 2021] GET /compute/v2.1/servers/a7cdc6a6-8316-4a58-a96d-3ff71cb10927 => generated 1505 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:42:32.873427 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-ed789388-2a4c-48fe-911c-33e92ccf1076 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f314714d-463e-4ed4-b063-4c8f3d338df0"}} {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:42:32.874494 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-ed789388-2a4c-48fe-911c-33e92ccf1076 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] [instance: a7cdc6a6-8316-4a58-a96d-3ff71cb10927] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:42:32.881498 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ed789388-2a4c-48fe-911c-33e92ccf1076 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:42:32.881951 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ed789388-2a4c-48fe-911c-33e92ccf1076 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:42:32.882742 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ed789388-2a4c-48fe-911c-33e92ccf1076 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:42:32.883176 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ed789388-2a4c-48fe-911c-33e92ccf1076 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:42:33.124467 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-ed789388-2a4c-48fe-911c-33e92ccf1076 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] 10.222.0.25 "POST /compute/v2.1/servers/a7cdc6a6-8316-4a58-a96d-3ff71cb10927/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.254482 Nov 09 20:42:33.125395 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1310/2588] 10.222.0.25 () {60 vars in 1322 bytes} [Tue Nov 9 20:42:32 2021] POST /compute/v2.1/servers/a7cdc6a6-8316-4a58-a96d-3ff71cb10927/os-volume_attachments => generated 194 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:42:40.690749 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-7d6d50e6-d69f-402e-a047-6720c7ea2573 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:42:40.691436 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-7d6d50e6-d69f-402e-a047-6720c7ea2573 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] [instance: a7cdc6a6-8316-4a58-a96d-3ff71cb10927] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:42:40.698587 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7d6d50e6-d69f-402e-a047-6720c7ea2573 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:42:40.699067 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7d6d50e6-d69f-402e-a047-6720c7ea2573 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:42:40.699901 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7d6d50e6-d69f-402e-a047-6720c7ea2573 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:42:40.700364 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7d6d50e6-d69f-402e-a047-6720c7ea2573 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:42:40.778261 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.objects.instance [None req-7d6d50e6-d69f-402e-a047-6720c7ea2573 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lazy-loading 'services' on Instance uuid a7cdc6a6-8316-4a58-a96d-3ff71cb10927 {{(pid=116103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 09 20:42:40.847955 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-7d6d50e6-d69f-402e-a047-6720c7ea2573 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] 10.222.0.25 "DELETE /compute/v2.1/servers/a7cdc6a6-8316-4a58-a96d-3ff71cb10927/os-volume_attachments/f314714d-463e-4ed4-b063-4c8f3d338df0" status: 202 len: 0 microversion: 2.1 time: 0.160604 Nov 09 20:42:40.848588 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1279/2589] 10.222.0.25 () {58 vars in 1415 bytes} [Tue Nov 9 20:42:40 2021] DELETE /compute/v2.1/servers/a7cdc6a6-8316-4a58-a96d-3ff71cb10927/os-volume_attachments/f314714d-463e-4ed4-b063-4c8f3d338df0 => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 09 20:42:40.858877 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-c6028025-bd7c-458c-bcbf-2617aea508e4 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:42:40.859856 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-c6028025-bd7c-458c-bcbf-2617aea508e4 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] [instance: a7cdc6a6-8316-4a58-a96d-3ff71cb10927] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:42:40.867566 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c6028025-bd7c-458c-bcbf-2617aea508e4 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:42:40.868886 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c6028025-bd7c-458c-bcbf-2617aea508e4 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:42:40.870010 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c6028025-bd7c-458c-bcbf-2617aea508e4 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:42:40.870442 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c6028025-bd7c-458c-bcbf-2617aea508e4 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:42:40.903056 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-c6028025-bd7c-458c-bcbf-2617aea508e4 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] 10.222.0.25 "GET /compute/v2.1/servers/a7cdc6a6-8316-4a58-a96d-3ff71cb10927/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049054 Nov 09 20:42:40.903621 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1311/2590] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:42:40 2021] GET /compute/v2.1/servers/a7cdc6a6-8316-4a58-a96d-3ff71cb10927/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:42:41.915815 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-cbf9e290-9861-46b5-992c-e565fd7d0354 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:42:41.916815 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-cbf9e290-9861-46b5-992c-e565fd7d0354 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] [instance: a7cdc6a6-8316-4a58-a96d-3ff71cb10927] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:42:41.922865 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cbf9e290-9861-46b5-992c-e565fd7d0354 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:42:41.923303 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cbf9e290-9861-46b5-992c-e565fd7d0354 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:42:41.924060 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cbf9e290-9861-46b5-992c-e565fd7d0354 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:42:41.924513 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-cbf9e290-9861-46b5-992c-e565fd7d0354 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:42:41.952940 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-cbf9e290-9861-46b5-992c-e565fd7d0354 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] 10.222.0.25 "GET /compute/v2.1/servers/a7cdc6a6-8316-4a58-a96d-3ff71cb10927/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041796 Nov 09 20:42:41.953494 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1280/2591] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Nov 9 20:42:41 2021] GET /compute/v2.1/servers/a7cdc6a6-8316-4a58-a96d-3ff71cb10927/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 09 20:42:43.125297 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-acd495aa-7ea9-40f8-8b1c-4153f6cc61d9 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:42:43.125766 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-acd495aa-7ea9-40f8-8b1c-4153f6cc61d9 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] [instance: a7cdc6a6-8316-4a58-a96d-3ff71cb10927] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:42:43.133198 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-acd495aa-7ea9-40f8-8b1c-4153f6cc61d9 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:42:43.133645 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-acd495aa-7ea9-40f8-8b1c-4153f6cc61d9 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:42:43.134411 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-acd495aa-7ea9-40f8-8b1c-4153f6cc61d9 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:42:43.134841 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-acd495aa-7ea9-40f8-8b1c-4153f6cc61d9 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:42:43.160108 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-acd495aa-7ea9-40f8-8b1c-4153f6cc61d9 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] [instance: a7cdc6a6-8316-4a58-a96d-3ff71cb10927] Going to try to terminate instance {{(pid=116102) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 09 20:42:43.231524 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-acd495aa-7ea9-40f8-8b1c-4153f6cc61d9 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] 10.222.0.25 "DELETE /compute/v2.1/servers/a7cdc6a6-8316-4a58-a96d-3ff71cb10927" status: 204 len: 0 microversion: 2.1 time: 0.109414 Nov 09 20:42:43.232103 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1312/2592] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Nov 9 20:42:43 2021] DELETE /compute/v2.1/servers/a7cdc6a6-8316-4a58-a96d-3ff71cb10927 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 09 20:42:43.239594 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-a282ed60-9ae5-471e-9fa9-56c1832e8b3d tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:42:43.240199 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-a282ed60-9ae5-471e-9fa9-56c1832e8b3d tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] [instance: a7cdc6a6-8316-4a58-a96d-3ff71cb10927] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:42:43.246373 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a282ed60-9ae5-471e-9fa9-56c1832e8b3d tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:42:43.246816 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a282ed60-9ae5-471e-9fa9-56c1832e8b3d tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:42:43.247576 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a282ed60-9ae5-471e-9fa9-56c1832e8b3d tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:42:43.248001 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-a282ed60-9ae5-471e-9fa9-56c1832e8b3d tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:42:43.379654 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-a282ed60-9ae5-471e-9fa9-56c1832e8b3d tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05573fa698bd46e88032483a6cb0ad30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a7db7a0f06b4371a79629e21c8d4bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:42:43.393793 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-a282ed60-9ae5-471e-9fa9-56c1832e8b3d tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] 10.222.0.25 "GET /compute/v2.1/servers/a7cdc6a6-8316-4a58-a96d-3ff71cb10927" status: 200 len: 1511 microversion: 2.1 time: 0.157797 Nov 09 20:42:43.394353 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1281/2593] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:42:43 2021] GET /compute/v2.1/servers/a7cdc6a6-8316-4a58-a96d-3ff71cb10927 => generated 1511 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:42:44.412165 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-70188229-a3da-43ec-a5a0-05d36ccc141d tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:42:44.412878 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-70188229-a3da-43ec-a5a0-05d36ccc141d tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] [instance: a7cdc6a6-8316-4a58-a96d-3ff71cb10927] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:42:44.419022 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-70188229-a3da-43ec-a5a0-05d36ccc141d tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:42:44.419458 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-70188229-a3da-43ec-a5a0-05d36ccc141d tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:42:44.420238 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-70188229-a3da-43ec-a5a0-05d36ccc141d tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:42:44.420689 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-70188229-a3da-43ec-a5a0-05d36ccc141d tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:42:44.553642 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-70188229-a3da-43ec-a5a0-05d36ccc141d tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05573fa698bd46e88032483a6cb0ad30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a7db7a0f06b4371a79629e21c8d4bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:42:44.560830 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-70188229-a3da-43ec-a5a0-05d36ccc141d tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] 10.222.0.25 "GET /compute/v2.1/servers/a7cdc6a6-8316-4a58-a96d-3ff71cb10927" status: 200 len: 1511 microversion: 2.1 time: 0.153236 Nov 09 20:42:44.561392 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1313/2594] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:42:44 2021] GET /compute/v2.1/servers/a7cdc6a6-8316-4a58-a96d-3ff71cb10927 => generated 1511 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:42:45.500704 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-56712a43-0250-44e0-8e09-178ef74d3e7c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:42:45.501191 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-56712a43-0250-44e0-8e09-178ef74d3e7c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:42:45.508581 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-56712a43-0250-44e0-8e09-178ef74d3e7c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:42:45.509023 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-56712a43-0250-44e0-8e09-178ef74d3e7c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:42:45.509795 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-56712a43-0250-44e0-8e09-178ef74d3e7c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:42:45.510226 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-56712a43-0250-44e0-8e09-178ef74d3e7c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:42:45.523827 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.wsgi [None req-56712a43-0250-44e0-8e09-178ef74d3e7c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] HTTP exception thrown: Instance 632b79c1-d378-423c-8404-3204223226a6 could not be found. Nov 09 20:42:45.524436 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-56712a43-0250-44e0-8e09-178ef74d3e7c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Returning 404 to user: Instance 632b79c1-d378-423c-8404-3204223226a6 could not be found. {{(pid=116103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 09 20:42:45.525263 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-56712a43-0250-44e0-8e09-178ef74d3e7c tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "DELETE /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 404 len: 111 microversion: 2.1 time: 0.028262 Nov 09 20:42:45.525812 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1282/2595] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Nov 9 20:42:45 2021] DELETE /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 09 20:42:45.533634 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-aaafef25-e49f-452e-80f4-755815f6f4a3 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:42:45.534270 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-aaafef25-e49f-452e-80f4-755815f6f4a3 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] [instance: 632b79c1-d378-423c-8404-3204223226a6] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:42:45.540719 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-aaafef25-e49f-452e-80f4-755815f6f4a3 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:42:45.541116 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-aaafef25-e49f-452e-80f4-755815f6f4a3 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:42:45.541940 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-aaafef25-e49f-452e-80f4-755815f6f4a3 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:42:45.542397 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-aaafef25-e49f-452e-80f4-755815f6f4a3 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:42:45.555752 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.wsgi [None req-aaafef25-e49f-452e-80f4-755815f6f4a3 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] HTTP exception thrown: Instance 632b79c1-d378-423c-8404-3204223226a6 could not be found. Nov 09 20:42:45.556374 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-aaafef25-e49f-452e-80f4-755815f6f4a3 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] Returning 404 to user: Instance 632b79c1-d378-423c-8404-3204223226a6 could not be found. {{(pid=116102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 09 20:42:45.557217 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-aaafef25-e49f-452e-80f4-755815f6f4a3 tempest-AttachVolumeTestJSON-938832429 tempest-AttachVolumeTestJSON-938832429-project] 10.222.0.25 "GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6" status: 404 len: 111 microversion: 2.1 time: 0.027263 Nov 09 20:42:45.557751 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1314/2596] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:42:45 2021] GET /compute/v2.1/servers/632b79c1-d378-423c-8404-3204223226a6 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 09 20:42:45.577087 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-5278323e-8c75-4127-bbe3-f3d88dbce8af tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:42:45.577887 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-5278323e-8c75-4127-bbe3-f3d88dbce8af tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] [instance: a7cdc6a6-8316-4a58-a96d-3ff71cb10927] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:42:45.584674 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5278323e-8c75-4127-bbe3-f3d88dbce8af tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:42:45.585123 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5278323e-8c75-4127-bbe3-f3d88dbce8af tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:42:45.585895 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5278323e-8c75-4127-bbe3-f3d88dbce8af tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:42:45.586328 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5278323e-8c75-4127-bbe3-f3d88dbce8af tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:42:45.687908 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 09 20:42:45.688424 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: Tue Nov 9 20:42:45 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 09 20:42:45.757299 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-5278323e-8c75-4127-bbe3-f3d88dbce8af tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05573fa698bd46e88032483a6cb0ad30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a7db7a0f06b4371a79629e21c8d4bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:42:45.765321 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-5278323e-8c75-4127-bbe3-f3d88dbce8af tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] 10.222.0.25 "GET /compute/v2.1/servers/a7cdc6a6-8316-4a58-a96d-3ff71cb10927" status: 200 len: 1511 microversion: 2.1 time: 0.191756 Nov 09 20:42:45.765900 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1283/2597] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:42:45 2021] GET /compute/v2.1/servers/a7cdc6a6-8316-4a58-a96d-3ff71cb10927 => generated 1511 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:42:45.791401 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [req-ab94846d-b14b-4437-b424-66703482e914 req-b50817f7-30e9-43fa-9150-00af0c153d8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7cdc6a6-8316-4a58-a96d-3ff71cb10927", "name": "network-vif-deleted", "tag": "bf961d0b-5889-4d82-878d-8cc65cabd158"}]} {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:42:45.793652 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 20:42:45.793652 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: warnings.warn(msg) Nov 09 20:42:45.804718 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [req-ab94846d-b14b-4437-b424-66703482e914 req-b50817f7-30e9-43fa-9150-00af0c153d8e service nova] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:42:45.805440 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [req-ab94846d-b14b-4437-b424-66703482e914 req-b50817f7-30e9-43fa-9150-00af0c153d8e service nova] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:42:45.820876 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.compute.server_external_events [req-ab94846d-b14b-4437-b424-66703482e914 req-b50817f7-30e9-43fa-9150-00af0c153d8e service nova] Creating event network-vif-deleted:bf961d0b-5889-4d82-878d-8cc65cabd158 for instance a7cdc6a6-8316-4a58-a96d-3ff71cb10927 on hv-cinder-80135 Nov 09 20:42:45.827437 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [req-ab94846d-b14b-4437-b424-66703482e914 req-b50817f7-30e9-43fa-9150-00af0c153d8e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040166 Nov 09 20:42:45.828526 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1315/2598] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Nov 9 20:42:45 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:42:46.571563 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-288215a4-dc46-4c5a-b85b-e1da22d66f29 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1338706683", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2081092357", "security_groups": [{"name": "tempest-secgroup-smoke-1239717613"}], "block_device_mapping_v2": [{"uuid": "daec9359-3f1d-43d3-bbc8-e918dfec97a0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f3b9dec4-c021-48b3-8c75-239f3e6bb8fa"}]}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:42:46.721444 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.network.neutron [None req-288215a4-dc46-4c5a-b85b-e1da22d66f29 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] validate_networks() for [('f3b9dec4-c021-48b3-8c75-239f3e6bb8fa', None, None, None, None, None)] {{(pid=116103) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 09 20:42:46.782596 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-97f616d9-3124-4e62-8913-4051e9bb88ac tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:42:46.783310 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-97f616d9-3124-4e62-8913-4051e9bb88ac tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] [instance: a7cdc6a6-8316-4a58-a96d-3ff71cb10927] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:42:46.789860 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-97f616d9-3124-4e62-8913-4051e9bb88ac tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:42:46.790375 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-97f616d9-3124-4e62-8913-4051e9bb88ac tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:42:46.791145 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-97f616d9-3124-4e62-8913-4051e9bb88ac tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:42:46.791579 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-97f616d9-3124-4e62-8913-4051e9bb88ac tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:42:46.804174 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.wsgi [None req-97f616d9-3124-4e62-8913-4051e9bb88ac tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] HTTP exception thrown: Instance a7cdc6a6-8316-4a58-a96d-3ff71cb10927 could not be found. Nov 09 20:42:46.804792 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-97f616d9-3124-4e62-8913-4051e9bb88ac tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Returning 404 to user: Instance a7cdc6a6-8316-4a58-a96d-3ff71cb10927 could not be found. {{(pid=116102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 09 20:42:46.805598 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-97f616d9-3124-4e62-8913-4051e9bb88ac tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] 10.222.0.25 "GET /compute/v2.1/servers/a7cdc6a6-8316-4a58-a96d-3ff71cb10927" status: 404 len: 111 microversion: 2.1 time: 0.027141 Nov 09 20:42:46.806128 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1316/2599] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:42:46 2021] GET /compute/v2.1/servers/a7cdc6a6-8316-4a58-a96d-3ff71cb10927 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 09 20:42:47.355302 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.virt.hardware [None req-288215a4-dc46-4c5a-b85b-e1da22d66f29 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Flavor limits 0:0:0 {{(pid=116103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 09 20:42:47.355729 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.virt.hardware [None req-288215a4-dc46-4c5a-b85b-e1da22d66f29 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Image limits 0:0:0 {{(pid=116103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 09 20:42:47.356636 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.virt.hardware [None req-288215a4-dc46-4c5a-b85b-e1da22d66f29 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Flavor pref 0:0:0 {{(pid=116103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 09 20:42:47.357049 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.virt.hardware [None req-288215a4-dc46-4c5a-b85b-e1da22d66f29 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Image pref 0:0:0 {{(pid=116103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 09 20:42:47.357478 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.virt.hardware [None req-288215a4-dc46-4c5a-b85b-e1da22d66f29 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 09 20:42:47.366166 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-288215a4-dc46-4c5a-b85b-e1da22d66f29 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:42:47.366621 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-288215a4-dc46-4c5a-b85b-e1da22d66f29 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:42:47.367426 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-288215a4-dc46-4c5a-b85b-e1da22d66f29 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:42:47.367865 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-288215a4-dc46-4c5a-b85b-e1da22d66f29 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:42:47.386228 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.quota [None req-288215a4-dc46-4c5a-b85b-e1da22d66f29 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Getting quotas for project 9858a3c560894023a1fdd7e30f9759da. Resources: {'cores', 'instances', 'ram'} {{(pid=116103) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 09 20:42:47.390169 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.quota [None req-288215a4-dc46-4c5a-b85b-e1da22d66f29 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Getting quotas for user 03d26c07791240fcac7bcf26606fce8f and project 9858a3c560894023a1fdd7e30f9759da. Resources: {'cores', 'instances', 'ram'} {{(pid=116103) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 09 20:42:47.444316 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-288215a4-dc46-4c5a-b85b-e1da22d66f29 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Going to run 1 instances... {{(pid=116103) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 09 20:42:47.446579 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-288215a4-dc46-4c5a-b85b-e1da22d66f29 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] [instance: 10121fdc-8839-4431-8688-40eaedc47e3d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='daec9359-3f1d-43d3-bbc8-e918dfec97a0',volume_size=None,volume_type=None)] {{(pid=116103) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 09 20:42:47.570281 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-288215a4-dc46-4c5a-b85b-e1da22d66f29 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.002276 Nov 09 20:42:47.571142 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1284/2600] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Nov 9 20:42:46 2021] POST /compute/v2.1/servers => generated 406 bytes in 1004 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 09 20:42:47.582170 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-1562daae-b485-473e-9785-4eb281793b3a tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:42:47.582783 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-1562daae-b485-473e-9785-4eb281793b3a tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] [instance: 10121fdc-8839-4431-8688-40eaedc47e3d] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:42:47.672694 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-1562daae-b485-473e-9785-4eb281793b3a tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d26c07791240fcac7bcf26606fce8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9858a3c560894023a1fdd7e30f9759da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:42:47.679930 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-1562daae-b485-473e-9785-4eb281793b3a tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] 10.222.0.25 "GET /compute/v2.1/servers/10121fdc-8839-4431-8688-40eaedc47e3d" status: 200 len: 1095 microversion: 2.1 time: 0.102794 Nov 09 20:42:47.680824 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1317/2601] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:42:47 2021] GET /compute/v2.1/servers/10121fdc-8839-4431-8688-40eaedc47e3d => generated 1095 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:42:47.941719 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-bf2b047a-d551-4ace-8ce4-ca24b9560cb7 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:42:47.942981 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-bf2b047a-d551-4ace-8ce4-ca24b9560cb7 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] [instance: 09b4db10-7445-4517-b195-2af2df01bb08] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:42:47.949906 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bf2b047a-d551-4ace-8ce4-ca24b9560cb7 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:42:47.950613 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bf2b047a-d551-4ace-8ce4-ca24b9560cb7 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:42:47.951534 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bf2b047a-d551-4ace-8ce4-ca24b9560cb7 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:42:47.952107 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bf2b047a-d551-4ace-8ce4-ca24b9560cb7 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:42:47.979582 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-bf2b047a-d551-4ace-8ce4-ca24b9560cb7 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] [instance: 09b4db10-7445-4517-b195-2af2df01bb08] Going to try to terminate instance {{(pid=116103) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 09 20:42:48.073528 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-bf2b047a-d551-4ace-8ce4-ca24b9560cb7 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] 10.222.0.25 "DELETE /compute/v2.1/servers/09b4db10-7445-4517-b195-2af2df01bb08" status: 204 len: 0 microversion: 2.1 time: 0.137209 Nov 09 20:42:48.076493 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1285/2602] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Nov 9 20:42:47 2021] DELETE /compute/v2.1/servers/09b4db10-7445-4517-b195-2af2df01bb08 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 09 20:42:48.084220 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-293a9f96-0b3c-4db9-8227-0ce1b152cce0 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:42:48.085693 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-293a9f96-0b3c-4db9-8227-0ce1b152cce0 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] [instance: 09b4db10-7445-4517-b195-2af2df01bb08] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:42:48.095337 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-293a9f96-0b3c-4db9-8227-0ce1b152cce0 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:42:48.096037 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-293a9f96-0b3c-4db9-8227-0ce1b152cce0 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:42:48.097249 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-293a9f96-0b3c-4db9-8227-0ce1b152cce0 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:42:48.097883 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-293a9f96-0b3c-4db9-8227-0ce1b152cce0 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:42:48.361495 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-293a9f96-0b3c-4db9-8227-0ce1b152cce0 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05573fa698bd46e88032483a6cb0ad30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a7db7a0f06b4371a79629e21c8d4bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:42:48.369858 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-293a9f96-0b3c-4db9-8227-0ce1b152cce0 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] 10.222.0.25 "GET /compute/v2.1/servers/09b4db10-7445-4517-b195-2af2df01bb08" status: 200 len: 1513 microversion: 2.1 time: 0.290299 Nov 09 20:42:48.370430 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1318/2603] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:42:48 2021] GET /compute/v2.1/servers/09b4db10-7445-4517-b195-2af2df01bb08 => generated 1513 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:42:48.698021 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-68cfd3bc-d4bb-4a94-8471-0e64765e1ee8 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:42:48.698716 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-68cfd3bc-d4bb-4a94-8471-0e64765e1ee8 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] [instance: 10121fdc-8839-4431-8688-40eaedc47e3d] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:42:48.710043 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-68cfd3bc-d4bb-4a94-8471-0e64765e1ee8 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:42:48.710666 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-68cfd3bc-d4bb-4a94-8471-0e64765e1ee8 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:42:48.711433 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-68cfd3bc-d4bb-4a94-8471-0e64765e1ee8 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:42:48.711867 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-68cfd3bc-d4bb-4a94-8471-0e64765e1ee8 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:42:48.810211 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-68cfd3bc-d4bb-4a94-8471-0e64765e1ee8 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d26c07791240fcac7bcf26606fce8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9858a3c560894023a1fdd7e30f9759da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:42:48.819838 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-68cfd3bc-d4bb-4a94-8471-0e64765e1ee8 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] 10.222.0.25 "GET /compute/v2.1/servers/10121fdc-8839-4431-8688-40eaedc47e3d" status: 200 len: 1211 microversion: 2.1 time: 0.125643 Nov 09 20:42:48.820961 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1286/2604] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:42:48 2021] GET /compute/v2.1/servers/10121fdc-8839-4431-8688-40eaedc47e3d => generated 1211 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:42:49.388925 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-71f502e9-a1cc-462d-b677-c074b918ca83 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:42:49.390929 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-71f502e9-a1cc-462d-b677-c074b918ca83 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] [instance: 09b4db10-7445-4517-b195-2af2df01bb08] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:42:49.405787 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-71f502e9-a1cc-462d-b677-c074b918ca83 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:42:49.408830 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-71f502e9-a1cc-462d-b677-c074b918ca83 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:42:49.411543 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-71f502e9-a1cc-462d-b677-c074b918ca83 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:42:49.412638 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-71f502e9-a1cc-462d-b677-c074b918ca83 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:42:49.838413 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-7ebec452-4ba4-4289-9a08-a2f1d8fc90ce tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:42:49.839029 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-7ebec452-4ba4-4289-9a08-a2f1d8fc90ce tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] [instance: 10121fdc-8839-4431-8688-40eaedc47e3d] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:42:49.848929 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7ebec452-4ba4-4289-9a08-a2f1d8fc90ce tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:42:49.849382 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7ebec452-4ba4-4289-9a08-a2f1d8fc90ce tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:42:49.850353 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7ebec452-4ba4-4289-9a08-a2f1d8fc90ce tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:42:49.850790 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7ebec452-4ba4-4289-9a08-a2f1d8fc90ce tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:42:50.100790 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-71f502e9-a1cc-462d-b677-c074b918ca83 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05573fa698bd46e88032483a6cb0ad30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a7db7a0f06b4371a79629e21c8d4bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:42:50.108339 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-71f502e9-a1cc-462d-b677-c074b918ca83 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] 10.222.0.25 "GET /compute/v2.1/servers/09b4db10-7445-4517-b195-2af2df01bb08" status: 200 len: 1513 microversion: 2.1 time: 0.724941 Nov 09 20:42:50.118178 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1319/2605] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:42:49 2021] GET /compute/v2.1/servers/09b4db10-7445-4517-b195-2af2df01bb08 => generated 1513 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:42:50.226452 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-7ebec452-4ba4-4289-9a08-a2f1d8fc90ce tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d26c07791240fcac7bcf26606fce8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9858a3c560894023a1fdd7e30f9759da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:42:50.240247 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-7ebec452-4ba4-4289-9a08-a2f1d8fc90ce tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] 10.222.0.25 "GET /compute/v2.1/servers/10121fdc-8839-4431-8688-40eaedc47e3d" status: 200 len: 1267 microversion: 2.1 time: 0.403733 Nov 09 20:42:50.240247 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1287/2606] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:42:49 2021] GET /compute/v2.1/servers/10121fdc-8839-4431-8688-40eaedc47e3d => generated 1267 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 20:42:50.900013 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [req-d21835f3-9cd5-4988-a00c-6480abc03c6e req-ce6d41bc-4dc1-42c8-b956-e100464bf874 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10121fdc-8839-4431-8688-40eaedc47e3d", "tag": "59962065-ec11-434f-9050-0a01d332ac44"}]} {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:42:50.901587 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 20:42:50.901587 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: warnings.warn(msg) Nov 09 20:42:50.916928 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [req-d21835f3-9cd5-4988-a00c-6480abc03c6e req-ce6d41bc-4dc1-42c8-b956-e100464bf874 service nova] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:42:50.917646 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [req-d21835f3-9cd5-4988-a00c-6480abc03c6e req-ce6d41bc-4dc1-42c8-b956-e100464bf874 service nova] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:42:50.944774 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.compute.server_external_events [req-d21835f3-9cd5-4988-a00c-6480abc03c6e req-ce6d41bc-4dc1-42c8-b956-e100464bf874 service nova] Creating event network-changed:59962065-ec11-434f-9050-0a01d332ac44 for instance 10121fdc-8839-4431-8688-40eaedc47e3d on hv-cinder-80135 Nov 09 20:42:50.962231 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [req-d21835f3-9cd5-4988-a00c-6480abc03c6e req-ce6d41bc-4dc1-42c8-b956-e100464bf874 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065609 Nov 09 20:42:50.962834 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1320/2607] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Nov 9 20:42:50 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:42:51.125242 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-2e74571e-7b56-42f7-aef8-2c42295c4888 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:42:51.126409 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-2e74571e-7b56-42f7-aef8-2c42295c4888 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] [instance: 09b4db10-7445-4517-b195-2af2df01bb08] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:42:51.139724 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2e74571e-7b56-42f7-aef8-2c42295c4888 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:42:51.140163 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2e74571e-7b56-42f7-aef8-2c42295c4888 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:42:51.142492 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2e74571e-7b56-42f7-aef8-2c42295c4888 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:42:51.142960 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-2e74571e-7b56-42f7-aef8-2c42295c4888 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:42:51.219431 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-2e74571e-7b56-42f7-aef8-2c42295c4888 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05573fa698bd46e88032483a6cb0ad30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a7db7a0f06b4371a79629e21c8d4bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:42:51.230086 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-2e74571e-7b56-42f7-aef8-2c42295c4888 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] 10.222.0.25 "GET /compute/v2.1/servers/09b4db10-7445-4517-b195-2af2df01bb08" status: 200 len: 1303 microversion: 2.1 time: 0.108682 Nov 09 20:42:51.239978 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1288/2608] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:42:51 2021] GET /compute/v2.1/servers/09b4db10-7445-4517-b195-2af2df01bb08 => generated 1303 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:42:51.256036 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-d5a186f4-705a-43bb-b59c-e34c918f6524 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:42:51.257054 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-d5a186f4-705a-43bb-b59c-e34c918f6524 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] [instance: 10121fdc-8839-4431-8688-40eaedc47e3d] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:42:51.263623 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d5a186f4-705a-43bb-b59c-e34c918f6524 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:42:51.264068 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d5a186f4-705a-43bb-b59c-e34c918f6524 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:42:51.265152 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d5a186f4-705a-43bb-b59c-e34c918f6524 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:42:51.265912 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d5a186f4-705a-43bb-b59c-e34c918f6524 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:42:51.411837 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-d5a186f4-705a-43bb-b59c-e34c918f6524 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d26c07791240fcac7bcf26606fce8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9858a3c560894023a1fdd7e30f9759da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:42:51.419959 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-d5a186f4-705a-43bb-b59c-e34c918f6524 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] 10.222.0.25 "GET /compute/v2.1/servers/10121fdc-8839-4431-8688-40eaedc47e3d" status: 200 len: 1267 microversion: 2.1 time: 0.168450 Nov 09 20:42:51.420558 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1321/2609] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:42:51 2021] GET /compute/v2.1/servers/10121fdc-8839-4431-8688-40eaedc47e3d => generated 1267 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:42:51.783177 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-cc48483b-72ac-47a2-8368-6abe918f070d tempest-VolumesGetTestJSON-335891685 tempest-VolumesGetTestJSON-335891685-project] Action: 'create', calling method: .version_select at 0x7fab3fe30430>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-12041120", "metadata": {"Type": "work"}}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:42:52.065849 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-cc48483b-72ac-47a2-8368-6abe918f070d tempest-VolumesGetTestJSON-335891685 tempest-VolumesGetTestJSON-335891685-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 200 len: 351 microversion: 2.1 time: 0.397306 Nov 09 20:42:52.066950 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1289/2610] 10.222.0.25 () {60 vars in 1155 bytes} [Tue Nov 9 20:42:51 2021] POST /compute/v2.1/os-volumes => generated 351 bytes in 400 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Nov 09 20:42:52.077331 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-4f26e6f4-306f-4ed6-9055-b00a192d9ed1 tempest-VolumesGetTestJSON-335891685 tempest-VolumesGetTestJSON-335891685-project] Calling method '.version_select at 0x7fab36e80700>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:42:52.127889 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-4f26e6f4-306f-4ed6-9055-b00a192d9ed1 tempest-VolumesGetTestJSON-335891685 tempest-VolumesGetTestJSON-335891685-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/bd5dc3a9-e2bf-4fd6-b9a9-d05724c9e800" status: 200 len: 351 microversion: 2.1 time: 0.053759 Nov 09 20:42:52.128705 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1322/2611] 10.222.0.25 () {58 vars in 1244 bytes} [Tue Nov 9 20:42:52 2021] GET /compute/v2.1/os-volumes/bd5dc3a9-e2bf-4fd6-b9a9-d05724c9e800 => generated 351 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:42:52.247474 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-28f93118-abc4-4a72-820f-5112bd2238ab tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:42:52.248069 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-28f93118-abc4-4a72-820f-5112bd2238ab tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] [instance: 09b4db10-7445-4517-b195-2af2df01bb08] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:42:52.254570 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-28f93118-abc4-4a72-820f-5112bd2238ab tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:42:52.255006 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-28f93118-abc4-4a72-820f-5112bd2238ab tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:42:52.256016 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-28f93118-abc4-4a72-820f-5112bd2238ab tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:42:52.256469 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-28f93118-abc4-4a72-820f-5112bd2238ab tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:42:52.269136 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.wsgi [None req-28f93118-abc4-4a72-820f-5112bd2238ab tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] HTTP exception thrown: Instance 09b4db10-7445-4517-b195-2af2df01bb08 could not be found. Nov 09 20:42:52.269717 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-28f93118-abc4-4a72-820f-5112bd2238ab tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Returning 404 to user: Instance 09b4db10-7445-4517-b195-2af2df01bb08 could not be found. {{(pid=116103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 09 20:42:52.270532 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-28f93118-abc4-4a72-820f-5112bd2238ab tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] 10.222.0.25 "GET /compute/v2.1/servers/09b4db10-7445-4517-b195-2af2df01bb08" status: 404 len: 111 microversion: 2.1 time: 0.027263 Nov 09 20:42:52.271116 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1290/2612] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:42:52 2021] GET /compute/v2.1/servers/09b4db10-7445-4517-b195-2af2df01bb08 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 09 20:42:52.279245 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-0f83e17c-1805-4352-83c2-a6106c6b9eb5 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:42:52.280573 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-0f83e17c-1805-4352-83c2-a6106c6b9eb5 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] [instance: f979bb50-149c-4173-bc59-6a77465e755e] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:42:52.287195 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-0f83e17c-1805-4352-83c2-a6106c6b9eb5 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:42:52.287666 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-0f83e17c-1805-4352-83c2-a6106c6b9eb5 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:42:52.288516 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-0f83e17c-1805-4352-83c2-a6106c6b9eb5 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:42:52.289055 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-0f83e17c-1805-4352-83c2-a6106c6b9eb5 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:42:52.314411 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-0f83e17c-1805-4352-83c2-a6106c6b9eb5 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] [instance: f979bb50-149c-4173-bc59-6a77465e755e] Going to try to terminate instance {{(pid=116102) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 09 20:42:52.386260 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-0f83e17c-1805-4352-83c2-a6106c6b9eb5 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] 10.222.0.25 "DELETE /compute/v2.1/servers/f979bb50-149c-4173-bc59-6a77465e755e" status: 204 len: 0 microversion: 2.1 time: 0.110597 Nov 09 20:42:52.386859 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1323/2613] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Nov 9 20:42:52 2021] DELETE /compute/v2.1/servers/f979bb50-149c-4173-bc59-6a77465e755e => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 09 20:42:52.396225 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-5f5c6142-a009-4f90-a839-0c113d5fd555 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:42:52.396862 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-5f5c6142-a009-4f90-a839-0c113d5fd555 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] [instance: f979bb50-149c-4173-bc59-6a77465e755e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:42:52.407072 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5f5c6142-a009-4f90-a839-0c113d5fd555 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:42:52.407514 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5f5c6142-a009-4f90-a839-0c113d5fd555 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:42:52.408283 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5f5c6142-a009-4f90-a839-0c113d5fd555 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:42:52.408771 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5f5c6142-a009-4f90-a839-0c113d5fd555 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:42:52.438138 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-775e6f4c-6807-4a69-a2d0-cd10ba32e117 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:42:52.438844 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-775e6f4c-6807-4a69-a2d0-cd10ba32e117 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] [instance: 10121fdc-8839-4431-8688-40eaedc47e3d] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:42:52.444880 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-775e6f4c-6807-4a69-a2d0-cd10ba32e117 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:42:52.445345 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-775e6f4c-6807-4a69-a2d0-cd10ba32e117 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:42:52.446118 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-775e6f4c-6807-4a69-a2d0-cd10ba32e117 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:42:52.446551 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-775e6f4c-6807-4a69-a2d0-cd10ba32e117 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:42:52.616085 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-5f5c6142-a009-4f90-a839-0c113d5fd555 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05573fa698bd46e88032483a6cb0ad30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a7db7a0f06b4371a79629e21c8d4bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:42:52.620898 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-775e6f4c-6807-4a69-a2d0-cd10ba32e117 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d26c07791240fcac7bcf26606fce8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9858a3c560894023a1fdd7e30f9759da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:42:52.623339 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-5f5c6142-a009-4f90-a839-0c113d5fd555 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] 10.222.0.25 "GET /compute/v2.1/servers/f979bb50-149c-4173-bc59-6a77465e755e" status: 200 len: 1513 microversion: 2.1 time: 0.232235 Nov 09 20:42:52.623899 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1291/2614] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:42:52 2021] GET /compute/v2.1/servers/f979bb50-149c-4173-bc59-6a77465e755e => generated 1513 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:42:52.628450 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-775e6f4c-6807-4a69-a2d0-cd10ba32e117 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] 10.222.0.25 "GET /compute/v2.1/servers/10121fdc-8839-4431-8688-40eaedc47e3d" status: 200 len: 1267 microversion: 2.1 time: 0.194345 Nov 09 20:42:52.636232 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1324/2615] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:42:52 2021] GET /compute/v2.1/servers/10121fdc-8839-4431-8688-40eaedc47e3d => generated 1267 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 20:42:52.979243 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [req-83e179a9-b118-4dca-9f9a-f04e71964fd7 req-5cf2aa0f-ec5a-478d-b927-366985b8f369 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09b4db10-7445-4517-b195-2af2df01bb08", "name": "network-vif-deleted", "tag": "1f626854-ec25-4c1a-a056-119bab20d470"}]} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:42:52.980784 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 20:42:52.980784 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: warnings.warn(msg) Nov 09 20:42:52.988634 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-83e179a9-b118-4dca-9f9a-f04e71964fd7 req-5cf2aa0f-ec5a-478d-b927-366985b8f369 service nova] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:42:52.989071 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-83e179a9-b118-4dca-9f9a-f04e71964fd7 req-5cf2aa0f-ec5a-478d-b927-366985b8f369 service nova] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:42:52.999831 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.compute.server_external_events [req-83e179a9-b118-4dca-9f9a-f04e71964fd7 req-5cf2aa0f-ec5a-478d-b927-366985b8f369 service nova] Creating event network-vif-deleted:1f626854-ec25-4c1a-a056-119bab20d470 for instance 09b4db10-7445-4517-b195-2af2df01bb08 on hv-cinder-80135 Nov 09 20:42:53.005404 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [req-83e179a9-b118-4dca-9f9a-f04e71964fd7 req-5cf2aa0f-ec5a-478d-b927-366985b8f369 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029733 Nov 09 20:42:53.006584 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1292/2616] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Nov 9 20:42:52 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:42:53.140690 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-5464eb0f-e384-4345-a9fd-946c5295788e tempest-VolumesGetTestJSON-335891685 tempest-VolumesGetTestJSON-335891685-project] Calling method '.version_select at 0x7fab36e00310>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:42:53.187444 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-5464eb0f-e384-4345-a9fd-946c5295788e tempest-VolumesGetTestJSON-335891685 tempest-VolumesGetTestJSON-335891685-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/bd5dc3a9-e2bf-4fd6-b9a9-d05724c9e800" status: 200 len: 352 microversion: 2.1 time: 0.050401 Nov 09 20:42:53.188012 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1325/2617] 10.222.0.25 () {58 vars in 1244 bytes} [Tue Nov 9 20:42:53 2021] GET /compute/v2.1/os-volumes/bd5dc3a9-e2bf-4fd6-b9a9-d05724c9e800 => generated 352 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:42:53.199067 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-5ca56f85-abd4-45d1-ba46-cfd113d830c2 tempest-VolumesGetTestJSON-335891685 tempest-VolumesGetTestJSON-335891685-project] Calling method '.version_select at 0x7fab3fdd1040>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:42:53.246222 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-5ca56f85-abd4-45d1-ba46-cfd113d830c2 tempest-VolumesGetTestJSON-335891685 tempest-VolumesGetTestJSON-335891685-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/bd5dc3a9-e2bf-4fd6-b9a9-d05724c9e800" status: 200 len: 352 microversion: 2.1 time: 0.050887 Nov 09 20:42:53.246817 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1293/2618] 10.222.0.25 () {58 vars in 1244 bytes} [Tue Nov 9 20:42:53 2021] GET /compute/v2.1/os-volumes/bd5dc3a9-e2bf-4fd6-b9a9-d05724c9e800 => generated 352 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:42:53.263228 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-55e5570b-6d7c-4d05-8af9-b3530e606f9d tempest-VolumesGetTestJSON-335891685 tempest-VolumesGetTestJSON-335891685-project] Calling method '.version_select at 0x7fab36d5aee0>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:42:53.321486 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-55e5570b-6d7c-4d05-8af9-b3530e606f9d tempest-VolumesGetTestJSON-335891685 tempest-VolumesGetTestJSON-335891685-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/bd5dc3a9-e2bf-4fd6-b9a9-d05724c9e800" status: 202 len: 0 microversion: 2.1 time: 0.061813 Nov 09 20:42:53.322055 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1326/2619] 10.222.0.25 () {58 vars in 1247 bytes} [Tue Nov 9 20:42:53 2021] DELETE /compute/v2.1/os-volumes/bd5dc3a9-e2bf-4fd6-b9a9-d05724c9e800 => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 09 20:42:53.330242 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-f402fa5d-f7cc-4864-bf97-68930bc74e05 tempest-VolumesGetTestJSON-335891685 tempest-VolumesGetTestJSON-335891685-project] Calling method '.version_select at 0x7fab3fe555e0>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:42:53.377769 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-f402fa5d-f7cc-4864-bf97-68930bc74e05 tempest-VolumesGetTestJSON-335891685 tempest-VolumesGetTestJSON-335891685-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/bd5dc3a9-e2bf-4fd6-b9a9-d05724c9e800" status: 200 len: 351 microversion: 2.1 time: 0.051507 Nov 09 20:42:53.378639 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1294/2620] 10.222.0.25 () {58 vars in 1244 bytes} [Tue Nov 9 20:42:53 2021] GET /compute/v2.1/os-volumes/bd5dc3a9-e2bf-4fd6-b9a9-d05724c9e800 => generated 351 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:42:53.640603 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-0aabb6fc-3f24-4abd-95b6-8c28841a99bf tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:42:53.641213 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-0aabb6fc-3f24-4abd-95b6-8c28841a99bf tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] [instance: f979bb50-149c-4173-bc59-6a77465e755e] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:42:53.646969 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-66b37000-dfa1-415e-8ab1-5afb6ed69344 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:42:53.648013 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-66b37000-dfa1-415e-8ab1-5afb6ed69344 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] [instance: 10121fdc-8839-4431-8688-40eaedc47e3d] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:42:53.649067 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-0aabb6fc-3f24-4abd-95b6-8c28841a99bf tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:42:53.649517 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-0aabb6fc-3f24-4abd-95b6-8c28841a99bf tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:42:53.650313 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-0aabb6fc-3f24-4abd-95b6-8c28841a99bf tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:42:53.650750 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-0aabb6fc-3f24-4abd-95b6-8c28841a99bf tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:42:53.656331 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-66b37000-dfa1-415e-8ab1-5afb6ed69344 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:42:53.657071 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-66b37000-dfa1-415e-8ab1-5afb6ed69344 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:42:53.657845 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-66b37000-dfa1-415e-8ab1-5afb6ed69344 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:42:53.658546 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-66b37000-dfa1-415e-8ab1-5afb6ed69344 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:42:53.846209 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-0aabb6fc-3f24-4abd-95b6-8c28841a99bf tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05573fa698bd46e88032483a6cb0ad30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a7db7a0f06b4371a79629e21c8d4bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:42:53.851020 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-66b37000-dfa1-415e-8ab1-5afb6ed69344 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d26c07791240fcac7bcf26606fce8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9858a3c560894023a1fdd7e30f9759da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:42:53.858554 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-66b37000-dfa1-415e-8ab1-5afb6ed69344 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] 10.222.0.25 "GET /compute/v2.1/servers/10121fdc-8839-4431-8688-40eaedc47e3d" status: 200 len: 1267 microversion: 2.1 time: 0.216400 Nov 09 20:42:53.859656 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1295/2621] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:42:53 2021] GET /compute/v2.1/servers/10121fdc-8839-4431-8688-40eaedc47e3d => generated 1267 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 20:42:53.860106 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-0aabb6fc-3f24-4abd-95b6-8c28841a99bf tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] 10.222.0.25 "GET /compute/v2.1/servers/f979bb50-149c-4173-bc59-6a77465e755e" status: 200 len: 1513 microversion: 2.1 time: 0.223118 Nov 09 20:42:53.860710 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1327/2622] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:42:53 2021] GET /compute/v2.1/servers/f979bb50-149c-4173-bc59-6a77465e755e => generated 1513 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:42:54.390700 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-1e91ccae-59b9-4bc0-ab6b-53b9a74be100 tempest-VolumesGetTestJSON-335891685 tempest-VolumesGetTestJSON-335891685-project] Calling method '.version_select at 0x7fab3fef1790>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:42:54.417876 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.wsgi [None req-1e91ccae-59b9-4bc0-ab6b-53b9a74be100 tempest-VolumesGetTestJSON-335891685 tempest-VolumesGetTestJSON-335891685-project] HTTP exception thrown: Volume bd5dc3a9-e2bf-4fd6-b9a9-d05724c9e800 could not be found. Nov 09 20:42:54.418541 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-1e91ccae-59b9-4bc0-ab6b-53b9a74be100 tempest-VolumesGetTestJSON-335891685 tempest-VolumesGetTestJSON-335891685-project] Returning 404 to user: Volume bd5dc3a9-e2bf-4fd6-b9a9-d05724c9e800 could not be found. {{(pid=116103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 09 20:42:54.419390 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-1e91ccae-59b9-4bc0-ab6b-53b9a74be100 tempest-VolumesGetTestJSON-335891685 tempest-VolumesGetTestJSON-335891685-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/bd5dc3a9-e2bf-4fd6-b9a9-d05724c9e800" status: 404 len: 109 microversion: 2.1 time: 0.032346 Nov 09 20:42:54.419950 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1296/2623] 10.222.0.25 () {58 vars in 1244 bytes} [Tue Nov 9 20:42:54 2021] GET /compute/v2.1/os-volumes/bd5dc3a9-e2bf-4fd6-b9a9-d05724c9e800 => generated 109 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 09 20:42:54.875250 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-f2c4147e-28a8-4afe-908c-1bb3d1557469 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:42:54.876437 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-f2c4147e-28a8-4afe-908c-1bb3d1557469 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] [instance: 10121fdc-8839-4431-8688-40eaedc47e3d] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:42:54.877225 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-930c543b-cf9a-49e0-bdd2-9052b5106d48 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:42:54.878122 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-930c543b-cf9a-49e0-bdd2-9052b5106d48 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] [instance: f979bb50-149c-4173-bc59-6a77465e755e] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:42:54.883196 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f2c4147e-28a8-4afe-908c-1bb3d1557469 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:42:54.883876 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f2c4147e-28a8-4afe-908c-1bb3d1557469 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:42:54.884841 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f2c4147e-28a8-4afe-908c-1bb3d1557469 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:42:54.885223 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f2c4147e-28a8-4afe-908c-1bb3d1557469 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:42:54.903972 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-930c543b-cf9a-49e0-bdd2-9052b5106d48 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:42:54.904447 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-930c543b-cf9a-49e0-bdd2-9052b5106d48 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:42:54.905252 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-930c543b-cf9a-49e0-bdd2-9052b5106d48 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:42:54.905687 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-930c543b-cf9a-49e0-bdd2-9052b5106d48 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:42:54.922926 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.wsgi [None req-930c543b-cf9a-49e0-bdd2-9052b5106d48 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] HTTP exception thrown: Instance f979bb50-149c-4173-bc59-6a77465e755e could not be found. Nov 09 20:42:54.923561 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-930c543b-cf9a-49e0-bdd2-9052b5106d48 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Returning 404 to user: Instance f979bb50-149c-4173-bc59-6a77465e755e could not be found. {{(pid=116103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 09 20:42:54.924855 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-930c543b-cf9a-49e0-bdd2-9052b5106d48 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] 10.222.0.25 "GET /compute/v2.1/servers/f979bb50-149c-4173-bc59-6a77465e755e" status: 404 len: 111 microversion: 2.1 time: 0.051476 Nov 09 20:42:54.925608 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1297/2624] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:42:54 2021] GET /compute/v2.1/servers/f979bb50-149c-4173-bc59-6a77465e755e => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 09 20:42:55.022193 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [req-6103a111-cc20-4be9-98e5-3b260bbcf554 req-afc92fe0-05fd-4ae0-b247-936b32a0028e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f979bb50-149c-4173-bc59-6a77465e755e", "name": "network-vif-deleted", "tag": "8b33d53b-0014-4527-bbfc-55150cd1f6d4"}]} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:42:55.024304 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 20:42:55.024304 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: warnings.warn(msg) Nov 09 20:42:55.031611 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-6103a111-cc20-4be9-98e5-3b260bbcf554 req-afc92fe0-05fd-4ae0-b247-936b32a0028e service nova] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:42:55.032199 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-6103a111-cc20-4be9-98e5-3b260bbcf554 req-afc92fe0-05fd-4ae0-b247-936b32a0028e service nova] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:42:55.043749 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.compute.server_external_events [req-6103a111-cc20-4be9-98e5-3b260bbcf554 req-afc92fe0-05fd-4ae0-b247-936b32a0028e service nova] Creating event network-vif-deleted:8b33d53b-0014-4527-bbfc-55150cd1f6d4 for instance f979bb50-149c-4173-bc59-6a77465e755e on hv-cinder-80135 Nov 09 20:42:55.048687 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [req-6103a111-cc20-4be9-98e5-3b260bbcf554 req-afc92fe0-05fd-4ae0-b247-936b32a0028e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030616 Nov 09 20:42:55.052365 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1298/2625] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Nov 9 20:42:55 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 20:42:55.085967 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-f2c4147e-28a8-4afe-908c-1bb3d1557469 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d26c07791240fcac7bcf26606fce8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9858a3c560894023a1fdd7e30f9759da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:42:55.093181 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-f2c4147e-28a8-4afe-908c-1bb3d1557469 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] 10.222.0.25 "GET /compute/v2.1/servers/10121fdc-8839-4431-8688-40eaedc47e3d" status: 200 len: 1267 microversion: 2.1 time: 0.222058 Nov 09 20:42:55.093749 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1328/2626] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:42:54 2021] GET /compute/v2.1/servers/10121fdc-8839-4431-8688-40eaedc47e3d => generated 1267 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:42:56.058297 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-0d0a8f21-bae6-4232-99de-957b38d3011d tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:42:56.058867 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-0d0a8f21-bae6-4232-99de-957b38d3011d tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] [instance: f634121a-0b50-440d-b976-14f1945e9dc2] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:42:56.064873 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0d0a8f21-bae6-4232-99de-957b38d3011d tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:42:56.065856 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0d0a8f21-bae6-4232-99de-957b38d3011d tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:42:56.066890 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0d0a8f21-bae6-4232-99de-957b38d3011d tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:42:56.067288 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-0d0a8f21-bae6-4232-99de-957b38d3011d tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:42:56.092076 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-0d0a8f21-bae6-4232-99de-957b38d3011d tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] [instance: f634121a-0b50-440d-b976-14f1945e9dc2] Going to try to terminate instance {{(pid=116103) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 09 20:42:56.110599 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-eab788fa-865f-47b7-bec0-f8c52833c944 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:42:56.111525 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-eab788fa-865f-47b7-bec0-f8c52833c944 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] [instance: 10121fdc-8839-4431-8688-40eaedc47e3d] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:42:56.118217 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-eab788fa-865f-47b7-bec0-f8c52833c944 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:42:56.118843 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-eab788fa-865f-47b7-bec0-f8c52833c944 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:42:56.119617 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-eab788fa-865f-47b7-bec0-f8c52833c944 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:42:56.120047 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-eab788fa-865f-47b7-bec0-f8c52833c944 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:42:56.188795 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-0d0a8f21-bae6-4232-99de-957b38d3011d tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] 10.222.0.25 "DELETE /compute/v2.1/servers/f634121a-0b50-440d-b976-14f1945e9dc2" status: 204 len: 0 microversion: 2.1 time: 0.134174 Nov 09 20:42:56.193239 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1299/2627] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Nov 9 20:42:56 2021] DELETE /compute/v2.1/servers/f634121a-0b50-440d-b976-14f1945e9dc2 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 09 20:42:56.201117 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-20914d05-5153-4a8f-9e50-71d319a4a12d tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:42:56.203430 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-20914d05-5153-4a8f-9e50-71d319a4a12d tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] [instance: f634121a-0b50-440d-b976-14f1945e9dc2] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:42:56.211373 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-20914d05-5153-4a8f-9e50-71d319a4a12d tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:42:56.212266 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-20914d05-5153-4a8f-9e50-71d319a4a12d tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:42:56.213419 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-20914d05-5153-4a8f-9e50-71d319a4a12d tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:42:56.214051 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-20914d05-5153-4a8f-9e50-71d319a4a12d tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:42:56.305108 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-eab788fa-865f-47b7-bec0-f8c52833c944 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d26c07791240fcac7bcf26606fce8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9858a3c560894023a1fdd7e30f9759da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:42:56.312818 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-eab788fa-865f-47b7-bec0-f8c52833c944 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] 10.222.0.25 "GET /compute/v2.1/servers/10121fdc-8839-4431-8688-40eaedc47e3d" status: 200 len: 1267 microversion: 2.1 time: 0.205665 Nov 09 20:42:56.323377 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1329/2628] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:42:56 2021] GET /compute/v2.1/servers/10121fdc-8839-4431-8688-40eaedc47e3d => generated 1267 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:42:56.374273 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-20914d05-5153-4a8f-9e50-71d319a4a12d tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05573fa698bd46e88032483a6cb0ad30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a7db7a0f06b4371a79629e21c8d4bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:42:56.382943 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-20914d05-5153-4a8f-9e50-71d319a4a12d tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] 10.222.0.25 "GET /compute/v2.1/servers/f634121a-0b50-440d-b976-14f1945e9dc2" status: 200 len: 1513 microversion: 2.1 time: 0.188408 Nov 09 20:42:56.383526 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1300/2629] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:42:56 2021] GET /compute/v2.1/servers/f634121a-0b50-440d-b976-14f1945e9dc2 => generated 1513 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 20:42:57.330516 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-fb175b20-1f30-45ed-9432-512ff617235d tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:42:57.331997 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-fb175b20-1f30-45ed-9432-512ff617235d tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] [instance: 10121fdc-8839-4431-8688-40eaedc47e3d] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:42:57.338264 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-fb175b20-1f30-45ed-9432-512ff617235d tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:42:57.338770 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-fb175b20-1f30-45ed-9432-512ff617235d tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:42:57.339717 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-fb175b20-1f30-45ed-9432-512ff617235d tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:42:57.340140 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-fb175b20-1f30-45ed-9432-512ff617235d tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:42:57.399450 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-5e9ed810-3a8b-49d5-832c-fb84da08f943 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:42:57.400055 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-5e9ed810-3a8b-49d5-832c-fb84da08f943 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] [instance: f634121a-0b50-440d-b976-14f1945e9dc2] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:42:57.406541 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5e9ed810-3a8b-49d5-832c-fb84da08f943 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:42:57.406990 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5e9ed810-3a8b-49d5-832c-fb84da08f943 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:42:57.407757 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5e9ed810-3a8b-49d5-832c-fb84da08f943 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:42:57.408187 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-5e9ed810-3a8b-49d5-832c-fb84da08f943 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:42:57.495106 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-fb175b20-1f30-45ed-9432-512ff617235d tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d26c07791240fcac7bcf26606fce8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9858a3c560894023a1fdd7e30f9759da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:42:57.502447 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-fb175b20-1f30-45ed-9432-512ff617235d tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] 10.222.0.25 "GET /compute/v2.1/servers/10121fdc-8839-4431-8688-40eaedc47e3d" status: 200 len: 1267 microversion: 2.1 time: 0.175581 Nov 09 20:42:57.503622 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1330/2630] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:42:57 2021] GET /compute/v2.1/servers/10121fdc-8839-4431-8688-40eaedc47e3d => generated 1267 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:42:57.561255 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-5e9ed810-3a8b-49d5-832c-fb84da08f943 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05573fa698bd46e88032483a6cb0ad30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a7db7a0f06b4371a79629e21c8d4bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:42:57.570027 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-5e9ed810-3a8b-49d5-832c-fb84da08f943 tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] 10.222.0.25 "GET /compute/v2.1/servers/f634121a-0b50-440d-b976-14f1945e9dc2" status: 200 len: 1513 microversion: 2.1 time: 0.174140 Nov 09 20:42:57.570674 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1301/2631] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:42:57 2021] GET /compute/v2.1/servers/f634121a-0b50-440d-b976-14f1945e9dc2 => generated 1513 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 20:42:58.202652 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [req-0b445ffe-5977-4af3-b874-a9093e2d8447 req-e7597309-f2d7-46f5-9670-9c604c64116f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f634121a-0b50-440d-b976-14f1945e9dc2", "name": "network-vif-deleted", "tag": "c1095bb4-ce3f-48c7-926a-b6e26611dbb1"}]} {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:42:58.204594 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 20:42:58.204594 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: warnings.warn(msg) Nov 09 20:42:58.212600 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [req-0b445ffe-5977-4af3-b874-a9093e2d8447 req-e7597309-f2d7-46f5-9670-9c604c64116f service nova] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:42:58.213059 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [req-0b445ffe-5977-4af3-b874-a9093e2d8447 req-e7597309-f2d7-46f5-9670-9c604c64116f service nova] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:42:58.227744 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.compute.server_external_events [req-0b445ffe-5977-4af3-b874-a9093e2d8447 req-e7597309-f2d7-46f5-9670-9c604c64116f service nova] Creating event network-vif-deleted:c1095bb4-ce3f-48c7-926a-b6e26611dbb1 for instance f634121a-0b50-440d-b976-14f1945e9dc2 on hv-cinder-80135 Nov 09 20:42:58.232746 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [req-0b445ffe-5977-4af3-b874-a9093e2d8447 req-e7597309-f2d7-46f5-9670-9c604c64116f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033906 Nov 09 20:42:58.233334 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1331/2632] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Nov 9 20:42:58 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:42:58.519792 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-63633e51-5f83-433e-9b98-48a2fc5954c8 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:42:58.520422 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-63633e51-5f83-433e-9b98-48a2fc5954c8 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] [instance: 10121fdc-8839-4431-8688-40eaedc47e3d] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:42:58.526573 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-63633e51-5f83-433e-9b98-48a2fc5954c8 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:42:58.527023 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-63633e51-5f83-433e-9b98-48a2fc5954c8 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:42:58.527792 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-63633e51-5f83-433e-9b98-48a2fc5954c8 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:42:58.528226 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-63633e51-5f83-433e-9b98-48a2fc5954c8 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:42:58.588310 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-c41ae18d-59c7-428c-973e-32f2527e89ad tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:42:58.589205 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-c41ae18d-59c7-428c-973e-32f2527e89ad tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] [instance: f634121a-0b50-440d-b976-14f1945e9dc2] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:42:58.595773 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c41ae18d-59c7-428c-973e-32f2527e89ad tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:42:58.596221 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c41ae18d-59c7-428c-973e-32f2527e89ad tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:42:58.597427 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c41ae18d-59c7-428c-973e-32f2527e89ad tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:42:58.598035 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c41ae18d-59c7-428c-973e-32f2527e89ad tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:42:58.632488 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c41ae18d-59c7-428c-973e-32f2527e89ad tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:42:58.632939 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-c41ae18d-59c7-428c-973e-32f2527e89ad tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:42:58.633389 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.objects.instance [None req-c41ae18d-59c7-428c-973e-32f2527e89ad tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lazy-loading 'fault' on Instance uuid f634121a-0b50-440d-b976-14f1945e9dc2 {{(pid=116102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 09 20:42:58.690305 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-c41ae18d-59c7-428c-973e-32f2527e89ad tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05573fa698bd46e88032483a6cb0ad30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a7db7a0f06b4371a79629e21c8d4bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:42:58.695648 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-63633e51-5f83-433e-9b98-48a2fc5954c8 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d26c07791240fcac7bcf26606fce8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9858a3c560894023a1fdd7e30f9759da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:42:58.703162 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-63633e51-5f83-433e-9b98-48a2fc5954c8 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] 10.222.0.25 "GET /compute/v2.1/servers/10121fdc-8839-4431-8688-40eaedc47e3d" status: 200 len: 1267 microversion: 2.1 time: 0.186954 Nov 09 20:42:58.704219 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1302/2633] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:42:58 2021] GET /compute/v2.1/servers/10121fdc-8839-4431-8688-40eaedc47e3d => generated 1267 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:42:58.704671 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-c41ae18d-59c7-428c-973e-32f2527e89ad tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] 10.222.0.25 "GET /compute/v2.1/servers/f634121a-0b50-440d-b976-14f1945e9dc2" status: 200 len: 1307 microversion: 2.1 time: 0.120737 Nov 09 20:42:58.705237 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1332/2634] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:42:58 2021] GET /compute/v2.1/servers/f634121a-0b50-440d-b976-14f1945e9dc2 => generated 1307 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 20:42:59.725774 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-28662908-c8d2-4bdc-8e26-cea77284ad21 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:42:59.726375 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-28662908-c8d2-4bdc-8e26-cea77284ad21 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] [instance: 10121fdc-8839-4431-8688-40eaedc47e3d] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:42:59.727767 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-a6cfcae4-20e1-4783-bb3c-fa341cf4bc8a tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:42:59.728510 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-a6cfcae4-20e1-4783-bb3c-fa341cf4bc8a tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] [instance: f634121a-0b50-440d-b976-14f1945e9dc2] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:42:59.740519 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-28662908-c8d2-4bdc-8e26-cea77284ad21 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:42:59.740963 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-28662908-c8d2-4bdc-8e26-cea77284ad21 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:42:59.741746 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-28662908-c8d2-4bdc-8e26-cea77284ad21 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:42:59.742155 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-28662908-c8d2-4bdc-8e26-cea77284ad21 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:42:59.743026 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a6cfcae4-20e1-4783-bb3c-fa341cf4bc8a tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:42:59.743483 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a6cfcae4-20e1-4783-bb3c-fa341cf4bc8a tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:42:59.744269 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a6cfcae4-20e1-4783-bb3c-fa341cf4bc8a tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:42:59.744732 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-a6cfcae4-20e1-4783-bb3c-fa341cf4bc8a tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:42:59.758934 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.wsgi [None req-a6cfcae4-20e1-4783-bb3c-fa341cf4bc8a tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] HTTP exception thrown: Instance f634121a-0b50-440d-b976-14f1945e9dc2 could not be found. Nov 09 20:42:59.759524 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-a6cfcae4-20e1-4783-bb3c-fa341cf4bc8a tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] Returning 404 to user: Instance f634121a-0b50-440d-b976-14f1945e9dc2 could not be found. {{(pid=116102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 09 20:42:59.760347 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-a6cfcae4-20e1-4783-bb3c-fa341cf4bc8a tempest-AttachVolumeNegativeTest-334861441 tempest-AttachVolumeNegativeTest-334861441-project] 10.222.0.25 "GET /compute/v2.1/servers/f634121a-0b50-440d-b976-14f1945e9dc2" status: 404 len: 111 microversion: 2.1 time: 0.042196 Nov 09 20:42:59.760924 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1333/2635] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:42:59 2021] GET /compute/v2.1/servers/f634121a-0b50-440d-b976-14f1945e9dc2 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 09 20:42:59.904715 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-28662908-c8d2-4bdc-8e26-cea77284ad21 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d26c07791240fcac7bcf26606fce8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9858a3c560894023a1fdd7e30f9759da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:42:59.915504 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-28662908-c8d2-4bdc-8e26-cea77284ad21 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] 10.222.0.25 "GET /compute/v2.1/servers/10121fdc-8839-4431-8688-40eaedc47e3d" status: 200 len: 1267 microversion: 2.1 time: 0.193394 Nov 09 20:42:59.917530 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1303/2636] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:42:59 2021] GET /compute/v2.1/servers/10121fdc-8839-4431-8688-40eaedc47e3d => generated 1267 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:43:00.933438 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-f0979d6e-4ca8-46f5-a6a5-1cc9e62ef96c tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:43:00.934045 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-f0979d6e-4ca8-46f5-a6a5-1cc9e62ef96c tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] [instance: 10121fdc-8839-4431-8688-40eaedc47e3d] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:43:00.941082 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f0979d6e-4ca8-46f5-a6a5-1cc9e62ef96c tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:43:00.941544 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f0979d6e-4ca8-46f5-a6a5-1cc9e62ef96c tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:43:00.942334 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f0979d6e-4ca8-46f5-a6a5-1cc9e62ef96c tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:43:00.942768 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-f0979d6e-4ca8-46f5-a6a5-1cc9e62ef96c tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:43:01.129673 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-f0979d6e-4ca8-46f5-a6a5-1cc9e62ef96c tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d26c07791240fcac7bcf26606fce8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9858a3c560894023a1fdd7e30f9759da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:43:01.137926 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-f0979d6e-4ca8-46f5-a6a5-1cc9e62ef96c tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] 10.222.0.25 "GET /compute/v2.1/servers/10121fdc-8839-4431-8688-40eaedc47e3d" status: 200 len: 1267 microversion: 2.1 time: 0.208122 Nov 09 20:43:01.138724 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1334/2637] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:43:00 2021] GET /compute/v2.1/servers/10121fdc-8839-4431-8688-40eaedc47e3d => generated 1267 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:43:01.488747 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [req-a8abc99a-d359-44fe-9151-29b8fdbf45b2 req-6ec29540-c1a5-4143-94bc-347f21bb5eff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10121fdc-8839-4431-8688-40eaedc47e3d", "name": "network-vif-plugged", "status": "completed", "tag": "59962065-ec11-434f-9050-0a01d332ac44"}]} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:43:01.490324 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 20:43:01.490324 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: warnings.warn(msg) Nov 09 20:43:01.500864 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-a8abc99a-d359-44fe-9151-29b8fdbf45b2 req-6ec29540-c1a5-4143-94bc-347f21bb5eff service nova] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:43:01.501999 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-a8abc99a-d359-44fe-9151-29b8fdbf45b2 req-6ec29540-c1a5-4143-94bc-347f21bb5eff service nova] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:43:01.520254 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.compute.server_external_events [req-a8abc99a-d359-44fe-9151-29b8fdbf45b2 req-6ec29540-c1a5-4143-94bc-347f21bb5eff service nova] Creating event network-vif-plugged:59962065-ec11-434f-9050-0a01d332ac44 for instance 10121fdc-8839-4431-8688-40eaedc47e3d on hv-cinder-80135 Nov 09 20:43:01.530678 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [req-a8abc99a-d359-44fe-9151-29b8fdbf45b2 req-6ec29540-c1a5-4143-94bc-347f21bb5eff service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041769 Nov 09 20:43:01.531752 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1304/2638] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Nov 9 20:43:01 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:43:01.794071 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-1df0dd92-9822-4d4e-b0be-eb13574305d8 tempest-VolumesNegativeTest-614350398 tempest-VolumesNegativeTest-614350398-project] Action: 'create', calling method: .version_select at 0x7fab36ebef70>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-2047461604", "metadata": {"Type": "work"}}} {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:43:01.796113 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-1df0dd92-9822-4d4e-b0be-eb13574305d8 tempest-VolumesNegativeTest-614350398 tempest-VolumesNegativeTest-614350398-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=116102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 09 20:43:01.797651 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-1df0dd92-9822-4d4e-b0be-eb13574305d8 tempest-VolumesNegativeTest-614350398 tempest-VolumesNegativeTest-614350398-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.264944 Nov 09 20:43:01.798293 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1335/2639] 10.222.0.25 () {60 vars in 1155 bytes} [Tue Nov 9 20:43:01 2021] POST /compute/v2.1/os-volumes => generated 127 bytes in 267 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Nov 09 20:43:01.808764 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-3dfcca5c-c206-40ba-97c6-52f44efb5105 tempest-VolumesNegativeTest-614350398 tempest-VolumesNegativeTest-614350398-project] Action: 'create', calling method: .version_select at 0x7fab3fef1160>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1496125228", "metadata": {"Type": "work"}}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:43:01.810273 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-3dfcca5c-c206-40ba-97c6-52f44efb5105 tempest-VolumesNegativeTest-614350398 tempest-VolumesNegativeTest-614350398-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=116103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 09 20:43:01.811098 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-3dfcca5c-c206-40ba-97c6-52f44efb5105 tempest-VolumesNegativeTest-614350398 tempest-VolumesNegativeTest-614350398-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.006342 Nov 09 20:43:01.811944 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1305/2640] 10.222.0.25 () {60 vars in 1155 bytes} [Tue Nov 9 20:43:01 2021] POST /compute/v2.1/os-volumes => generated 125 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 09 20:43:01.821538 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-2e254b0b-f472-4eb9-8e9b-ba080c08753c tempest-VolumesNegativeTest-614350398 tempest-VolumesNegativeTest-614350398-project] Action: 'create', calling method: .version_select at 0x7fab36d5af70>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1003380926", "metadata": {"Type": "work"}}} {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:43:01.822725 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-2e254b0b-f472-4eb9-8e9b-ba080c08753c tempest-VolumesNegativeTest-614350398 tempest-VolumesNegativeTest-614350398-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=116102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 09 20:43:01.823508 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-2e254b0b-f472-4eb9-8e9b-ba080c08753c tempest-VolumesNegativeTest-614350398 tempest-VolumesNegativeTest-614350398-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.005731 Nov 09 20:43:01.824007 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1336/2641] 10.222.0.25 () {60 vars in 1155 bytes} [Tue Nov 9 20:43:01 2021] POST /compute/v2.1/os-volumes => generated 121 bytes in 7 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 09 20:43:01.833771 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-d675a60c-a69e-4bf6-8309-c8fb88341edc tempest-VolumesNegativeTest-614350398 tempest-VolumesNegativeTest-614350398-project] Calling method '.version_select at 0x7fab3fe55af0>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:43:01.860719 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.wsgi [None req-d675a60c-a69e-4bf6-8309-c8fb88341edc tempest-VolumesNegativeTest-614350398 tempest-VolumesNegativeTest-614350398-project] HTTP exception thrown: Volume tempest-invalid-2031087168 could not be found. Nov 09 20:43:01.861372 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-d675a60c-a69e-4bf6-8309-c8fb88341edc tempest-VolumesNegativeTest-614350398 tempest-VolumesNegativeTest-614350398-project] Returning 404 to user: Volume tempest-invalid-2031087168 could not be found. {{(pid=116103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 09 20:43:01.862405 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-d675a60c-a69e-4bf6-8309-c8fb88341edc tempest-VolumesNegativeTest-614350398 tempest-VolumesNegativeTest-614350398-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/tempest-invalid-2031087168" status: 404 len: 99 microversion: 2.1 time: 0.032860 Nov 09 20:43:01.863016 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1306/2642] 10.222.0.25 () {58 vars in 1217 bytes} [Tue Nov 9 20:43:01 2021] DELETE /compute/v2.1/os-volumes/tempest-invalid-2031087168 => generated 99 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 09 20:43:01.872466 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-582c5d68-17a5-4072-babc-13a0dd9f1bce tempest-VolumesNegativeTest-614350398 tempest-VolumesNegativeTest-614350398-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004344 Nov 09 20:43:01.872955 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1337/2643] 10.222.0.25 () {58 vars in 1139 bytes} [Tue Nov 9 20:43:01 2021] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Nov 09 20:43:01.882282 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-38f0ac98-f9c6-420c-9aeb-99fef6652e7c tempest-VolumesNegativeTest-614350398 tempest-VolumesNegativeTest-614350398-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004447 Nov 09 20:43:01.882772 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1307/2644] 10.222.0.25 () {58 vars in 1136 bytes} [Tue Nov 9 20:43:01 2021] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Nov 09 20:43:01.891038 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-b7c94d7b-de07-4511-9b9e-a7dfee3b3501 tempest-VolumesNegativeTest-614350398 tempest-VolumesNegativeTest-614350398-project] Calling method '.version_select at 0x7fab36d5a3a0>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:43:01.918169 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.wsgi [None req-b7c94d7b-de07-4511-9b9e-a7dfee3b3501 tempest-VolumesNegativeTest-614350398 tempest-VolumesNegativeTest-614350398-project] HTTP exception thrown: Volume e36a1413-e71f-4928-9e71-fe0f15a96db5 could not be found. Nov 09 20:43:01.918791 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-b7c94d7b-de07-4511-9b9e-a7dfee3b3501 tempest-VolumesNegativeTest-614350398 tempest-VolumesNegativeTest-614350398-project] Returning 404 to user: Volume e36a1413-e71f-4928-9e71-fe0f15a96db5 could not be found. {{(pid=116102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 09 20:43:01.919601 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-b7c94d7b-de07-4511-9b9e-a7dfee3b3501 tempest-VolumesNegativeTest-614350398 tempest-VolumesNegativeTest-614350398-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/e36a1413-e71f-4928-9e71-fe0f15a96db5" status: 404 len: 109 microversion: 2.1 time: 0.032082 Nov 09 20:43:01.923258 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1338/2645] 10.222.0.25 () {58 vars in 1247 bytes} [Tue Nov 9 20:43:01 2021] DELETE /compute/v2.1/os-volumes/e36a1413-e71f-4928-9e71-fe0f15a96db5 => generated 109 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 09 20:43:01.929355 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-a82327a6-28cb-4e00-9fae-362af23ce26e tempest-VolumesNegativeTest-614350398 tempest-VolumesNegativeTest-614350398-project] Calling method '.version_select at 0x7fab3fe16f70>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:43:01.956630 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.wsgi [None req-a82327a6-28cb-4e00-9fae-362af23ce26e tempest-VolumesNegativeTest-614350398 tempest-VolumesNegativeTest-614350398-project] HTTP exception thrown: Volume d11a82bc-07ba-4840-aca2-a2a993d64528 could not be found. Nov 09 20:43:01.957401 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-a82327a6-28cb-4e00-9fae-362af23ce26e tempest-VolumesNegativeTest-614350398 tempest-VolumesNegativeTest-614350398-project] Returning 404 to user: Volume d11a82bc-07ba-4840-aca2-a2a993d64528 could not be found. {{(pid=116103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 09 20:43:01.958211 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-a82327a6-28cb-4e00-9fae-362af23ce26e tempest-VolumesNegativeTest-614350398 tempest-VolumesNegativeTest-614350398-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/d11a82bc-07ba-4840-aca2-a2a993d64528" status: 404 len: 109 microversion: 2.1 time: 0.032427 Nov 09 20:43:01.958744 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1308/2646] 10.222.0.25 () {58 vars in 1244 bytes} [Tue Nov 9 20:43:01 2021] GET /compute/v2.1/os-volumes/d11a82bc-07ba-4840-aca2-a2a993d64528 => generated 109 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 09 20:43:02.155645 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-ba0abaa0-c2fd-4e4d-9e95-21ebd38be22f tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:43:02.156501 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-ba0abaa0-c2fd-4e4d-9e95-21ebd38be22f tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] [instance: 10121fdc-8839-4431-8688-40eaedc47e3d] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:43:02.163131 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ba0abaa0-c2fd-4e4d-9e95-21ebd38be22f tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:43:02.163668 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ba0abaa0-c2fd-4e4d-9e95-21ebd38be22f tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:43:02.164740 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ba0abaa0-c2fd-4e4d-9e95-21ebd38be22f tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:43:02.165349 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ba0abaa0-c2fd-4e4d-9e95-21ebd38be22f tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:43:02.312430 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-ba0abaa0-c2fd-4e4d-9e95-21ebd38be22f tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d26c07791240fcac7bcf26606fce8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9858a3c560894023a1fdd7e30f9759da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:43:02.320631 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-ba0abaa0-c2fd-4e4d-9e95-21ebd38be22f tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] 10.222.0.25 "GET /compute/v2.1/servers/10121fdc-8839-4431-8688-40eaedc47e3d" status: 200 len: 1267 microversion: 2.1 time: 0.169395 Nov 09 20:43:02.321200 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1339/2647] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:43:02 2021] GET /compute/v2.1/servers/10121fdc-8839-4431-8688-40eaedc47e3d => generated 1267 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:43:03.338889 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-52f3f826-54ac-4d6b-a724-c8394b79ddda tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:43:03.339605 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-52f3f826-54ac-4d6b-a724-c8394b79ddda tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] [instance: 10121fdc-8839-4431-8688-40eaedc47e3d] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:43:03.345865 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-52f3f826-54ac-4d6b-a724-c8394b79ddda tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:43:03.347099 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-52f3f826-54ac-4d6b-a724-c8394b79ddda tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:43:03.347973 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-52f3f826-54ac-4d6b-a724-c8394b79ddda tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:43:03.348363 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-52f3f826-54ac-4d6b-a724-c8394b79ddda tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:43:03.486096 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-52f3f826-54ac-4d6b-a724-c8394b79ddda tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d26c07791240fcac7bcf26606fce8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9858a3c560894023a1fdd7e30f9759da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:43:03.494148 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-52f3f826-54ac-4d6b-a724-c8394b79ddda tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] 10.222.0.25 "GET /compute/v2.1/servers/10121fdc-8839-4431-8688-40eaedc47e3d" status: 200 len: 1454 microversion: 2.1 time: 0.159933 Nov 09 20:43:03.494703 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1309/2648] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:43:03 2021] GET /compute/v2.1/servers/10121fdc-8839-4431-8688-40eaedc47e3d => generated 1454 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:43:03.510086 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-75c9aa9d-cdc4-4018-b7b4-8d9fa8db297b tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:43:03.510771 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-75c9aa9d-cdc4-4018-b7b4-8d9fa8db297b tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] [instance: 10121fdc-8839-4431-8688-40eaedc47e3d] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:43:03.517338 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-75c9aa9d-cdc4-4018-b7b4-8d9fa8db297b tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:43:03.517921 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-75c9aa9d-cdc4-4018-b7b4-8d9fa8db297b tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:43:03.518791 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-75c9aa9d-cdc4-4018-b7b4-8d9fa8db297b tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:43:03.519475 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-75c9aa9d-cdc4-4018-b7b4-8d9fa8db297b tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:43:03.657829 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-75c9aa9d-cdc4-4018-b7b4-8d9fa8db297b tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d26c07791240fcac7bcf26606fce8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9858a3c560894023a1fdd7e30f9759da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:43:03.666504 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-75c9aa9d-cdc4-4018-b7b4-8d9fa8db297b tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] 10.222.0.25 "GET /compute/v2.1/servers/10121fdc-8839-4431-8688-40eaedc47e3d" status: 200 len: 1454 microversion: 2.1 time: 0.160172 Nov 09 20:43:03.667327 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1340/2649] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:43:03 2021] GET /compute/v2.1/servers/10121fdc-8839-4431-8688-40eaedc47e3d => generated 1454 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:43:06.143333 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [req-5b590f20-85c6-47f9-b67a-6e10c752deef req-4d720cfb-37a2-4137-8414-e00ed02b8e73 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10121fdc-8839-4431-8688-40eaedc47e3d", "tag": "59962065-ec11-434f-9050-0a01d332ac44"}]} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:43:06.145389 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 20:43:06.145389 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: warnings.warn(msg) Nov 09 20:43:06.152452 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-5b590f20-85c6-47f9-b67a-6e10c752deef req-4d720cfb-37a2-4137-8414-e00ed02b8e73 service nova] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:43:06.153234 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-5b590f20-85c6-47f9-b67a-6e10c752deef req-4d720cfb-37a2-4137-8414-e00ed02b8e73 service nova] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:43:06.165374 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.compute.server_external_events [req-5b590f20-85c6-47f9-b67a-6e10c752deef req-4d720cfb-37a2-4137-8414-e00ed02b8e73 service nova] Creating event network-changed:59962065-ec11-434f-9050-0a01d332ac44 for instance 10121fdc-8839-4431-8688-40eaedc47e3d on hv-cinder-80135 Nov 09 20:43:06.170839 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [req-5b590f20-85c6-47f9-b67a-6e10c752deef req-4d720cfb-37a2-4137-8414-e00ed02b8e73 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.166752 Nov 09 20:43:06.172070 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1310/2650] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Nov 9 20:43:06 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:45:33.091505 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: ERROR oslo.messaging._drivers.impl_rabbit [-] [191f0ded-b252-489d-a76b-b568a9711d9e] AMQP server on 10.222.0.25:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 09 20:45:33.094949 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-ed0c4de2-e875-46c8-8756-7b5a53359523 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:45:33.095440 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-ed0c4de2-e875-46c8-8756-7b5a53359523 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] [instance: 10121fdc-8839-4431-8688-40eaedc47e3d] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:45:33.101305 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ed0c4de2-e875-46c8-8756-7b5a53359523 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:45:33.101752 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ed0c4de2-e875-46c8-8756-7b5a53359523 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:45:33.102514 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ed0c4de2-e875-46c8-8756-7b5a53359523 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:45:33.102943 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-ed0c4de2-e875-46c8-8756-7b5a53359523 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:45:33.127867 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-ed0c4de2-e875-46c8-8756-7b5a53359523 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] [instance: 10121fdc-8839-4431-8688-40eaedc47e3d] Going to try to terminate instance {{(pid=116102) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 09 20:45:33.199661 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-ed0c4de2-e875-46c8-8756-7b5a53359523 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] 10.222.0.25 "DELETE /compute/v2.1/servers/10121fdc-8839-4431-8688-40eaedc47e3d" status: 204 len: 0 microversion: 2.1 time: 0.110796 Nov 09 20:45:33.200805 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1341/2651] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Nov 9 20:45:33 2021] DELETE /compute/v2.1/servers/10121fdc-8839-4431-8688-40eaedc47e3d => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 09 20:45:33.206936 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: ERROR oslo.messaging._drivers.impl_rabbit [-] [212f8895-2a68-490b-9f34-619e00352d8d] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 09 20:45:33.212475 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-8da2a801-2d4d-4b6d-8c92-963dea32ee8f tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:45:33.213165 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-8da2a801-2d4d-4b6d-8c92-963dea32ee8f tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] [instance: 10121fdc-8839-4431-8688-40eaedc47e3d] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:45:33.219755 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8da2a801-2d4d-4b6d-8c92-963dea32ee8f tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:45:33.220223 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8da2a801-2d4d-4b6d-8c92-963dea32ee8f tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:45:33.221026 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8da2a801-2d4d-4b6d-8c92-963dea32ee8f tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:45:33.221451 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-8da2a801-2d4d-4b6d-8c92-963dea32ee8f tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:45:33.355670 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-8da2a801-2d4d-4b6d-8c92-963dea32ee8f tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d26c07791240fcac7bcf26606fce8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9858a3c560894023a1fdd7e30f9759da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:45:33.363810 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-8da2a801-2d4d-4b6d-8c92-963dea32ee8f tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] 10.222.0.25 "GET /compute/v2.1/servers/10121fdc-8839-4431-8688-40eaedc47e3d" status: 200 len: 1579 microversion: 2.1 time: 0.158777 Nov 09 20:45:33.364366 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1311/2652] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:45:33 2021] GET /compute/v2.1/servers/10121fdc-8839-4431-8688-40eaedc47e3d => generated 1579 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:45:34.384050 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-67abc20a-3b25-4116-9354-f52856e83b0d tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:45:34.384758 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-67abc20a-3b25-4116-9354-f52856e83b0d tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] [instance: 10121fdc-8839-4431-8688-40eaedc47e3d] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:45:34.403815 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-67abc20a-3b25-4116-9354-f52856e83b0d tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:45:34.404267 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-67abc20a-3b25-4116-9354-f52856e83b0d tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:45:34.405076 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-67abc20a-3b25-4116-9354-f52856e83b0d tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:45:34.405512 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-67abc20a-3b25-4116-9354-f52856e83b0d tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:45:34.411968 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO oslo.messaging._drivers.impl_rabbit [-] [191f0ded-b252-489d-a76b-b568a9711d9e] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 47590. Nov 09 20:45:34.538610 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-67abc20a-3b25-4116-9354-f52856e83b0d tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d26c07791240fcac7bcf26606fce8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9858a3c560894023a1fdd7e30f9759da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:45:34.546537 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-67abc20a-3b25-4116-9354-f52856e83b0d tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] 10.222.0.25 "GET /compute/v2.1/servers/10121fdc-8839-4431-8688-40eaedc47e3d" status: 200 len: 1579 microversion: 2.1 time: 0.168421 Nov 09 20:45:34.547098 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1342/2653] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:45:34 2021] GET /compute/v2.1/servers/10121fdc-8839-4431-8688-40eaedc47e3d => generated 1579 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:45:35.563474 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-e62af687-3301-4b1a-8a77-387b8dfb679e tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:45:35.564095 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-e62af687-3301-4b1a-8a77-387b8dfb679e tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] [instance: 10121fdc-8839-4431-8688-40eaedc47e3d] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:45:35.581923 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [req-0f2e3e64-c66e-4272-83c3-9c60f998af0d req-6f223b09-d0d8-47e2-af3c-dd632143e8d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10121fdc-8839-4431-8688-40eaedc47e3d", "name": "network-vif-deleted", "tag": "59962065-ec11-434f-9050-0a01d332ac44"}]} {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:45:35.583439 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 20:45:35.583439 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: warnings.warn(msg) Nov 09 20:45:35.583623 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e62af687-3301-4b1a-8a77-387b8dfb679e tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:45:35.583911 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e62af687-3301-4b1a-8a77-387b8dfb679e tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:45:35.584875 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e62af687-3301-4b1a-8a77-387b8dfb679e tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:45:35.585327 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-e62af687-3301-4b1a-8a77-387b8dfb679e tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:45:35.593714 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [req-0f2e3e64-c66e-4272-83c3-9c60f998af0d req-6f223b09-d0d8-47e2-af3c-dd632143e8d2 service nova] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:45:35.595399 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [req-0f2e3e64-c66e-4272-83c3-9c60f998af0d req-6f223b09-d0d8-47e2-af3c-dd632143e8d2 service nova] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:45:35.607426 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO oslo.messaging._drivers.impl_rabbit [-] [212f8895-2a68-490b-9f34-619e00352d8d] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 47596. Nov 09 20:45:35.622790 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.compute.server_external_events [req-0f2e3e64-c66e-4272-83c3-9c60f998af0d req-6f223b09-d0d8-47e2-af3c-dd632143e8d2 service nova] Creating event network-vif-deleted:59962065-ec11-434f-9050-0a01d332ac44 for instance 10121fdc-8839-4431-8688-40eaedc47e3d on hv-cinder-80135 Nov 09 20:45:35.638254 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [req-0f2e3e64-c66e-4272-83c3-9c60f998af0d req-6f223b09-d0d8-47e2-af3c-dd632143e8d2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060926 Nov 09 20:45:35.639200 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1343/2654] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Nov 9 20:45:35 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 20:45:35.661953 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-e62af687-3301-4b1a-8a77-387b8dfb679e tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d26c07791240fcac7bcf26606fce8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9858a3c560894023a1fdd7e30f9759da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:45:35.671170 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-e62af687-3301-4b1a-8a77-387b8dfb679e tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] 10.222.0.25 "GET /compute/v2.1/servers/10121fdc-8839-4431-8688-40eaedc47e3d" status: 200 len: 1511 microversion: 2.1 time: 0.111808 Nov 09 20:45:35.671948 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1312/2655] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:45:35 2021] GET /compute/v2.1/servers/10121fdc-8839-4431-8688-40eaedc47e3d => generated 1511 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:45:36.689371 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-d33c5982-cb5b-48ce-914f-04e19bcd277f tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:45:36.690058 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-d33c5982-cb5b-48ce-914f-04e19bcd277f tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] [instance: 10121fdc-8839-4431-8688-40eaedc47e3d] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:45:36.696009 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d33c5982-cb5b-48ce-914f-04e19bcd277f tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:45:36.696471 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d33c5982-cb5b-48ce-914f-04e19bcd277f tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:45:36.697235 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d33c5982-cb5b-48ce-914f-04e19bcd277f tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:45:36.697660 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-d33c5982-cb5b-48ce-914f-04e19bcd277f tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:45:36.710953 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.wsgi [None req-d33c5982-cb5b-48ce-914f-04e19bcd277f tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] HTTP exception thrown: Instance 10121fdc-8839-4431-8688-40eaedc47e3d could not be found. Nov 09 20:45:36.711526 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-d33c5982-cb5b-48ce-914f-04e19bcd277f tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Returning 404 to user: Instance 10121fdc-8839-4431-8688-40eaedc47e3d could not be found. {{(pid=116102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 09 20:45:36.712324 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-d33c5982-cb5b-48ce-914f-04e19bcd277f tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] 10.222.0.25 "GET /compute/v2.1/servers/10121fdc-8839-4431-8688-40eaedc47e3d" status: 404 len: 111 microversion: 2.1 time: 0.027624 Nov 09 20:45:36.713015 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1344/2656] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:45:36 2021] GET /compute/v2.1/servers/10121fdc-8839-4431-8688-40eaedc47e3d => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 09 20:45:36.803644 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-68a9ea38-72f4-40f5-adfa-8f19de76a09e tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-65247038", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2081092357", "security_groups": [{"name": "tempest-secgroup-smoke-1239717613"}], "block_device_mapping_v2": [{"uuid": "daec9359-3f1d-43d3-bbc8-e918dfec97a0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f3b9dec4-c021-48b3-8c75-239f3e6bb8fa"}]}} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:45:36.913876 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.network.neutron [None req-68a9ea38-72f4-40f5-adfa-8f19de76a09e tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] validate_networks() for [('f3b9dec4-c021-48b3-8c75-239f3e6bb8fa', None, None, None, None, None)] {{(pid=116103) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 09 20:45:37.273462 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.virt.hardware [None req-68a9ea38-72f4-40f5-adfa-8f19de76a09e tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Flavor limits 0:0:0 {{(pid=116103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 09 20:45:37.273895 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.virt.hardware [None req-68a9ea38-72f4-40f5-adfa-8f19de76a09e tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Image limits 0:0:0 {{(pid=116103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 09 20:45:37.274360 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.virt.hardware [None req-68a9ea38-72f4-40f5-adfa-8f19de76a09e tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Flavor pref 0:0:0 {{(pid=116103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 09 20:45:37.274767 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.virt.hardware [None req-68a9ea38-72f4-40f5-adfa-8f19de76a09e tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Image pref 0:0:0 {{(pid=116103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 09 20:45:37.275173 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.virt.hardware [None req-68a9ea38-72f4-40f5-adfa-8f19de76a09e tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 09 20:45:37.283948 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-68a9ea38-72f4-40f5-adfa-8f19de76a09e tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:45:37.284392 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-68a9ea38-72f4-40f5-adfa-8f19de76a09e tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:45:37.285225 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-68a9ea38-72f4-40f5-adfa-8f19de76a09e tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:45:37.285938 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-68a9ea38-72f4-40f5-adfa-8f19de76a09e tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:45:37.302458 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.quota [None req-68a9ea38-72f4-40f5-adfa-8f19de76a09e tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Getting quotas for project 9858a3c560894023a1fdd7e30f9759da. Resources: {'cores', 'instances', 'ram'} {{(pid=116103) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 09 20:45:37.306402 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.quota [None req-68a9ea38-72f4-40f5-adfa-8f19de76a09e tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Getting quotas for user 03d26c07791240fcac7bcf26606fce8f and project 9858a3c560894023a1fdd7e30f9759da. Resources: {'cores', 'instances', 'ram'} {{(pid=116103) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 09 20:45:37.363344 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-68a9ea38-72f4-40f5-adfa-8f19de76a09e tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Going to run 1 instances... {{(pid=116103) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 09 20:45:37.365501 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-68a9ea38-72f4-40f5-adfa-8f19de76a09e tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] [instance: 5983cbdc-7a92-49ec-a092-68ee6f1accdb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='daec9359-3f1d-43d3-bbc8-e918dfec97a0',volume_size=None,volume_type=None)] {{(pid=116103) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 09 20:45:37.483337 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-68a9ea38-72f4-40f5-adfa-8f19de76a09e tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.683211 Nov 09 20:45:37.483969 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1313/2657] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Nov 9 20:45:36 2021] POST /compute/v2.1/servers => generated 406 bytes in 684 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 09 20:45:37.494816 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-23aef119-17a9-47cb-ac9f-e2918b80aaff tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:45:37.495551 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-23aef119-17a9-47cb-ac9f-e2918b80aaff tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] [instance: 5983cbdc-7a92-49ec-a092-68ee6f1accdb] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:45:37.550947 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-23aef119-17a9-47cb-ac9f-e2918b80aaff tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d26c07791240fcac7bcf26606fce8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9858a3c560894023a1fdd7e30f9759da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:45:37.557348 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-23aef119-17a9-47cb-ac9f-e2918b80aaff tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] 10.222.0.25 "GET /compute/v2.1/servers/5983cbdc-7a92-49ec-a092-68ee6f1accdb" status: 200 len: 1093 microversion: 2.1 time: 0.066768 Nov 09 20:45:37.557940 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1345/2658] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:45:37 2021] GET /compute/v2.1/servers/5983cbdc-7a92-49ec-a092-68ee6f1accdb => generated 1093 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 20:45:38.575215 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-6e1a134a-f797-4dd8-927f-0acc316f8728 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:45:38.575740 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-6e1a134a-f797-4dd8-927f-0acc316f8728 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] [instance: 5983cbdc-7a92-49ec-a092-68ee6f1accdb] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:45:38.582282 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6e1a134a-f797-4dd8-927f-0acc316f8728 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:45:38.582719 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6e1a134a-f797-4dd8-927f-0acc316f8728 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:45:38.583483 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6e1a134a-f797-4dd8-927f-0acc316f8728 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:45:38.583911 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6e1a134a-f797-4dd8-927f-0acc316f8728 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:45:38.647499 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-6e1a134a-f797-4dd8-927f-0acc316f8728 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d26c07791240fcac7bcf26606fce8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9858a3c560894023a1fdd7e30f9759da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:45:38.657874 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-6e1a134a-f797-4dd8-927f-0acc316f8728 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] 10.222.0.25 "GET /compute/v2.1/servers/5983cbdc-7a92-49ec-a092-68ee6f1accdb" status: 200 len: 1209 microversion: 2.1 time: 0.086823 Nov 09 20:45:38.658608 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1314/2659] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:45:38 2021] GET /compute/v2.1/servers/5983cbdc-7a92-49ec-a092-68ee6f1accdb => generated 1209 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:45:39.681584 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-de2a1394-7235-4d42-b12d-fc990c6f7508 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:45:39.683495 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-de2a1394-7235-4d42-b12d-fc990c6f7508 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] [instance: 5983cbdc-7a92-49ec-a092-68ee6f1accdb] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:45:39.692767 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-de2a1394-7235-4d42-b12d-fc990c6f7508 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:45:39.693466 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-de2a1394-7235-4d42-b12d-fc990c6f7508 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:45:39.694465 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-de2a1394-7235-4d42-b12d-fc990c6f7508 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:45:39.695067 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-de2a1394-7235-4d42-b12d-fc990c6f7508 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:45:39.836133 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-de2a1394-7235-4d42-b12d-fc990c6f7508 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d26c07791240fcac7bcf26606fce8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9858a3c560894023a1fdd7e30f9759da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:45:39.844461 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-de2a1394-7235-4d42-b12d-fc990c6f7508 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] 10.222.0.25 "GET /compute/v2.1/servers/5983cbdc-7a92-49ec-a092-68ee6f1accdb" status: 200 len: 1265 microversion: 2.1 time: 0.173120 Nov 09 20:45:39.845625 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1346/2660] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:45:39 2021] GET /compute/v2.1/servers/5983cbdc-7a92-49ec-a092-68ee6f1accdb => generated 1265 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:45:39.888370 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [req-1a6cca54-fdcf-4f5d-b134-06bc97a6bfdb req-18fc51ac-453a-44c5-b463-b8513c94b5ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5983cbdc-7a92-49ec-a092-68ee6f1accdb", "tag": "6f01d5e3-9ef2-4b67-8715-660581726999"}]} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:45:39.890321 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 20:45:39.890321 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: warnings.warn(msg) Nov 09 20:45:39.902744 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-1a6cca54-fdcf-4f5d-b134-06bc97a6bfdb req-18fc51ac-453a-44c5-b463-b8513c94b5ef service nova] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:45:39.903215 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-1a6cca54-fdcf-4f5d-b134-06bc97a6bfdb req-18fc51ac-453a-44c5-b463-b8513c94b5ef service nova] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:45:39.919655 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.compute.server_external_events [req-1a6cca54-fdcf-4f5d-b134-06bc97a6bfdb req-18fc51ac-453a-44c5-b463-b8513c94b5ef service nova] Creating event network-changed:6f01d5e3-9ef2-4b67-8715-660581726999 for instance 5983cbdc-7a92-49ec-a092-68ee6f1accdb on hv-cinder-80135 Nov 09 20:45:39.923811 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: ERROR oslo.messaging._drivers.impl_rabbit [req-1a6cca54-fdcf-4f5d-b134-06bc97a6bfdb req-18fc51ac-453a-44c5-b463-b8513c94b5ef service nova] [e74ec4ee-5a2c-4e9b-a3cb-77ede2633c68] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 09 20:45:40.862261 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-4aa7e65f-110b-4411-9104-40f56416c90b tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:45:40.862872 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-4aa7e65f-110b-4411-9104-40f56416c90b tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] [instance: 5983cbdc-7a92-49ec-a092-68ee6f1accdb] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:45:40.869227 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-4aa7e65f-110b-4411-9104-40f56416c90b tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:45:40.869688 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-4aa7e65f-110b-4411-9104-40f56416c90b tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:45:40.870455 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-4aa7e65f-110b-4411-9104-40f56416c90b tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:45:40.870891 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-4aa7e65f-110b-4411-9104-40f56416c90b tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:45:40.941241 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO oslo.messaging._drivers.impl_rabbit [req-1a6cca54-fdcf-4f5d-b134-06bc97a6bfdb req-18fc51ac-453a-44c5-b463-b8513c94b5ef service nova] [e74ec4ee-5a2c-4e9b-a3cb-77ede2633c68] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 47632. Nov 09 20:45:40.945041 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [req-1a6cca54-fdcf-4f5d-b134-06bc97a6bfdb req-18fc51ac-453a-44c5-b463-b8513c94b5ef service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.060828 Nov 09 20:45:40.945642 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1315/2661] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Nov 9 20:45:39 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:45:41.007135 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-4aa7e65f-110b-4411-9104-40f56416c90b tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d26c07791240fcac7bcf26606fce8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9858a3c560894023a1fdd7e30f9759da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:45:41.014792 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-4aa7e65f-110b-4411-9104-40f56416c90b tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] 10.222.0.25 "GET /compute/v2.1/servers/5983cbdc-7a92-49ec-a092-68ee6f1accdb" status: 200 len: 1265 microversion: 2.1 time: 0.156153 Nov 09 20:45:41.015358 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1347/2662] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:45:40 2021] GET /compute/v2.1/servers/5983cbdc-7a92-49ec-a092-68ee6f1accdb => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 20:45:42.031839 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-3e06d22e-19fc-48b9-afd1-b6b75fc21dd0 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:45:42.032559 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-3e06d22e-19fc-48b9-afd1-b6b75fc21dd0 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] [instance: 5983cbdc-7a92-49ec-a092-68ee6f1accdb] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:45:42.038633 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3e06d22e-19fc-48b9-afd1-b6b75fc21dd0 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:45:42.039081 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3e06d22e-19fc-48b9-afd1-b6b75fc21dd0 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:45:42.039853 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3e06d22e-19fc-48b9-afd1-b6b75fc21dd0 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:45:42.040290 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-3e06d22e-19fc-48b9-afd1-b6b75fc21dd0 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:45:42.169585 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-3e06d22e-19fc-48b9-afd1-b6b75fc21dd0 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d26c07791240fcac7bcf26606fce8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9858a3c560894023a1fdd7e30f9759da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:45:42.177275 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-3e06d22e-19fc-48b9-afd1-b6b75fc21dd0 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] 10.222.0.25 "GET /compute/v2.1/servers/5983cbdc-7a92-49ec-a092-68ee6f1accdb" status: 200 len: 1265 microversion: 2.1 time: 0.150036 Nov 09 20:45:42.177968 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1316/2663] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:45:42 2021] GET /compute/v2.1/servers/5983cbdc-7a92-49ec-a092-68ee6f1accdb => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:45:43.195166 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-869eb13d-7816-4e3c-93e0-bf95125350f2 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:45:43.195772 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-869eb13d-7816-4e3c-93e0-bf95125350f2 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] [instance: 5983cbdc-7a92-49ec-a092-68ee6f1accdb] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:45:43.202697 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-869eb13d-7816-4e3c-93e0-bf95125350f2 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:45:43.203140 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-869eb13d-7816-4e3c-93e0-bf95125350f2 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:45:43.203903 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-869eb13d-7816-4e3c-93e0-bf95125350f2 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:45:43.204334 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-869eb13d-7816-4e3c-93e0-bf95125350f2 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:45:43.338998 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-869eb13d-7816-4e3c-93e0-bf95125350f2 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d26c07791240fcac7bcf26606fce8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9858a3c560894023a1fdd7e30f9759da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:45:43.346760 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-869eb13d-7816-4e3c-93e0-bf95125350f2 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] 10.222.0.25 "GET /compute/v2.1/servers/5983cbdc-7a92-49ec-a092-68ee6f1accdb" status: 200 len: 1265 microversion: 2.1 time: 0.155378 Nov 09 20:45:43.347324 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1348/2664] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:45:43 2021] GET /compute/v2.1/servers/5983cbdc-7a92-49ec-a092-68ee6f1accdb => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:45:44.363557 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-903db8cf-92a4-42c3-867d-39ee146280cf tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:45:44.364164 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-903db8cf-92a4-42c3-867d-39ee146280cf tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] [instance: 5983cbdc-7a92-49ec-a092-68ee6f1accdb] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:45:44.370347 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-903db8cf-92a4-42c3-867d-39ee146280cf tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:45:44.370793 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-903db8cf-92a4-42c3-867d-39ee146280cf tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:45:44.371557 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-903db8cf-92a4-42c3-867d-39ee146280cf tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:45:44.371987 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-903db8cf-92a4-42c3-867d-39ee146280cf tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:45:44.500696 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-903db8cf-92a4-42c3-867d-39ee146280cf tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d26c07791240fcac7bcf26606fce8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9858a3c560894023a1fdd7e30f9759da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:45:44.508425 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-903db8cf-92a4-42c3-867d-39ee146280cf tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] 10.222.0.25 "GET /compute/v2.1/servers/5983cbdc-7a92-49ec-a092-68ee6f1accdb" status: 200 len: 1265 microversion: 2.1 time: 0.148472 Nov 09 20:45:44.508977 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1317/2665] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:45:44 2021] GET /compute/v2.1/servers/5983cbdc-7a92-49ec-a092-68ee6f1accdb => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:45:45.524861 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-442c647d-0940-435f-8ba7-195a20c5bac8 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:45:45.525455 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-442c647d-0940-435f-8ba7-195a20c5bac8 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] [instance: 5983cbdc-7a92-49ec-a092-68ee6f1accdb] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:45:45.531673 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-442c647d-0940-435f-8ba7-195a20c5bac8 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:45:45.532109 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-442c647d-0940-435f-8ba7-195a20c5bac8 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:45:45.532924 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-442c647d-0940-435f-8ba7-195a20c5bac8 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:45:45.533346 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-442c647d-0940-435f-8ba7-195a20c5bac8 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:45:45.661678 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-442c647d-0940-435f-8ba7-195a20c5bac8 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d26c07791240fcac7bcf26606fce8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9858a3c560894023a1fdd7e30f9759da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:45:45.668812 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-442c647d-0940-435f-8ba7-195a20c5bac8 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] 10.222.0.25 "GET /compute/v2.1/servers/5983cbdc-7a92-49ec-a092-68ee6f1accdb" status: 200 len: 1265 microversion: 2.1 time: 0.147503 Nov 09 20:45:45.669361 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1349/2666] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:45:45 2021] GET /compute/v2.1/servers/5983cbdc-7a92-49ec-a092-68ee6f1accdb => generated 1265 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:45:46.688347 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-90ddb279-3376-4f57-b8fc-75f184a8da44 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:45:46.688972 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-90ddb279-3376-4f57-b8fc-75f184a8da44 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] [instance: 5983cbdc-7a92-49ec-a092-68ee6f1accdb] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:45:46.695067 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-90ddb279-3376-4f57-b8fc-75f184a8da44 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:45:46.695509 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-90ddb279-3376-4f57-b8fc-75f184a8da44 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:45:46.696258 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-90ddb279-3376-4f57-b8fc-75f184a8da44 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:45:46.696710 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-90ddb279-3376-4f57-b8fc-75f184a8da44 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:45:46.828340 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-90ddb279-3376-4f57-b8fc-75f184a8da44 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d26c07791240fcac7bcf26606fce8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9858a3c560894023a1fdd7e30f9759da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:45:46.835704 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-90ddb279-3376-4f57-b8fc-75f184a8da44 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] 10.222.0.25 "GET /compute/v2.1/servers/5983cbdc-7a92-49ec-a092-68ee6f1accdb" status: 200 len: 1265 microversion: 2.1 time: 0.151452 Nov 09 20:45:46.836257 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1318/2667] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:45:46 2021] GET /compute/v2.1/servers/5983cbdc-7a92-49ec-a092-68ee6f1accdb => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:45:47.851658 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-0b4aeabb-0d53-4c39-8d18-56de528d77a7 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:45:47.852265 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-0b4aeabb-0d53-4c39-8d18-56de528d77a7 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] [instance: 5983cbdc-7a92-49ec-a092-68ee6f1accdb] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:45:47.859175 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-0b4aeabb-0d53-4c39-8d18-56de528d77a7 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:45:47.859621 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-0b4aeabb-0d53-4c39-8d18-56de528d77a7 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:45:47.860389 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-0b4aeabb-0d53-4c39-8d18-56de528d77a7 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:45:47.860860 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-0b4aeabb-0d53-4c39-8d18-56de528d77a7 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:45:47.992019 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-0b4aeabb-0d53-4c39-8d18-56de528d77a7 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d26c07791240fcac7bcf26606fce8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9858a3c560894023a1fdd7e30f9759da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:45:47.999742 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-0b4aeabb-0d53-4c39-8d18-56de528d77a7 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] 10.222.0.25 "GET /compute/v2.1/servers/5983cbdc-7a92-49ec-a092-68ee6f1accdb" status: 200 len: 1265 microversion: 2.1 time: 0.151743 Nov 09 20:45:48.000258 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1350/2668] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:45:47 2021] GET /compute/v2.1/servers/5983cbdc-7a92-49ec-a092-68ee6f1accdb => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:45:49.016428 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-be0801ae-9516-4ccb-8051-e79639cb85f9 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:45:49.016972 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-be0801ae-9516-4ccb-8051-e79639cb85f9 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] [instance: 5983cbdc-7a92-49ec-a092-68ee6f1accdb] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:45:49.023210 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-be0801ae-9516-4ccb-8051-e79639cb85f9 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:45:49.023658 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-be0801ae-9516-4ccb-8051-e79639cb85f9 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:45:49.024445 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-be0801ae-9516-4ccb-8051-e79639cb85f9 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:45:49.024882 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-be0801ae-9516-4ccb-8051-e79639cb85f9 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:45:49.157731 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-be0801ae-9516-4ccb-8051-e79639cb85f9 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d26c07791240fcac7bcf26606fce8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9858a3c560894023a1fdd7e30f9759da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:45:49.165115 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-be0801ae-9516-4ccb-8051-e79639cb85f9 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] 10.222.0.25 "GET /compute/v2.1/servers/5983cbdc-7a92-49ec-a092-68ee6f1accdb" status: 200 len: 1265 microversion: 2.1 time: 0.152663 Nov 09 20:45:49.165683 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1319/2669] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:45:49 2021] GET /compute/v2.1/servers/5983cbdc-7a92-49ec-a092-68ee6f1accdb => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:45:50.182796 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [req-008ed0cc-3235-428c-8831-2549f5b9eb21 req-84f5338c-3282-49b9-b3ca-5a3f08086ffc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5983cbdc-7a92-49ec-a092-68ee6f1accdb", "name": "network-vif-plugged", "status": "completed", "tag": "6f01d5e3-9ef2-4b67-8715-660581726999"}]} {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:45:50.185007 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-17249a7d-d6e1-4a7d-970c-b2ced4fb4a6b tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:45:50.185448 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 20:45:50.185448 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: warnings.warn(msg) Nov 09 20:45:50.186286 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-17249a7d-d6e1-4a7d-970c-b2ced4fb4a6b tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] [instance: 5983cbdc-7a92-49ec-a092-68ee6f1accdb] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:45:50.193559 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-17249a7d-d6e1-4a7d-970c-b2ced4fb4a6b tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:45:50.193995 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-17249a7d-d6e1-4a7d-970c-b2ced4fb4a6b tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:45:50.194852 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-17249a7d-d6e1-4a7d-970c-b2ced4fb4a6b tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:45:50.195530 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-17249a7d-d6e1-4a7d-970c-b2ced4fb4a6b tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:45:50.196034 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [req-008ed0cc-3235-428c-8831-2549f5b9eb21 req-84f5338c-3282-49b9-b3ca-5a3f08086ffc service nova] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:45:50.197037 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [req-008ed0cc-3235-428c-8831-2549f5b9eb21 req-84f5338c-3282-49b9-b3ca-5a3f08086ffc service nova] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:45:50.211976 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.compute.server_external_events [req-008ed0cc-3235-428c-8831-2549f5b9eb21 req-84f5338c-3282-49b9-b3ca-5a3f08086ffc service nova] Creating event network-vif-plugged:6f01d5e3-9ef2-4b67-8715-660581726999 for instance 5983cbdc-7a92-49ec-a092-68ee6f1accdb on hv-cinder-80135 Nov 09 20:45:50.217191 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [req-008ed0cc-3235-428c-8831-2549f5b9eb21 req-84f5338c-3282-49b9-b3ca-5a3f08086ffc service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040900 Nov 09 20:45:50.218327 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1351/2670] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Nov 9 20:45:50 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:45:50.333351 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-17249a7d-d6e1-4a7d-970c-b2ced4fb4a6b tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d26c07791240fcac7bcf26606fce8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9858a3c560894023a1fdd7e30f9759da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:45:50.340609 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-17249a7d-d6e1-4a7d-970c-b2ced4fb4a6b tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] 10.222.0.25 "GET /compute/v2.1/servers/5983cbdc-7a92-49ec-a092-68ee6f1accdb" status: 200 len: 1265 microversion: 2.1 time: 0.159547 Nov 09 20:45:50.341344 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1320/2671] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:45:50 2021] GET /compute/v2.1/servers/5983cbdc-7a92-49ec-a092-68ee6f1accdb => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 20:45:51.358821 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-e2feed53-5694-4e39-b430-aa2853ce7bcc tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:45:51.359506 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-e2feed53-5694-4e39-b430-aa2853ce7bcc tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] [instance: 5983cbdc-7a92-49ec-a092-68ee6f1accdb] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:45:51.365897 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e2feed53-5694-4e39-b430-aa2853ce7bcc tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:45:51.366333 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e2feed53-5694-4e39-b430-aa2853ce7bcc tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:45:51.367976 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e2feed53-5694-4e39-b430-aa2853ce7bcc tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:45:51.369077 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e2feed53-5694-4e39-b430-aa2853ce7bcc tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:45:51.503902 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-e2feed53-5694-4e39-b430-aa2853ce7bcc tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d26c07791240fcac7bcf26606fce8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9858a3c560894023a1fdd7e30f9759da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:45:51.511474 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-e2feed53-5694-4e39-b430-aa2853ce7bcc tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] 10.222.0.25 "GET /compute/v2.1/servers/5983cbdc-7a92-49ec-a092-68ee6f1accdb" status: 200 len: 1265 microversion: 2.1 time: 0.156629 Nov 09 20:45:51.512024 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1352/2672] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:45:51 2021] GET /compute/v2.1/servers/5983cbdc-7a92-49ec-a092-68ee6f1accdb => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:45:52.528646 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-1fe4aaeb-eabf-45f4-b7d8-88bc29ad3958 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:45:52.529255 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-1fe4aaeb-eabf-45f4-b7d8-88bc29ad3958 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] [instance: 5983cbdc-7a92-49ec-a092-68ee6f1accdb] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:45:52.536358 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1fe4aaeb-eabf-45f4-b7d8-88bc29ad3958 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:45:52.536779 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1fe4aaeb-eabf-45f4-b7d8-88bc29ad3958 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:45:52.537545 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1fe4aaeb-eabf-45f4-b7d8-88bc29ad3958 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:45:52.537983 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1fe4aaeb-eabf-45f4-b7d8-88bc29ad3958 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:45:52.670389 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-1fe4aaeb-eabf-45f4-b7d8-88bc29ad3958 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d26c07791240fcac7bcf26606fce8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9858a3c560894023a1fdd7e30f9759da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:45:52.678367 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-1fe4aaeb-eabf-45f4-b7d8-88bc29ad3958 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] 10.222.0.25 "GET /compute/v2.1/servers/5983cbdc-7a92-49ec-a092-68ee6f1accdb" status: 200 len: 1452 microversion: 2.1 time: 0.153368 Nov 09 20:45:52.678929 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1321/2673] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:45:52 2021] GET /compute/v2.1/servers/5983cbdc-7a92-49ec-a092-68ee6f1accdb => generated 1452 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:45:52.694539 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-fe486e12-9c99-4780-bd03-1318efd8bebe tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:45:52.695139 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-fe486e12-9c99-4780-bd03-1318efd8bebe tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] [instance: 5983cbdc-7a92-49ec-a092-68ee6f1accdb] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:45:52.701313 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-fe486e12-9c99-4780-bd03-1318efd8bebe tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:45:52.701752 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-fe486e12-9c99-4780-bd03-1318efd8bebe tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:45:52.702642 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-fe486e12-9c99-4780-bd03-1318efd8bebe tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:45:52.703064 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-fe486e12-9c99-4780-bd03-1318efd8bebe tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:45:52.838624 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-fe486e12-9c99-4780-bd03-1318efd8bebe tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d26c07791240fcac7bcf26606fce8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9858a3c560894023a1fdd7e30f9759da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:45:52.846678 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-fe486e12-9c99-4780-bd03-1318efd8bebe tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] 10.222.0.25 "GET /compute/v2.1/servers/5983cbdc-7a92-49ec-a092-68ee6f1accdb" status: 200 len: 1452 microversion: 2.1 time: 0.155716 Nov 09 20:45:52.847243 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1353/2674] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:45:52 2021] GET /compute/v2.1/servers/5983cbdc-7a92-49ec-a092-68ee6f1accdb => generated 1452 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 20:45:54.443050 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [req-dde264cb-ceb9-4954-b048-fda087ed4e27 req-0c35ee75-85bc-449d-8b88-9654719b2a2e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5983cbdc-7a92-49ec-a092-68ee6f1accdb", "tag": "6f01d5e3-9ef2-4b67-8715-660581726999"}]} {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:45:54.444574 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 20:45:54.444574 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: warnings.warn(msg) Nov 09 20:45:54.453970 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-dde264cb-ceb9-4954-b048-fda087ed4e27 req-0c35ee75-85bc-449d-8b88-9654719b2a2e service nova] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:45:54.454405 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [req-dde264cb-ceb9-4954-b048-fda087ed4e27 req-0c35ee75-85bc-449d-8b88-9654719b2a2e service nova] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:45:54.464904 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.compute.server_external_events [req-dde264cb-ceb9-4954-b048-fda087ed4e27 req-0c35ee75-85bc-449d-8b88-9654719b2a2e service nova] Creating event network-changed:6f01d5e3-9ef2-4b67-8715-660581726999 for instance 5983cbdc-7a92-49ec-a092-68ee6f1accdb on hv-cinder-80135 Nov 09 20:45:54.470845 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [req-dde264cb-ceb9-4954-b048-fda087ed4e27 req-0c35ee75-85bc-449d-8b88-9654719b2a2e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031250 Nov 09 20:45:54.471450 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1322/2675] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Nov 9 20:45:54 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:46:05.713665 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 09 20:46:05.714129 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: Tue Nov 9 20:46:05 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 09 20:47:28.298952 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-5bbee6f0-e9f5-4fd8-8d81-d66ef30d0553 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-454209834", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2081092357", "security_groups": [{"name": "tempest-secgroup-smoke-1239717613"}], "block_device_mapping_v2": [{"uuid": "4bff4dc1-96f5-4687-a116-28e2acf0ce3d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f3b9dec4-c021-48b3-8c75-239f3e6bb8fa"}]}} {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:47:28.534866 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.network.neutron [None req-5bbee6f0-e9f5-4fd8-8d81-d66ef30d0553 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] validate_networks() for [('f3b9dec4-c021-48b3-8c75-239f3e6bb8fa', None, None, None, None, None)] {{(pid=116102) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 09 20:47:28.970563 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.virt.hardware [None req-5bbee6f0-e9f5-4fd8-8d81-d66ef30d0553 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Flavor limits 0:0:0 {{(pid=116102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 09 20:47:28.970986 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.virt.hardware [None req-5bbee6f0-e9f5-4fd8-8d81-d66ef30d0553 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Image limits 0:0:0 {{(pid=116102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 09 20:47:28.971450 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.virt.hardware [None req-5bbee6f0-e9f5-4fd8-8d81-d66ef30d0553 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Flavor pref 0:0:0 {{(pid=116102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 09 20:47:28.971853 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.virt.hardware [None req-5bbee6f0-e9f5-4fd8-8d81-d66ef30d0553 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Image pref 0:0:0 {{(pid=116102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 09 20:47:28.972257 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.virt.hardware [None req-5bbee6f0-e9f5-4fd8-8d81-d66ef30d0553 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 09 20:47:28.980963 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-5bbee6f0-e9f5-4fd8-8d81-d66ef30d0553 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:47:28.981408 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-5bbee6f0-e9f5-4fd8-8d81-d66ef30d0553 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:47:28.982209 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-5bbee6f0-e9f5-4fd8-8d81-d66ef30d0553 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:47:28.982642 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-5bbee6f0-e9f5-4fd8-8d81-d66ef30d0553 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:47:28.998524 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.quota [None req-5bbee6f0-e9f5-4fd8-8d81-d66ef30d0553 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Getting quotas for project 9858a3c560894023a1fdd7e30f9759da. Resources: {'cores', 'instances', 'ram'} {{(pid=116102) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 09 20:47:29.002289 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.quota [None req-5bbee6f0-e9f5-4fd8-8d81-d66ef30d0553 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Getting quotas for user 03d26c07791240fcac7bcf26606fce8f and project 9858a3c560894023a1fdd7e30f9759da. Resources: {'cores', 'instances', 'ram'} {{(pid=116102) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 09 20:47:29.056641 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-5bbee6f0-e9f5-4fd8-8d81-d66ef30d0553 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Going to run 1 instances... {{(pid=116102) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 09 20:47:29.058782 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-5bbee6f0-e9f5-4fd8-8d81-d66ef30d0553 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] [instance: 6defb15e-c775-4ae2-86cb-6f0f5c90a228] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4bff4dc1-96f5-4687-a116-28e2acf0ce3d',volume_size=None,volume_type=None)] {{(pid=116102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 09 20:47:29.177528 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: ERROR oslo.messaging._drivers.impl_rabbit [None req-5bbee6f0-e9f5-4fd8-8d81-d66ef30d0553 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] [f935c386-d614-49b2-bf9c-1c6e2c9b3906] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 09 20:47:30.194630 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO oslo.messaging._drivers.impl_rabbit [None req-5bbee6f0-e9f5-4fd8-8d81-d66ef30d0553 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] [f935c386-d614-49b2-bf9c-1c6e2c9b3906] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 47748. Nov 09 20:47:30.198440 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-5bbee6f0-e9f5-4fd8-8d81-d66ef30d0553 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.903615 Nov 09 20:47:30.199076 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1354/2676] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Nov 9 20:47:28 2021] POST /compute/v2.1/servers => generated 406 bytes in 1905 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 09 20:47:30.211683 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-19e03213-a5a9-446d-a5b8-3a8e4bc94dd1 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:47:30.212372 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-19e03213-a5a9-446d-a5b8-3a8e4bc94dd1 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] [instance: 6defb15e-c775-4ae2-86cb-6f0f5c90a228] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:47:30.316594 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-19e03213-a5a9-446d-a5b8-3a8e4bc94dd1 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d26c07791240fcac7bcf26606fce8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9858a3c560894023a1fdd7e30f9759da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:47:30.323718 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-19e03213-a5a9-446d-a5b8-3a8e4bc94dd1 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] 10.222.0.25 "GET /compute/v2.1/servers/6defb15e-c775-4ae2-86cb-6f0f5c90a228" status: 200 len: 1094 microversion: 2.1 time: 0.118383 Nov 09 20:47:30.324287 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1323/2677] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:47:30 2021] GET /compute/v2.1/servers/6defb15e-c775-4ae2-86cb-6f0f5c90a228 => generated 1094 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:47:31.341748 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-dd80d308-0394-4cac-887b-deaceb72f5f7 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:47:31.342365 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-dd80d308-0394-4cac-887b-deaceb72f5f7 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] [instance: 6defb15e-c775-4ae2-86cb-6f0f5c90a228] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:47:31.348332 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-dd80d308-0394-4cac-887b-deaceb72f5f7 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:47:31.348804 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-dd80d308-0394-4cac-887b-deaceb72f5f7 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:47:31.350065 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-dd80d308-0394-4cac-887b-deaceb72f5f7 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:47:31.350493 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-dd80d308-0394-4cac-887b-deaceb72f5f7 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:47:31.410403 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-dd80d308-0394-4cac-887b-deaceb72f5f7 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d26c07791240fcac7bcf26606fce8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9858a3c560894023a1fdd7e30f9759da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:47:31.421398 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-dd80d308-0394-4cac-887b-deaceb72f5f7 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] 10.222.0.25 "GET /compute/v2.1/servers/6defb15e-c775-4ae2-86cb-6f0f5c90a228" status: 200 len: 1210 microversion: 2.1 time: 0.084572 Nov 09 20:47:31.421974 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1355/2678] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:47:31 2021] GET /compute/v2.1/servers/6defb15e-c775-4ae2-86cb-6f0f5c90a228 => generated 1210 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:47:32.438836 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-4dbc5b74-2c0f-449a-92ab-9282091be5f1 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:47:32.439862 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-4dbc5b74-2c0f-449a-92ab-9282091be5f1 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] [instance: 6defb15e-c775-4ae2-86cb-6f0f5c90a228] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:47:32.448030 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4dbc5b74-2c0f-449a-92ab-9282091be5f1 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:47:32.448582 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4dbc5b74-2c0f-449a-92ab-9282091be5f1 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:47:32.449556 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4dbc5b74-2c0f-449a-92ab-9282091be5f1 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:47:32.450185 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-4dbc5b74-2c0f-449a-92ab-9282091be5f1 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:47:32.642774 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [req-fbe94ce6-7213-47e9-804e-ad6960a50ef1 req-a6f255ea-0b5d-4861-9dee-e202957e68c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6defb15e-c775-4ae2-86cb-6f0f5c90a228", "tag": "11321244-327c-47fc-baf1-49e5d3a09cbf"}]} {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:47:32.645440 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 20:47:32.645440 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: warnings.warn(msg) Nov 09 20:47:32.654716 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [req-fbe94ce6-7213-47e9-804e-ad6960a50ef1 req-a6f255ea-0b5d-4861-9dee-e202957e68c6 service nova] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:47:32.655693 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [req-fbe94ce6-7213-47e9-804e-ad6960a50ef1 req-a6f255ea-0b5d-4861-9dee-e202957e68c6 service nova] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:47:32.672347 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.compute.server_external_events [req-fbe94ce6-7213-47e9-804e-ad6960a50ef1 req-a6f255ea-0b5d-4861-9dee-e202957e68c6 service nova] Creating event network-changed:11321244-327c-47fc-baf1-49e5d3a09cbf for instance 6defb15e-c775-4ae2-86cb-6f0f5c90a228 on hv-cinder-80135 Nov 09 20:47:32.679457 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [req-fbe94ce6-7213-47e9-804e-ad6960a50ef1 req-a6f255ea-0b5d-4861-9dee-e202957e68c6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.131886 Nov 09 20:47:32.680519 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1356/2679] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Nov 9 20:47:32 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 20:47:32.895329 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-4dbc5b74-2c0f-449a-92ab-9282091be5f1 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d26c07791240fcac7bcf26606fce8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9858a3c560894023a1fdd7e30f9759da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:47:32.902575 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-4dbc5b74-2c0f-449a-92ab-9282091be5f1 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] 10.222.0.25 "GET /compute/v2.1/servers/6defb15e-c775-4ae2-86cb-6f0f5c90a228" status: 200 len: 1266 microversion: 2.1 time: 0.467422 Nov 09 20:47:32.903121 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1324/2680] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:47:32 2021] GET /compute/v2.1/servers/6defb15e-c775-4ae2-86cb-6f0f5c90a228 => generated 1266 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:47:33.919533 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-4ba1118e-4e9f-45cc-b101-70431db07ca3 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:47:33.920260 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-4ba1118e-4e9f-45cc-b101-70431db07ca3 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] [instance: 6defb15e-c775-4ae2-86cb-6f0f5c90a228] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:47:33.926738 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-4ba1118e-4e9f-45cc-b101-70431db07ca3 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:47:33.927190 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-4ba1118e-4e9f-45cc-b101-70431db07ca3 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:47:33.928175 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-4ba1118e-4e9f-45cc-b101-70431db07ca3 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:47:33.928642 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-4ba1118e-4e9f-45cc-b101-70431db07ca3 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:47:34.056606 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-4ba1118e-4e9f-45cc-b101-70431db07ca3 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d26c07791240fcac7bcf26606fce8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9858a3c560894023a1fdd7e30f9759da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:47:34.064091 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-4ba1118e-4e9f-45cc-b101-70431db07ca3 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] 10.222.0.25 "GET /compute/v2.1/servers/6defb15e-c775-4ae2-86cb-6f0f5c90a228" status: 200 len: 1266 microversion: 2.1 time: 0.148507 Nov 09 20:47:34.064745 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1357/2681] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:47:33 2021] GET /compute/v2.1/servers/6defb15e-c775-4ae2-86cb-6f0f5c90a228 => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:47:35.080289 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-095da91b-94c5-4ba6-9484-2bf0a212f9c6 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:47:35.080854 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-095da91b-94c5-4ba6-9484-2bf0a212f9c6 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] [instance: 6defb15e-c775-4ae2-86cb-6f0f5c90a228] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:47:35.087284 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-095da91b-94c5-4ba6-9484-2bf0a212f9c6 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:47:35.087730 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-095da91b-94c5-4ba6-9484-2bf0a212f9c6 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:47:35.088529 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-095da91b-94c5-4ba6-9484-2bf0a212f9c6 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:47:35.088962 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-095da91b-94c5-4ba6-9484-2bf0a212f9c6 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:47:35.219385 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-095da91b-94c5-4ba6-9484-2bf0a212f9c6 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d26c07791240fcac7bcf26606fce8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9858a3c560894023a1fdd7e30f9759da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:47:35.227167 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-095da91b-94c5-4ba6-9484-2bf0a212f9c6 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] 10.222.0.25 "GET /compute/v2.1/servers/6defb15e-c775-4ae2-86cb-6f0f5c90a228" status: 200 len: 1266 microversion: 2.1 time: 0.150597 Nov 09 20:47:35.227723 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1325/2682] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:47:35 2021] GET /compute/v2.1/servers/6defb15e-c775-4ae2-86cb-6f0f5c90a228 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:47:36.244319 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-56d51b95-ca4b-43d9-a03d-e73402d8f368 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:47:36.244977 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-56d51b95-ca4b-43d9-a03d-e73402d8f368 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] [instance: 6defb15e-c775-4ae2-86cb-6f0f5c90a228] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:47:36.250906 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-56d51b95-ca4b-43d9-a03d-e73402d8f368 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:47:36.251345 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-56d51b95-ca4b-43d9-a03d-e73402d8f368 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:47:36.252099 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-56d51b95-ca4b-43d9-a03d-e73402d8f368 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:47:36.252557 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-56d51b95-ca4b-43d9-a03d-e73402d8f368 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:47:36.383725 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-56d51b95-ca4b-43d9-a03d-e73402d8f368 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d26c07791240fcac7bcf26606fce8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9858a3c560894023a1fdd7e30f9759da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:47:36.391149 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-56d51b95-ca4b-43d9-a03d-e73402d8f368 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] 10.222.0.25 "GET /compute/v2.1/servers/6defb15e-c775-4ae2-86cb-6f0f5c90a228" status: 200 len: 1266 microversion: 2.1 time: 0.151042 Nov 09 20:47:36.391696 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1358/2683] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:47:36 2021] GET /compute/v2.1/servers/6defb15e-c775-4ae2-86cb-6f0f5c90a228 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:47:37.407934 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-c5c6472d-4b78-44ce-a409-8f162f352b2c tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:47:37.408567 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-c5c6472d-4b78-44ce-a409-8f162f352b2c tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] [instance: 6defb15e-c775-4ae2-86cb-6f0f5c90a228] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:47:37.415406 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c5c6472d-4b78-44ce-a409-8f162f352b2c tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:47:37.415851 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c5c6472d-4b78-44ce-a409-8f162f352b2c tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:47:37.416654 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c5c6472d-4b78-44ce-a409-8f162f352b2c tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:47:37.417089 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c5c6472d-4b78-44ce-a409-8f162f352b2c tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:47:37.547975 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-c5c6472d-4b78-44ce-a409-8f162f352b2c tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d26c07791240fcac7bcf26606fce8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9858a3c560894023a1fdd7e30f9759da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:47:37.555665 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-c5c6472d-4b78-44ce-a409-8f162f352b2c tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] 10.222.0.25 "GET /compute/v2.1/servers/6defb15e-c775-4ae2-86cb-6f0f5c90a228" status: 200 len: 1266 microversion: 2.1 time: 0.151680 Nov 09 20:47:37.556215 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1326/2684] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:47:37 2021] GET /compute/v2.1/servers/6defb15e-c775-4ae2-86cb-6f0f5c90a228 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:47:38.573147 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-657b47d1-14e3-4b87-9ed0-1bceaa8f0f2f tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:47:38.573709 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-657b47d1-14e3-4b87-9ed0-1bceaa8f0f2f tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] [instance: 6defb15e-c775-4ae2-86cb-6f0f5c90a228] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:47:38.579936 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-657b47d1-14e3-4b87-9ed0-1bceaa8f0f2f tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:47:38.580446 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-657b47d1-14e3-4b87-9ed0-1bceaa8f0f2f tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:47:38.581216 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-657b47d1-14e3-4b87-9ed0-1bceaa8f0f2f tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:47:38.581683 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-657b47d1-14e3-4b87-9ed0-1bceaa8f0f2f tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:47:38.715690 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-657b47d1-14e3-4b87-9ed0-1bceaa8f0f2f tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d26c07791240fcac7bcf26606fce8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9858a3c560894023a1fdd7e30f9759da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:47:38.722865 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-657b47d1-14e3-4b87-9ed0-1bceaa8f0f2f tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] 10.222.0.25 "GET /compute/v2.1/servers/6defb15e-c775-4ae2-86cb-6f0f5c90a228" status: 200 len: 1266 microversion: 2.1 time: 0.153458 Nov 09 20:47:38.723411 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1359/2685] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:47:38 2021] GET /compute/v2.1/servers/6defb15e-c775-4ae2-86cb-6f0f5c90a228 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:47:39.739649 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-20313c92-c8ef-4b15-a7fc-0c45448e01d9 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:47:39.740268 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-20313c92-c8ef-4b15-a7fc-0c45448e01d9 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] [instance: 6defb15e-c775-4ae2-86cb-6f0f5c90a228] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:47:39.746451 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-20313c92-c8ef-4b15-a7fc-0c45448e01d9 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:47:39.746888 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-20313c92-c8ef-4b15-a7fc-0c45448e01d9 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:47:39.747640 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-20313c92-c8ef-4b15-a7fc-0c45448e01d9 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:47:39.748067 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-20313c92-c8ef-4b15-a7fc-0c45448e01d9 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:47:39.876494 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-20313c92-c8ef-4b15-a7fc-0c45448e01d9 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d26c07791240fcac7bcf26606fce8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9858a3c560894023a1fdd7e30f9759da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:47:39.884621 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-20313c92-c8ef-4b15-a7fc-0c45448e01d9 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] 10.222.0.25 "GET /compute/v2.1/servers/6defb15e-c775-4ae2-86cb-6f0f5c90a228" status: 200 len: 1266 microversion: 2.1 time: 0.148278 Nov 09 20:47:39.885173 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1327/2686] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:47:39 2021] GET /compute/v2.1/servers/6defb15e-c775-4ae2-86cb-6f0f5c90a228 => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:47:40.901697 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-6841a6aa-1163-459c-9785-ea0f278395f7 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:47:40.902307 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-6841a6aa-1163-459c-9785-ea0f278395f7 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] [instance: 6defb15e-c775-4ae2-86cb-6f0f5c90a228] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:47:40.908579 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6841a6aa-1163-459c-9785-ea0f278395f7 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:47:40.909031 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6841a6aa-1163-459c-9785-ea0f278395f7 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:47:40.909802 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6841a6aa-1163-459c-9785-ea0f278395f7 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:47:40.910235 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-6841a6aa-1163-459c-9785-ea0f278395f7 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:47:41.045896 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-6841a6aa-1163-459c-9785-ea0f278395f7 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d26c07791240fcac7bcf26606fce8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9858a3c560894023a1fdd7e30f9759da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:47:41.053137 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-6841a6aa-1163-459c-9785-ea0f278395f7 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] 10.222.0.25 "GET /compute/v2.1/servers/6defb15e-c775-4ae2-86cb-6f0f5c90a228" status: 200 len: 1266 microversion: 2.1 time: 0.155084 Nov 09 20:47:41.053710 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1360/2687] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:47:40 2021] GET /compute/v2.1/servers/6defb15e-c775-4ae2-86cb-6f0f5c90a228 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:47:42.070210 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-80c99757-f4c7-4996-9b48-c00f6f4fccff tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:47:42.070801 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-80c99757-f4c7-4996-9b48-c00f6f4fccff tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] [instance: 6defb15e-c775-4ae2-86cb-6f0f5c90a228] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:47:42.077069 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-80c99757-f4c7-4996-9b48-c00f6f4fccff tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:47:42.077513 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-80c99757-f4c7-4996-9b48-c00f6f4fccff tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:47:42.078276 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-80c99757-f4c7-4996-9b48-c00f6f4fccff tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:47:42.078707 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-80c99757-f4c7-4996-9b48-c00f6f4fccff tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:47:42.206700 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-80c99757-f4c7-4996-9b48-c00f6f4fccff tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d26c07791240fcac7bcf26606fce8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9858a3c560894023a1fdd7e30f9759da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:47:42.214579 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-80c99757-f4c7-4996-9b48-c00f6f4fccff tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] 10.222.0.25 "GET /compute/v2.1/servers/6defb15e-c775-4ae2-86cb-6f0f5c90a228" status: 200 len: 1266 microversion: 2.1 time: 0.148367 Nov 09 20:47:42.215140 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1328/2688] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:47:42 2021] GET /compute/v2.1/servers/6defb15e-c775-4ae2-86cb-6f0f5c90a228 => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:47:42.845772 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [req-bb1aa60e-917b-43b3-9787-792e92228ce6 req-89e30dc3-4e98-4ad9-b107-9c139980ec3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6defb15e-c775-4ae2-86cb-6f0f5c90a228", "name": "network-vif-plugged", "status": "completed", "tag": "11321244-327c-47fc-baf1-49e5d3a09cbf"}]} {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:47:42.847302 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 20:47:42.847302 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: warnings.warn(msg) Nov 09 20:47:42.859632 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [req-bb1aa60e-917b-43b3-9787-792e92228ce6 req-89e30dc3-4e98-4ad9-b107-9c139980ec3e service nova] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:47:42.860092 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [req-bb1aa60e-917b-43b3-9787-792e92228ce6 req-89e30dc3-4e98-4ad9-b107-9c139980ec3e service nova] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:47:42.871227 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.compute.server_external_events [req-bb1aa60e-917b-43b3-9787-792e92228ce6 req-89e30dc3-4e98-4ad9-b107-9c139980ec3e service nova] Creating event network-vif-plugged:11321244-327c-47fc-baf1-49e5d3a09cbf for instance 6defb15e-c775-4ae2-86cb-6f0f5c90a228 on hv-cinder-80135 Nov 09 20:47:42.876057 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [req-bb1aa60e-917b-43b3-9787-792e92228ce6 req-89e30dc3-4e98-4ad9-b107-9c139980ec3e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086272 Nov 09 20:47:42.876689 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1361/2689] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Nov 9 20:47:42 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:47:43.231321 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-15f9261b-fb85-422b-adaf-c89d32e74149 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:47:43.231916 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-15f9261b-fb85-422b-adaf-c89d32e74149 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] [instance: 6defb15e-c775-4ae2-86cb-6f0f5c90a228] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:47:43.238086 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-15f9261b-fb85-422b-adaf-c89d32e74149 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:47:43.238521 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-15f9261b-fb85-422b-adaf-c89d32e74149 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:47:43.239277 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-15f9261b-fb85-422b-adaf-c89d32e74149 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:47:43.239701 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-15f9261b-fb85-422b-adaf-c89d32e74149 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:47:43.370514 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-15f9261b-fb85-422b-adaf-c89d32e74149 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d26c07791240fcac7bcf26606fce8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9858a3c560894023a1fdd7e30f9759da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:47:43.377662 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-15f9261b-fb85-422b-adaf-c89d32e74149 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] 10.222.0.25 "GET /compute/v2.1/servers/6defb15e-c775-4ae2-86cb-6f0f5c90a228" status: 200 len: 1266 microversion: 2.1 time: 0.149976 Nov 09 20:47:43.378221 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1329/2690] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:47:43 2021] GET /compute/v2.1/servers/6defb15e-c775-4ae2-86cb-6f0f5c90a228 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:47:44.395504 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-62b0d246-c566-4420-961a-dbf92e408302 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:47:44.396669 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-62b0d246-c566-4420-961a-dbf92e408302 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] [instance: 6defb15e-c775-4ae2-86cb-6f0f5c90a228] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:47:44.402646 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-62b0d246-c566-4420-961a-dbf92e408302 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:47:44.403089 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-62b0d246-c566-4420-961a-dbf92e408302 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:47:44.403845 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-62b0d246-c566-4420-961a-dbf92e408302 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:47:44.404273 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-62b0d246-c566-4420-961a-dbf92e408302 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:47:44.536641 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-62b0d246-c566-4420-961a-dbf92e408302 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d26c07791240fcac7bcf26606fce8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9858a3c560894023a1fdd7e30f9759da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:47:44.543724 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-62b0d246-c566-4420-961a-dbf92e408302 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] 10.222.0.25 "GET /compute/v2.1/servers/6defb15e-c775-4ae2-86cb-6f0f5c90a228" status: 200 len: 1453 microversion: 2.1 time: 0.152644 Nov 09 20:47:44.544279 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1362/2691] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:47:44 2021] GET /compute/v2.1/servers/6defb15e-c775-4ae2-86cb-6f0f5c90a228 => generated 1453 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 20:47:44.560045 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-bd08f1ef-d728-4704-a95e-08d6e995a4d8 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:47:44.560711 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-bd08f1ef-d728-4704-a95e-08d6e995a4d8 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] [instance: 6defb15e-c775-4ae2-86cb-6f0f5c90a228] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:47:44.566784 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bd08f1ef-d728-4704-a95e-08d6e995a4d8 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:47:44.567223 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bd08f1ef-d728-4704-a95e-08d6e995a4d8 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:47:44.568030 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bd08f1ef-d728-4704-a95e-08d6e995a4d8 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:47:44.569055 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-bd08f1ef-d728-4704-a95e-08d6e995a4d8 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:47:44.698009 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-bd08f1ef-d728-4704-a95e-08d6e995a4d8 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d26c07791240fcac7bcf26606fce8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9858a3c560894023a1fdd7e30f9759da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:47:44.705492 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-bd08f1ef-d728-4704-a95e-08d6e995a4d8 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] 10.222.0.25 "GET /compute/v2.1/servers/6defb15e-c775-4ae2-86cb-6f0f5c90a228" status: 200 len: 1453 microversion: 2.1 time: 0.149103 Nov 09 20:47:44.706043 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1330/2692] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:47:44 2021] GET /compute/v2.1/servers/6defb15e-c775-4ae2-86cb-6f0f5c90a228 => generated 1453 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:47:46.288392 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [req-3891ff2c-3608-4dd7-ad9b-1094b1269344 req-ca0c6fd9-85eb-4e98-9dbd-9fe547aeea9e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6defb15e-c775-4ae2-86cb-6f0f5c90a228", "tag": "11321244-327c-47fc-baf1-49e5d3a09cbf"}]} {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:47:46.290748 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 20:47:46.290748 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: warnings.warn(msg) Nov 09 20:47:46.298100 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [req-3891ff2c-3608-4dd7-ad9b-1094b1269344 req-ca0c6fd9-85eb-4e98-9dbd-9fe547aeea9e service nova] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:47:46.298533 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [req-3891ff2c-3608-4dd7-ad9b-1094b1269344 req-ca0c6fd9-85eb-4e98-9dbd-9fe547aeea9e service nova] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:47:46.309696 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.compute.server_external_events [req-3891ff2c-3608-4dd7-ad9b-1094b1269344 req-ca0c6fd9-85eb-4e98-9dbd-9fe547aeea9e service nova] Creating event network-changed:11321244-327c-47fc-baf1-49e5d3a09cbf for instance 6defb15e-c775-4ae2-86cb-6f0f5c90a228 on hv-cinder-80135 Nov 09 20:47:46.314383 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [req-3891ff2c-3608-4dd7-ad9b-1094b1269344 req-ca0c6fd9-85eb-4e98-9dbd-9fe547aeea9e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030286 Nov 09 20:47:46.314985 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1363/2693] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Nov 9 20:47:46 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:47:52.314092 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 09 20:47:52.314547 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: Tue Nov 9 20:47:52 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 09 20:48:07.658599 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 09 20:48:07.659334 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: Tue Nov 9 20:48:07 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 09 20:49:25.729164 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-7f4c9618-c5ce-4bd9-aa17-b1059d7d70ce tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:49:25.729768 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-7f4c9618-c5ce-4bd9-aa17-b1059d7d70ce tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] [instance: 6defb15e-c775-4ae2-86cb-6f0f5c90a228] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:49:25.731792 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 09 20:49:25.733361 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: Tue Nov 9 20:49:25 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.25) !!! Nov 09 20:49:25.738564 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7f4c9618-c5ce-4bd9-aa17-b1059d7d70ce tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:49:25.739110 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7f4c9618-c5ce-4bd9-aa17-b1059d7d70ce tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:49:25.739949 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7f4c9618-c5ce-4bd9-aa17-b1059d7d70ce tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:49:25.740474 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-7f4c9618-c5ce-4bd9-aa17-b1059d7d70ce tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:49:25.767608 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-7f4c9618-c5ce-4bd9-aa17-b1059d7d70ce tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] [instance: 6defb15e-c775-4ae2-86cb-6f0f5c90a228] Going to try to terminate instance {{(pid=116103) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 09 20:49:25.806218 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [req-6f3df6e3-ac86-4be5-9b65-07b8594c0a39 req-63e470eb-1f52-40d0-9f79-f07ab7eadac3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6defb15e-c775-4ae2-86cb-6f0f5c90a228", "tag": "11321244-327c-47fc-baf1-49e5d3a09cbf"}]} {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:49:25.808152 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 20:49:25.808152 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: warnings.warn(msg) Nov 09 20:49:25.815902 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [req-6f3df6e3-ac86-4be5-9b65-07b8594c0a39 req-63e470eb-1f52-40d0-9f79-f07ab7eadac3 service nova] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:49:25.816576 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [req-6f3df6e3-ac86-4be5-9b65-07b8594c0a39 req-63e470eb-1f52-40d0-9f79-f07ab7eadac3 service nova] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:49:25.827464 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.compute.server_external_events [req-6f3df6e3-ac86-4be5-9b65-07b8594c0a39 req-63e470eb-1f52-40d0-9f79-f07ab7eadac3 service nova] Creating event network-changed:11321244-327c-47fc-baf1-49e5d3a09cbf for instance 6defb15e-c775-4ae2-86cb-6f0f5c90a228 on hv-cinder-80135 Nov 09 20:49:25.832778 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [req-6f3df6e3-ac86-4be5-9b65-07b8594c0a39 req-63e470eb-1f52-40d0-9f79-f07ab7eadac3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101556 Nov 09 20:49:25.833365 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1364/2694] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Nov 9 20:49:25 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:49:25.851923 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-7f4c9618-c5ce-4bd9-aa17-b1059d7d70ce tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] 10.222.0.25 "DELETE /compute/v2.1/servers/6defb15e-c775-4ae2-86cb-6f0f5c90a228" status: 204 len: 0 microversion: 2.1 time: 0.127117 Nov 09 20:49:25.853211 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1331/2695] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Nov 9 20:49:25 2021] DELETE /compute/v2.1/servers/6defb15e-c775-4ae2-86cb-6f0f5c90a228 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 09 20:49:25.861931 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-baeba305-7653-411d-9925-3a9ff134de00 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:49:25.862621 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-baeba305-7653-411d-9925-3a9ff134de00 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] [instance: 6defb15e-c775-4ae2-86cb-6f0f5c90a228] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:49:25.869596 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-baeba305-7653-411d-9925-3a9ff134de00 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:49:25.870271 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-baeba305-7653-411d-9925-3a9ff134de00 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:49:25.871223 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-baeba305-7653-411d-9925-3a9ff134de00 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:49:25.871682 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-baeba305-7653-411d-9925-3a9ff134de00 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:49:26.020681 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-baeba305-7653-411d-9925-3a9ff134de00 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d26c07791240fcac7bcf26606fce8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9858a3c560894023a1fdd7e30f9759da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:49:26.027873 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-baeba305-7653-411d-9925-3a9ff134de00 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] 10.222.0.25 "GET /compute/v2.1/servers/6defb15e-c775-4ae2-86cb-6f0f5c90a228" status: 200 len: 1578 microversion: 2.1 time: 0.170229 Nov 09 20:49:26.028645 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1365/2696] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:49:25 2021] GET /compute/v2.1/servers/6defb15e-c775-4ae2-86cb-6f0f5c90a228 => generated 1578 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:49:27.046999 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-c27ad6e5-c1d5-436d-83dd-00493a1b237e tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:49:27.047687 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-c27ad6e5-c1d5-436d-83dd-00493a1b237e tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] [instance: 6defb15e-c775-4ae2-86cb-6f0f5c90a228] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:49:27.054226 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c27ad6e5-c1d5-436d-83dd-00493a1b237e tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:49:27.054665 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c27ad6e5-c1d5-436d-83dd-00493a1b237e tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:49:27.055421 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c27ad6e5-c1d5-436d-83dd-00493a1b237e tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:49:27.055845 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c27ad6e5-c1d5-436d-83dd-00493a1b237e tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:49:27.186633 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-c27ad6e5-c1d5-436d-83dd-00493a1b237e tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d26c07791240fcac7bcf26606fce8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9858a3c560894023a1fdd7e30f9759da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:49:27.193765 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-c27ad6e5-c1d5-436d-83dd-00493a1b237e tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] 10.222.0.25 "GET /compute/v2.1/servers/6defb15e-c775-4ae2-86cb-6f0f5c90a228" status: 200 len: 1459 microversion: 2.1 time: 0.151518 Nov 09 20:49:27.194319 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1332/2697] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:49:27 2021] GET /compute/v2.1/servers/6defb15e-c775-4ae2-86cb-6f0f5c90a228 => generated 1459 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:49:27.907575 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [req-86f28b04-f3dc-4de2-a6b2-d87d257cbe69 req-7678b07e-a2bb-4918-a066-a819520b9df2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6defb15e-c775-4ae2-86cb-6f0f5c90a228", "name": "network-vif-deleted", "tag": "11321244-327c-47fc-baf1-49e5d3a09cbf"}]} {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:49:27.909181 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 20:49:27.909181 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: warnings.warn(msg) Nov 09 20:49:27.916574 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [req-86f28b04-f3dc-4de2-a6b2-d87d257cbe69 req-7678b07e-a2bb-4918-a066-a819520b9df2 service nova] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:49:27.917014 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [req-86f28b04-f3dc-4de2-a6b2-d87d257cbe69 req-7678b07e-a2bb-4918-a066-a819520b9df2 service nova] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:49:27.928213 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.compute.server_external_events [req-86f28b04-f3dc-4de2-a6b2-d87d257cbe69 req-7678b07e-a2bb-4918-a066-a819520b9df2 service nova] Creating event network-vif-deleted:11321244-327c-47fc-baf1-49e5d3a09cbf for instance 6defb15e-c775-4ae2-86cb-6f0f5c90a228 on hv-cinder-80135 Nov 09 20:49:27.932994 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [req-86f28b04-f3dc-4de2-a6b2-d87d257cbe69 req-7678b07e-a2bb-4918-a066-a819520b9df2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029174 Nov 09 20:49:27.933581 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1366/2698] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Nov 9 20:49:27 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:49:28.210839 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-6faf653c-68c6-4426-8453-49aac0fc9ddf tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:49:28.211379 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-6faf653c-68c6-4426-8453-49aac0fc9ddf tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] [instance: 6defb15e-c775-4ae2-86cb-6f0f5c90a228] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:49:28.218409 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6faf653c-68c6-4426-8453-49aac0fc9ddf tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:49:28.218845 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6faf653c-68c6-4426-8453-49aac0fc9ddf tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:49:28.219650 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6faf653c-68c6-4426-8453-49aac0fc9ddf tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:49:28.220076 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-6faf653c-68c6-4426-8453-49aac0fc9ddf tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:49:28.282893 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-6faf653c-68c6-4426-8453-49aac0fc9ddf tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d26c07791240fcac7bcf26606fce8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9858a3c560894023a1fdd7e30f9759da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:49:28.290829 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-6faf653c-68c6-4426-8453-49aac0fc9ddf tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] 10.222.0.25 "GET /compute/v2.1/servers/6defb15e-c775-4ae2-86cb-6f0f5c90a228" status: 200 len: 1225 microversion: 2.1 time: 0.083563 Nov 09 20:49:28.291430 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1333/2699] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:49:28 2021] GET /compute/v2.1/servers/6defb15e-c775-4ae2-86cb-6f0f5c90a228 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:49:29.309436 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-44cc73db-f677-42fd-ba4b-245861d585ef tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:49:29.310622 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-44cc73db-f677-42fd-ba4b-245861d585ef tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] [instance: 6defb15e-c775-4ae2-86cb-6f0f5c90a228] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:49:29.316721 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-44cc73db-f677-42fd-ba4b-245861d585ef tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:49:29.317163 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-44cc73db-f677-42fd-ba4b-245861d585ef tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:49:29.317922 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-44cc73db-f677-42fd-ba4b-245861d585ef tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:49:29.318350 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-44cc73db-f677-42fd-ba4b-245861d585ef tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:49:29.331592 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.wsgi [None req-44cc73db-f677-42fd-ba4b-245861d585ef tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] HTTP exception thrown: Instance 6defb15e-c775-4ae2-86cb-6f0f5c90a228 could not be found. Nov 09 20:49:29.332158 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-44cc73db-f677-42fd-ba4b-245861d585ef tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Returning 404 to user: Instance 6defb15e-c775-4ae2-86cb-6f0f5c90a228 could not be found. {{(pid=116102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 09 20:49:29.333094 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-44cc73db-f677-42fd-ba4b-245861d585ef tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] 10.222.0.25 "GET /compute/v2.1/servers/6defb15e-c775-4ae2-86cb-6f0f5c90a228" status: 404 len: 111 microversion: 2.1 time: 0.028091 Nov 09 20:49:29.333609 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1367/2700] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:49:29 2021] GET /compute/v2.1/servers/6defb15e-c775-4ae2-86cb-6f0f5c90a228 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 09 20:49:32.606924 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-c622eaf8-84b9-47b3-8a78-b76149b17026 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:49:32.608704 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-c622eaf8-84b9-47b3-8a78-b76149b17026 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] [instance: 5983cbdc-7a92-49ec-a092-68ee6f1accdb] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:49:32.609789 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [req-0aa549d1-e142-40e0-9b56-a5465f1b45e8 req-2fd0e0ef-1fcb-489a-8cf3-afb04ab62079 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5983cbdc-7a92-49ec-a092-68ee6f1accdb", "tag": "6f01d5e3-9ef2-4b67-8715-660581726999"}]} {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:49:32.611262 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 20:49:32.611262 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: warnings.warn(msg) Nov 09 20:49:32.615112 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c622eaf8-84b9-47b3-8a78-b76149b17026 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:49:32.615651 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c622eaf8-84b9-47b3-8a78-b76149b17026 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:49:32.616532 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c622eaf8-84b9-47b3-8a78-b76149b17026 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:49:32.617132 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-c622eaf8-84b9-47b3-8a78-b76149b17026 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:49:32.618722 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [req-0aa549d1-e142-40e0-9b56-a5465f1b45e8 req-2fd0e0ef-1fcb-489a-8cf3-afb04ab62079 service nova] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:49:32.619350 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [req-0aa549d1-e142-40e0-9b56-a5465f1b45e8 req-2fd0e0ef-1fcb-489a-8cf3-afb04ab62079 service nova] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:49:32.631250 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.compute.server_external_events [req-0aa549d1-e142-40e0-9b56-a5465f1b45e8 req-2fd0e0ef-1fcb-489a-8cf3-afb04ab62079 service nova] Creating event network-changed:6f01d5e3-9ef2-4b67-8715-660581726999 for instance 5983cbdc-7a92-49ec-a092-68ee6f1accdb on hv-cinder-80135 Nov 09 20:49:32.637167 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [req-0aa549d1-e142-40e0-9b56-a5465f1b45e8 req-2fd0e0ef-1fcb-489a-8cf3-afb04ab62079 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030931 Nov 09 20:49:32.637963 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1368/2701] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Nov 9 20:49:32 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 20:49:32.644708 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-c622eaf8-84b9-47b3-8a78-b76149b17026 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] [instance: 5983cbdc-7a92-49ec-a092-68ee6f1accdb] Going to try to terminate instance {{(pid=116103) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 09 20:49:32.733676 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-c622eaf8-84b9-47b3-8a78-b76149b17026 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] 10.222.0.25 "DELETE /compute/v2.1/servers/5983cbdc-7a92-49ec-a092-68ee6f1accdb" status: 204 len: 0 microversion: 2.1 time: 0.130162 Nov 09 20:49:32.737430 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1334/2702] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Nov 9 20:49:32 2021] DELETE /compute/v2.1/servers/5983cbdc-7a92-49ec-a092-68ee6f1accdb => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 09 20:49:32.743271 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-09c79f84-a194-4ded-88ea-5556523c2f24 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:49:32.744088 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-09c79f84-a194-4ded-88ea-5556523c2f24 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] [instance: 5983cbdc-7a92-49ec-a092-68ee6f1accdb] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:49:32.750424 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-09c79f84-a194-4ded-88ea-5556523c2f24 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:49:32.751000 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-09c79f84-a194-4ded-88ea-5556523c2f24 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:49:32.751863 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-09c79f84-a194-4ded-88ea-5556523c2f24 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:49:32.752388 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-09c79f84-a194-4ded-88ea-5556523c2f24 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:49:32.906175 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.policy [None req-09c79f84-a194-4ded-88ea-5556523c2f24 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d26c07791240fcac7bcf26606fce8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9858a3c560894023a1fdd7e30f9759da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116102) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:49:32.914383 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-09c79f84-a194-4ded-88ea-5556523c2f24 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] 10.222.0.25 "GET /compute/v2.1/servers/5983cbdc-7a92-49ec-a092-68ee6f1accdb" status: 200 len: 1577 microversion: 2.1 time: 0.175192 Nov 09 20:49:32.925205 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1369/2703] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:49:32 2021] GET /compute/v2.1/servers/5983cbdc-7a92-49ec-a092-68ee6f1accdb => generated 1577 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:49:33.933544 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-707176e4-4710-4775-82e4-a97b83396ae5 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:49:33.934140 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-707176e4-4710-4775-82e4-a97b83396ae5 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] [instance: 5983cbdc-7a92-49ec-a092-68ee6f1accdb] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:49:33.940330 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-707176e4-4710-4775-82e4-a97b83396ae5 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:49:33.940802 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-707176e4-4710-4775-82e4-a97b83396ae5 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:49:33.941562 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-707176e4-4710-4775-82e4-a97b83396ae5 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:49:33.941991 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-707176e4-4710-4775-82e4-a97b83396ae5 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:49:34.074340 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-707176e4-4710-4775-82e4-a97b83396ae5 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d26c07791240fcac7bcf26606fce8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9858a3c560894023a1fdd7e30f9759da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:49:34.082468 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-707176e4-4710-4775-82e4-a97b83396ae5 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] 10.222.0.25 "GET /compute/v2.1/servers/5983cbdc-7a92-49ec-a092-68ee6f1accdb" status: 200 len: 1458 microversion: 2.1 time: 0.152971 Nov 09 20:49:34.083020 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1335/2704] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:49:33 2021] GET /compute/v2.1/servers/5983cbdc-7a92-49ec-a092-68ee6f1accdb => generated 1458 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:49:34.855745 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [req-dbbfe8fd-6b7c-4288-b8e9-3fe189c3124e req-1a71cd91-a7e2-4b4a-9eb9-5e079cdea1b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5983cbdc-7a92-49ec-a092-68ee6f1accdb", "name": "network-vif-deleted", "tag": "6f01d5e3-9ef2-4b67-8715-660581726999"}]} {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 20:49:34.858125 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 20:49:34.858125 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: warnings.warn(msg) Nov 09 20:49:34.865840 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [req-dbbfe8fd-6b7c-4288-b8e9-3fe189c3124e req-1a71cd91-a7e2-4b4a-9eb9-5e079cdea1b1 service nova] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:49:34.866286 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [req-dbbfe8fd-6b7c-4288-b8e9-3fe189c3124e req-1a71cd91-a7e2-4b4a-9eb9-5e079cdea1b1 service nova] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:49:34.878829 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.compute.server_external_events [req-dbbfe8fd-6b7c-4288-b8e9-3fe189c3124e req-1a71cd91-a7e2-4b4a-9eb9-5e079cdea1b1 service nova] Creating event network-vif-deleted:6f01d5e3-9ef2-4b67-8715-660581726999 for instance 5983cbdc-7a92-49ec-a092-68ee6f1accdb on hv-cinder-80135 Nov 09 20:49:34.883533 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [req-dbbfe8fd-6b7c-4288-b8e9-3fe189c3124e req-1a71cd91-a7e2-4b4a-9eb9-5e079cdea1b1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031777 Nov 09 20:49:34.884120 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1370/2705] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Nov 9 20:49:34 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 20:49:35.100259 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-80a42681-0182-4f18-8e04-4c39a1aea701 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:49:35.100889 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-80a42681-0182-4f18-8e04-4c39a1aea701 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] [instance: 5983cbdc-7a92-49ec-a092-68ee6f1accdb] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:49:35.107722 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-80a42681-0182-4f18-8e04-4c39a1aea701 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:49:35.108182 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-80a42681-0182-4f18-8e04-4c39a1aea701 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:49:35.108991 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-80a42681-0182-4f18-8e04-4c39a1aea701 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:49:35.109432 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-80a42681-0182-4f18-8e04-4c39a1aea701 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:49:35.177719 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.policy [None req-80a42681-0182-4f18-8e04-4c39a1aea701 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d26c07791240fcac7bcf26606fce8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9858a3c560894023a1fdd7e30f9759da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116103) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 20:49:35.185449 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-80a42681-0182-4f18-8e04-4c39a1aea701 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] 10.222.0.25 "GET /compute/v2.1/servers/5983cbdc-7a92-49ec-a092-68ee6f1accdb" status: 200 len: 1224 microversion: 2.1 time: 0.088773 Nov 09 20:49:35.186294 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1336/2706] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:49:35 2021] GET /compute/v2.1/servers/5983cbdc-7a92-49ec-a092-68ee6f1accdb => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 20:49:36.203911 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-cbc3ec12-944e-4de7-9961-66c57f549c58 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:49:36.204617 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-cbc3ec12-944e-4de7-9961-66c57f549c58 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] [instance: 5983cbdc-7a92-49ec-a092-68ee6f1accdb] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:49:36.210525 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-cbc3ec12-944e-4de7-9961-66c57f549c58 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:49:36.210968 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-cbc3ec12-944e-4de7-9961-66c57f549c58 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:49:36.211723 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-cbc3ec12-944e-4de7-9961-66c57f549c58 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:49:36.212151 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-cbc3ec12-944e-4de7-9961-66c57f549c58 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:49:36.224871 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.wsgi [None req-cbc3ec12-944e-4de7-9961-66c57f549c58 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] HTTP exception thrown: Instance 5983cbdc-7a92-49ec-a092-68ee6f1accdb could not be found. Nov 09 20:49:36.225438 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-cbc3ec12-944e-4de7-9961-66c57f549c58 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Returning 404 to user: Instance 5983cbdc-7a92-49ec-a092-68ee6f1accdb could not be found. {{(pid=116102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 09 20:49:36.226231 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-cbc3ec12-944e-4de7-9961-66c57f549c58 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] 10.222.0.25 "GET /compute/v2.1/servers/5983cbdc-7a92-49ec-a092-68ee6f1accdb" status: 404 len: 111 microversion: 2.1 time: 0.027445 Nov 09 20:49:36.226740 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1371/2707] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:49:36 2021] GET /compute/v2.1/servers/5983cbdc-7a92-49ec-a092-68ee6f1accdb => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 09 20:49:36.661801 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-1b085580-6d8b-4c85-b73b-3bd29b34c06c tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Calling method '>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:49:36.662273 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.compute.api [None req-1b085580-6d8b-4c85-b73b-3bd29b34c06c tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] [instance: 10121fdc-8839-4431-8688-40eaedc47e3d] Fetching instance by UUID {{(pid=116103) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:49:36.668056 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1b085580-6d8b-4c85-b73b-3bd29b34c06c tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:49:36.668532 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1b085580-6d8b-4c85-b73b-3bd29b34c06c tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:49:36.669990 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1b085580-6d8b-4c85-b73b-3bd29b34c06c tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:49:36.670612 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG oslo_concurrency.lockutils [None req-1b085580-6d8b-4c85-b73b-3bd29b34c06c tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:49:36.683172 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.wsgi [None req-1b085580-6d8b-4c85-b73b-3bd29b34c06c tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] HTTP exception thrown: Instance 10121fdc-8839-4431-8688-40eaedc47e3d could not be found. Nov 09 20:49:36.683751 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-1b085580-6d8b-4c85-b73b-3bd29b34c06c tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Returning 404 to user: Instance 10121fdc-8839-4431-8688-40eaedc47e3d could not be found. {{(pid=116103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 09 20:49:36.684610 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-1b085580-6d8b-4c85-b73b-3bd29b34c06c tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] 10.222.0.25 "DELETE /compute/v2.1/servers/10121fdc-8839-4431-8688-40eaedc47e3d" status: 404 len: 111 microversion: 2.1 time: 0.026480 Nov 09 20:49:36.685344 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1337/2708] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Nov 9 20:49:36 2021] DELETE /compute/v2.1/servers/10121fdc-8839-4431-8688-40eaedc47e3d => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 09 20:49:36.693097 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-e4b3697c-0d55-4d9c-b0df-72830268b3e9 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Calling method '>' {{(pid=116102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:49:36.693732 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.compute.api [None req-e4b3697c-0d55-4d9c-b0df-72830268b3e9 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] [instance: 10121fdc-8839-4431-8688-40eaedc47e3d] Fetching instance by UUID {{(pid=116102) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 20:49:36.699580 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e4b3697c-0d55-4d9c-b0df-72830268b3e9 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:49:36.700033 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e4b3697c-0d55-4d9c-b0df-72830268b3e9 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:49:36.700835 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e4b3697c-0d55-4d9c-b0df-72830268b3e9 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 20:49:36.701267 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG oslo_concurrency.lockutils [None req-e4b3697c-0d55-4d9c-b0df-72830268b3e9 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Lock "3fe77ec2-f067-4504-9205-b014cb4accd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 20:49:36.714060 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.wsgi [None req-e4b3697c-0d55-4d9c-b0df-72830268b3e9 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] HTTP exception thrown: Instance 10121fdc-8839-4431-8688-40eaedc47e3d could not be found. Nov 09 20:49:36.714633 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: DEBUG nova.api.openstack.wsgi [None req-e4b3697c-0d55-4d9c-b0df-72830268b3e9 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Returning 404 to user: Instance 10121fdc-8839-4431-8688-40eaedc47e3d could not be found. {{(pid=116102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 09 20:49:36.715437 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO nova.api.openstack.requestlog [None req-e4b3697c-0d55-4d9c-b0df-72830268b3e9 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] 10.222.0.25 "GET /compute/v2.1/servers/10121fdc-8839-4431-8688-40eaedc47e3d" status: 404 len: 111 microversion: 2.1 time: 0.026008 Nov 09 20:49:36.715953 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: [pid: 116102|app: 0|req: 1372/2709] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Nov 9 20:49:36 2021] GET /compute/v2.1/servers/10121fdc-8839-4431-8688-40eaedc47e3d => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 09 20:49:37.993569 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: DEBUG nova.api.openstack.wsgi [None req-e33b7594-713a-4eb3-890d-85a588cca7c1 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] Calling method '.version_select at 0x7fab3fdf6430>' {{(pid=116103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 20:49:38.016139 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO nova.api.openstack.requestlog [None req-e33b7594-713a-4eb3-890d-85a588cca7c1 tempest-TestVolumeBootPattern-826552214 tempest-TestVolumeBootPattern-826552214-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2081092357" status: 202 len: 0 microversion: 2.1 time: 0.026255 Nov 09 20:49:38.017113 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: [pid: 116103|app: 0|req: 1338/2710] 10.222.0.25 () {58 vars in 1262 bytes} [Tue Nov 9 20:49:37 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2081092357 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 09 20:51:27.677172 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 09 20:51:27.677833 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: Tue Nov 9 20:51:27 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 09 20:52:39.207899 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 09 20:52:39.208501 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: Tue Nov 9 20:52:39 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 09 20:52:45.757455 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 09 20:52:45.758070 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: Tue Nov 9 20:52:45 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 09 20:52:52.333337 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 09 20:52:52.333787 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: Tue Nov 9 20:52:52 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 09 20:54:37.309754 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 09 20:54:37.310306 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: Tue Nov 9 20:54:37 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 09 20:54:46.305279 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 09 20:54:46.305741 dv-cinder-801354-4-iscsi devstack@n-api.service[116102]: Tue Nov 9 20:54:46 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 09 20:54:47.694697 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 09 20:54:47.695220 dv-cinder-801354-4-iscsi devstack@n-api.service[116103]: Tue Nov 9 20:54:47 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!